Riya Lonchenpa1* , Anju Krishnia2 , Mhasilenuo Vizo3 & Nisheeth Joshi4 ,
1Department of English and Modern European Languages, Banasthali Vidyapith. *Corresponding author.
2,3Department of Hindi and Modern Indian Languages, Banasthali Vidyapith.
4Centre for Artificial Intelligence, Banasthali Vidyapith.
Rupkatha Journal, Vol. 17, Issue 3, 2025. https://doi.org/10.21659/rupkatha.v17n3.04g
Full-Text PDF Issue Access
Abstract
This study examines the human evaluation of machine translation (MT) systems, with particular emphasis on its significance in the contemporary era of neural machine translation. The evaluation employed a scalar quality metric comprising 11 distinct parameters, each rated on a scale from 0 to 4. Three MT engines—Google Translate, Bing Translator, and Anuvad MT Engine—were assessed using this framework. Human evaluators systematically analyzed translations across all parameters and documented recurring error patterns specific to each engine. Among the systems evaluated, the Anuvad MT Engine demonstrated superior performance in terms of overall translation quality.
Keywords:Neural Machine Translation, Human Evaluation, Scalar Quality Metric.
| Conflicts of Interest: The authors declared no conflicts of interest. Funding: Ministry of Electronics and Information Technology, Government of India. Article History: Received: 05 April 2025. Revised: 10 September 2025. Accepted: 12 September 2025. First published: 15 September 2025. Copyright: © 2025 by the author/s. License: License Aesthetix Media Services, India. Distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Published by: Aesthetix Media Services, India Citation: Lonchenpa, R., Krishnia, A., Vizo, M., & Joshi, N. (2025). Caste and the Continuing Battle: A Critical Study of Aravind Malagatti’s “Karya” in Contemporary India. Rupkatha Journal, 17(3). https://doi.org/10.21659/rupkatha.v17n3.04g |
