The week's pick
Reseach Article
Automatic Ranking of MT Outputs using Approximations
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 81 - Number 17 |
| Year of Publication: 2013 |
| Authors: Pooja Gupta, Nisheeth Joshi, Iti Mathur |
10.5120/14217-2463
|
Pooja Gupta, Nisheeth Joshi, Iti Mathur . Automatic Ranking of MT Outputs using Approximations. International Journal of Computer Applications. 81, 17 ( November 2013), 27-31. DOI=10.5120/14217-2463
Abstract
Since long, research on machine translation has been ongoing. Still, we do not get good translations from MT engines so developed. Manual ranking of these outputs tends to be very time consuming and expensive. Identifying which one is better or worse than the others is a very taxing task. In this paper, we show an approach which can provide automatic ranks to MT outputs (translations) taken from different MT Engines and which is based on N-gram approximations. We provide a solution where no human intervention is required for ranking systems. Further we also show the evaluations of our results which show equivalent results as that of human ranking.
References
- Blatz, J. , Fitzgerald, E. , Foster, G. , Gandrabur, S. , Goutte, C. , Kulesza, A. , Sanchis, A, & Ueffing, N. 2004. Confidence estimation for machine translation. In proceedings of 20th Coling, Geneva.
- Ueffing, N. , & Ney, H. 2005. Word-level confidence estimation for machine translation using phrase-based translation models. Computational Linguistics.
- Specia, L. , Turchi, M. , Cancedda, N. , Dymetman, M. , & Cristianini, N. 2009. Estimating the Sentence-Level Quality of Machine Translation Systems. In 13th Annual Meeting of the European Association for Machine Translation (EAMT-2009) Barcelona, Spain.
- Raybaud, S. , Lavecchia, C. , David, L. , & Kamel, S. 2009. Word-and sentence-level confidence measures for machine translation. In 13th Annual Meeting of the European Association for Machine Translation (EAMT-2009), Barcelona, Spain. European Association of Machine Translation.
- Rosti, A. -V. , Ayan, N. F. , Xiang, B. , Matsoukas, S. , Schwartz, R. , & Dorr, B. J. 2007. Combining Outputs from Multiple Machine Translation Systems. In Proceedings of the North American Chapter of the Association for Computational Linguistics Human Language Technologies. Rochester, New York. Association for Computational Linguistics.
- Tavel, P. 2007 Modeling and Simulation Design. AK Peters Ltd.
- Soricut, R. , & Narsale, S. 2012. Combining Quality Prediction and System Selection for Improved Automatic Translation Output. In Proceedings of the Seventh Workshop on Statistical Machine Translation, Montréal, Canada. Association for Computational Linguistics.
- Avramidis E. 2012. Quality Estimation for Machine Translation output using linguistic analysis and decoding features. In Proceedings of the 7th Workshop on Statistical Machine Translation, Montréal, Canada June7-8, 2012
- Gupra, R. , Joshi, N. , & Mathur, I. 2013. Analysing Quality of English-Hindi Machine Translation Engine Outputs Using Bayesian Classification. International Journal of Artificial Intelligence and Applications, Vol 4, No 4, pp 165-171.
- Moore, R. C. , & Quirk, C. 2009. Improved Smoothing for N-gram Language Models Based on Ordinary Counts. In Proceedings of the ACL-IJCNLP 2009 Conference Short Papers.
- Setiawan, H. , & Zhou, B. 2013. Discriminative Training of 150 Million Translation Parameters and Its Application to Pruning. In Proceedings of NAACL-HLT 2013.
- Koehn, P. , Hoang, H. , Birch, A. , Callison-Burch, C. , Federico, M. , Bertoldi, N. , Cowan, B. , Shen, W. , Moran, C. , Zens, R. , Dyer, C. , Bojar, O. , Constantin, A. , & Herbst, E. 2007. Moses: Open source toolkit for statistical machine translation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, demonstration session.
- Hoang, H. , Koehn, P. , & Lopez, A. 2009. A unified framework for phrase-based, hierarchical, and syntax-based statistical machine translation. In Proc. of the International Workshop on Spoken Language Translation, Tokyo, Japan.
- Joshi N. , Mathur I. , and Mathur S. 2011. Translation Memory for Indian Languages: An Aid for Human Translators, Proceedings of 2nd International Conference and Workshop in Emerging Trends in Technology
- Joshi, N. , and Mathur, I. 2012. Design of English-Hindi Translation Memory for Efficient Translation. In Proc. of National Conference on Recent Advances in Computer Engineering.
- Joshi, N. , Darbari, H, & Mathur, I. 2012, Human and Automatic Evaluation of English to Hindi Machine Translation Systems. " Advances in Computer Science, Engineering & Applications. Springer Berlin Heidelberg, 2012. 423-432.
- Joshi, N. , Mathur, I. , Darbari, H, & Kumar, A. 2013, HEval: Yet Another Human Evaluation Metric. International Journal of Natural Language Computing, Vol 2, No 5, pp 21-36.
Index Terms
Keywords