Call for Paper - January 2023 Edition
IJCA solicits original research papers for the January 2023 Edition. Last date of manuscript submission is December 20, 2022. Read More

Arabic Short Answer Scoring with Effective Feedback for Students

Print
PDF
International Journal of Computer Applications
© 2014 by IJCA Journal
Volume 86 - Number 2
Year of Publication: 2014
Authors:
Wael Hassan Gomaa
Aly Aly Fahmy
10.5120/14961-3177

Wael Hassan Gomaa and Aly Aly Fahmy. Article: Arabic Short Answer Scoring with Effective Feedback for Students. International Journal of Computer Applications 86(2):35-41, January 2014. Full text available. BibTeX

@article{key:article,
	author = {Wael Hassan Gomaa and Aly Aly Fahmy},
	title = {Article: Arabic Short Answer Scoring with Effective Feedback for Students},
	journal = {International Journal of Computer Applications},
	year = {2014},
	volume = {86},
	number = {2},
	pages = {35-41},
	month = {January},
	note = {Full text available}
}

Abstract

In this paper, we explore text similarity techniques for the task of automatic short answer scoring in Arabic language. We compare a number of string-based and corpus-based similarity measures, evaluate the effect of combining these measures, handle student's answers holistically and partially, provide immediate useful feedback to student and also introduce a new benchmark Arabic data set that contains 50 questions and 600 student answers. Overall, the obtained correlation and error rate results prove that the presented system performs well enough for deployment in a real scoring environment.

References

  • Gomaa, W. H. , & Fahmy, A. A. (2013). Automatic scoring for answers to Arabic test questions. Computer Speech & Language. http://dx. doi. org/10. 1016/j. csl. 2013. 10. 005
  • Gomaa, W. H. & Fahmy, A. A. (2012). Short Answer Grading Using String Similarity and Corpus-Based Similarity. In International Journal of Advanced Computer Science and Applications (IJACSA), Vol. 3, No. 11.
  • Mohler, M. , & Mihalcea, R. (2009). Text-to-text semantic similarity for automatic short answer grading. In Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (pp. 567-575). Association for Computational Linguistics.
  • Mohler, M. , Bunescu, R. C. , & Mihalcea, R. (2011). Learning to Grade Short Answer Questions using Semantic Similarity Measures and Dependency Graph Alignments. In ACL (pp. 752-762).
  • Basu, S. , Jacobs, C. , & Vanderwende, L. (2013). Powergrading: a Clustering Approach to Amplify Human Effort for Short Answer Grading, In Transactions of the ACL (TACL).
  • Gomaa, W. H. & Fahmy, A. A. (2011). Tapping Into The Power of Automatic Scoring. the eleventh International Conference on Language Engineering, Egyptian Society of Language Engineering (ESOLEC '2011).
  • Ziai, R. , Ott, N. & Meurers, D. (2012). Short answer assessment: establishing links between research strands. In: Proceedings of the Seventh Workshopon Building Educational Applications Using NLP, June. Association for Computational Linguistics, pp. 190–200.
  • Rosé, C. P. , Roque, A. , Bhembe, D. , & VanLehn, K. (2003). A hybrid approach to content analysis for automatic essay grading. In Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology: companion volume of the Proceedings of HLT-NAACL 2003--short papers-Volume 2 (pp. 88-90). Association for Computational Linguistics.
  • Leacock, C. , Chodorow, M. (2003). C-Rater: automated scoring of short-answer questions. Computers and the Humanities 37 (4), 389–405.
  • Mitchell, T. , Russell, T. , Broomhead, P. & Aldridge, N. (2002). Towards robust computerized marking of free-text responses. In: Proceedings of the Sixth International Computer Assisted Assessment Conference. Loughborough University, Loughborough, UK.
  • Pulman, S. G. & Sukkarieh, J. Z. (2005). Automatic short answer marking. In: Proceedings of the Second Workshop on Building Educational Applications Using NLP, June. Association for Computational Linguistics, pp. 9–16.
  • Dzikovska, M. O. , Nielsen, R. D. , Brew, C. , Leacock, C. , Giampiccolo, D. , Bentivogli, L. , et al. (2013). SemEval 2013 task 7: the joint student response analysis and 8th recognizing textual entailment challenge. In: Proceedings of the 7th International Workshop on Semantic Evaluation (SemEval2013), in Conjunction with the Second Joint Conference on Lexical and Computational Semantics (*SEM 2013), Atlanta, Georgia, USA, June. Association for Computational Linguistics.
  • Dzikovska, M. O. , Nielsen, R. D. & Brew, C. (2012). Towards effective tutorial feedback for explanation questions: a dataset and baselines. In: Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, June. Association for Computational Linguistics, pp. 200–210.
  • Gomaa, W. H. , Fahmy, A. A. (2013). A Survey of text similarity approaches. International Journal of Computer Applications 68 (13), 13–18.
  • Kolb, P. (2009). Experiments on the difference between semantic similarity and relatedness. In Proceedings of the 17th Nordic Conference on Computational Linguistics NODALIDA'09.
  • Taghva, K. , Elkhoury, R. , & Coombs, J. (2005, April). Arabic stemming without a root dictionary. In Information Technology: Coding and Computing, 2005. ITCC 2005. International Conference on (Vol. 1, pp. 152-157). IEEE.
  • Hall, M. , Frank, E. , Holmes, G. , Pfahringer, B. , Reutemann, P. , & Witten, I. H. (2009). The WEKA data mining software: an update. ACM SIGKDD Explorations Newsletter, 11(1), 10-18.
  • Mostafa, M. S. , Haggag M. H. & Gomaa, W. H. (2008). Document Clustering using Word Sense Disambiguation, In proceeding of: 17th International Conference on Software Engineering and Data Engineering (SEDE 2008), June 30 - July 2, 2008, Omni Los Angeles Hotel at California Plaza, Los Angeles, California, USA.
  • Wang, H. & Song, M. (2011). Ckmeans : optimal k means clustering in one dimension by dynamic programming. The R Journal 3, 29–33.