Call for Paper - November 2022 Edition
IJCA solicits original research papers for the November 2022 Edition. Last date of manuscript submission is October 20, 2022. Read More

Intelligent Arabic Sign Language to Arabic text Translation for Easy Deaf Communication

Print
PDF
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Year of Publication: 2018
Authors:
A. E. E. El Alfi, S. M. EL Atawy
10.5120/ijca2018917081

El A E E Alfi and EL S M Atawy. Intelligent Arabic Sign Language to Arabic text Translation for Easy Deaf Communication. International Journal of Computer Applications 180(41):19-26, May 2018. BibTeX

@article{10.5120/ijca2018917081,
	author = {A. E. E. El Alfi and S. M. EL Atawy},
	title = {Intelligent Arabic Sign Language to Arabic text Translation for Easy Deaf Communication},
	journal = {International Journal of Computer Applications},
	issue_date = {May 2018},
	volume = {180},
	number = {41},
	month = {May},
	year = {2018},
	issn = {0975-8887},
	pages = {19-26},
	numpages = {8},
	url = {http://www.ijcaonline.org/archives/volume180/number41/29403-2018917081},
	doi = {10.5120/ijca2018917081},
	publisher = {Foundation of Computer Science (FCS), NY, USA},
	address = {New York, USA}
}

Abstract

This paper presents an intelligent translation system for the signs of some words and letters in the Arabic sign language. The proposed translation system does not depend on any visual markings or gloves used to complete the recognition process. The proposed translation system deals with images, which allows the user to interact with the system in a natural way. The proposed translation system consists of four main phases; Preprocessing images phase, feature extraction phase, matching strategy phase, and Display Text Translation phase. The extracted features used are combining intensity histogram features and Gray Level Co-occurrence Matrix (GLCM) features, Experiments revealed that the proposed system was able to recognize the 19 Arabic alphabets and word with an accuracy of 73%.

References

  1. Ameera M.Almasoud and Hend S. Al-Khalifa," A Proposed Semantic Machine Translation System for translating Arabic text to Arabic sign language" , Second Kuwait Conf. on E-Services and E-Systems, April 5-7, 2011, pp 79-84.
  2. Aberdeen Marc Marschark, " Raising and Educating a Deaf Child: A Comprehensive Guide to the Choices ", Oxford University Press, 2007.
  3. A.Z Shukor, M.F Miskon, et al. “A New Data Glove Approach for Malaysian Sign Language Detection”. IEEE International Symposium on Robotics and Intelligent Sensors, Volume 76, 2015, p. 60–67.
  4. Abdul aziz Almohimeed et al , " Arabic Text to Arabic Sign Language Translation System for the Deaf and Hearing-Impaired Community", Proceedings of the 2nd Workshop on Speech and Language Processing for Assistive Technologies, Edinburgh, Association for Computational Linguistics, 2011, pp 101–109.
  5. Khaled Assaleh and M. Al-Rousan," Recognition of Arabic Sign Language Alphabet Using Polynomial Classifiers" , EURASIP Journal on Applied Signal Processing, vol (13) , 2005, p.p 2136–2145.
  6. Menna ElBadawy, A. S. Elons, and Howida A. Shedeed, “Arabic sign language recognition with 3D convolutional neural networks”, Proceedings of the International Conference on Intelligent Computing and Information Systems (ICICIS), 5-7 Dec. 2017.
  7. M. AL-Rousan, K. Assaleh, A. Tala'a, “Video-based signer-independent Arabic sign language recognition using hidden Markov models”, Applied Soft
  8. Computing Volume 9, Issue 3 (June) pp. 990-999, 2009.
  9. Aly, S., B. Osman, W. Aly and M. Saber, 2016. Arabic sign language fingerspelling recognition from depth and intensity images. Proceedings of 12th International Computer Engineering Conference, Dec. 28-29, IEEE Xplore Press, Cairo, Egypt, pp: 99-104. DOI: 10.1109/ICENCO.2016.7856452
  10. Elsayed E. Hemayed and Allam S. Hassanien : Edge-based recognizer for Arabic sign language alphabet (ArS2V-Arabic sign to voice),  International Computer Engineering Conference , 27-28 Dec. 2010 IEEE Xplore Press, Giza, Egypt, DOI: 10.1109/ICENCO.2010.5720438
  11. Basma Hisham and Alaa Hamouda, “Arabic Static and Dynamic Gestures Recognition Using Leap Motion”, Journal of Computer Science 2017, 13 (8): 337.354
  12. Youssef Kadri & Jian-Yun Nie, "Effective Stemming for Arabic Information Retrieval”, THE CHALLENGE OF ARABIC FOR NLP/MT, Available: http//atour.iro.umontreal.ca/rali/sites/.../BCS-2006.
  13. Loannis Pitas‏," Digital Image Processing Algorithms and Applications”, john Wiley & Sons Inc, 2000.
  14. Vinu V. Das‏, R. Vijaykumar," Information and Communication Technologies: International Conference, ICT 2010", communication in computer and information science 101, Springer village Berlin, 2010.
  15. Mehemmed Emre Celebi, “Development of Algorithms for Dermoscopy Image Analysis", ProQuest, 2006.
  16. Thomas M. Deserno, “Biomedical Image Processing”, Springer village Berlin, 2011.
  17. Muhammad Noorazlan Shah Zainudin and et al, “Feature extraction on medical image using 2D Gabor filter", Applied Mechanics and Materials Vols. 52-54, 2011, p.p 2128-2132.
  18. Evangelos Triantaphyllou, Giovanni Felici‏, “Data Mining and Knowledge Discovery Approaches Based on Rule Induction Techniques", Springer Science + Business media, LLC, 2006.
  19. Mihran Tuceryan , Anil K. Jain," Texture Analysis" , The Handbook of Pattern Recognition and Computer Vision (2nd Edition), by C. H. Chen, L. F. Pau,P. S. P. Wang (eds.), pp. 207-248, World Scientific Publishing Co., 1998.
  20. Peter Enser, et al," image and video retrieval", third international conference CIVR2004, Springer – verlag Berlin Heidelberg, 2004.
  21. Marina L. Gavrilova," Generalized Voronoi Diagram: A Geometry-Based Approach to Computational intelligence", Springer – verlag Berlin Heidelberg, 2008.
  22. Donat P. Hader‏," Image Analysis: Methods and Applications, Second Edition", CRC Press ,2001.
  23. Manuel Graña‏، Carlos Toro‏،Jorge Posada‏،Robert J. Howlett, ‏and Lakhmi C. Jain‏ ," Advances in Knowledge-Based and Intelligent Information and Engineering Systems", IOS Press, 2012.
  24. Lawrence O'Gorman, Michael J. Sammon‏،Michael Seul‏,"Practical Algorithms for Image Analysis with CD-ROM”, Cambridge University Press , 2008.
  25. Dhinaharan Nagamalai‏, Eric Renault‏،Murugan Dhanuskodi‏, "Advances in Parallel, Distributed Computing: First International Conference on Parallel, Distributed Computing Technologies and Applications, PDCTA 2011 Tirunelveli, Tamil Nadu, India, September 2011 , Proceedings ", Springer – verlag Berlin Heidelberg, 2011.
  26. Paul F. Whelan‏،Derek Molloy‏,” Machine Vision Algorithms in Java: Techniques and Implementation”, ", Springer – verlag – Landan limited , 2002.
  27. Madhuri A. Joshi‏," Digital Image Processing: An Algorithm Approach ", Prentice Hall of India private limited, 2006.
  28. Hanalick. R.M. Shanmugam. K. Dinsiein. I.: Textural Features for Image Classification. IEEE Trans. Systems. Man. and Cybemnetics SMC-3(6). 610-621, 1973.
  29. Ohanian. PP... Dubes, R.C.:" Perfomance Evaluation for Four Classes of Textural Features", Pattern Recognition 25(8), 819—833, 1992.
  30. Tatyana Yakhno," Advances in Information Systems: First International Conference, ADVIS 2000 preceding ", Springer – verlag Berlin Heidelberg, 2000.
  31. Punitha P. Swamy‏, Devanur S. Guru‏," Multimedia Processing, Communication and Computing Applications: Proceedings of the First international Conference, ICMCCA, 13—15 December 2012 “, Springer India, 2013.
  32. Ryszard S. Choras," Image Processing & Communications Challenges 2 ", Springer – verlag Berlin Heidelberg, 2010.
  33. Sergios Theodoridis, Konstantinos Koutroumbas, ‏" Pattern Recognition" Elsevier Inc , 2009.
  34. R. Mukundan‏, K. R. Ramakrishnan" Moment Functions in Image Analysis: Theory and Applications", World Scientific, 1998.
  35. Sri`savakon Dangsaart et al ," Intelligent Thai text – Thai sign translation
  36. For language learning”, science direct, Computers & Education 51, 2008, pp 1125–1141.
  37. Dan Melamed et al,"precision and recall of machine translation, Available: nlp.cs.nyu.edu/pubs/papers/hlt03eval.pdf.

Keywords

Deaf, Arabic Sign Language, GLCM, feature extraction, intensity histogram, Classification