The week's pick
Reseach Article
Building Real-Time Translation of Arabic Sign Language System using Mechatronic Approach
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 175 - Number 23 |
| Year of Publication: 2020 |
| Authors: A.I. El-Alfi, R. Adly, H.M. Ibrahim |
10.5120/ijca2020920767
|
A.I. El-Alfi, R. Adly, H.M. Ibrahim . Building Real-Time Translation of Arabic Sign Language System using Mechatronic Approach. International Journal of Computer Applications. 175, 23 ( Oct 2020), 48-54. DOI=10.5120/ijca2020920767
Abstract
Each individual use language to communicate with others. The normal person uses phonetic language but the deaf uses sign language. So, all of them are using different language and having trouble dealing with the other. This paper aims to assist the deaf people to communicate with normal people by building real-time translation Arabic sign language system (ArSL). This system has two parts. The first part translates ArSl to phonetic language by using mechatronic approach. A Data Glove (DG) was built by flex sensors to get the hand gesture of ArSL and convert it to digital data. This data is interrupted to speech via speech knowledge base for Arabic phonetic language. The second part translates Arabic phonetic language to ArSL by using speech recognition for Arabic language to translate speech to text, and then translate text to ArSL via video knowledge base for Arabic language. This system is characterized by mobile, real-time translation, easy in usage and its support for Arabic language.
References
- Stefan Kozsk 2016 “Multidisciplinary Approach and Dual Education in Control Engineering for Mechatronic”, faculty of electronic Engineering and Information Technology, Slovak University of Technology in Bratislava, Slovakia, IFAC-Papers OnLine 49-6 (2016) 052–056
- Dr. Kevin Craig 2002 “ACTUATORS & SENSORS IN MECHATRONICS”, Associate Professor of Mechanical Engineering.
- M. Anjanappa, et al 2002 “Sensors and Actuators”, University of Maryland Baltimore County.
- Nazrul H. Adnan et al 2012 “Measurement of the Flexible Bending Force of the Index and Middle Fingers for Virtual Interaction”, International Symposium on Robotics and Intelligent Sensors, 388 – 394
- Kazuma Iwasako et al 2014 "Development of finger motion skill learning support system based on data gloves”, International Conference on Knowledge-Based and Intelligent Information & Engineering Systems.
- Ahmad Zaki Shukor and et al 2015 “A New Data Glove Approach for Malaysian Sign Language Detection”, IEEE International Symposium on Robotics and Intelligent Sensors (IRIS 2015)
- Norah Alsunaidi et al 2018 “Abjad: Towards Interactive Learning Approach to Arabic Reading Based on Speech Recognition”
- Julien Maitre et al 2019 “Basic Daily Activity Recognition with a Data Glove”, The 10th International Conference on Ambient Systems, Networks and Technologies (ANT) April 29 - May 2, 2019, Leuven, Belgium
- Kunal R. Jambhulkar 2017 “Review on Sensor based Hand Gesture Recognition System”, Department of Embedded System and Computing, Nagpur Institute of Technology, India.
- K. saksamudre et al 2015 " A Review on Different Approaches for Speech Recognition System." +International Journal of Computer Applications 115(22): 23-28.
- Prerana Das et al 2015 “VOICE RECOGNITION SYSTEM: SPEECH-TO-TEXT”, Department of Computer Science & Engineering and Information Technology, School of Technology, Assam Don Bosco University, Assam, India.
- Abidhusain Syed et al 2012 “Flex Sensor Based Robotic Arm Controller Using Micro Controller”, Department of Electronics and Communication, BLDEA College, India.
- Mark Keanu et al 2019 “Materials Selection of 3D Printing Filament and Utilization of Recycled Polyethylene Terephthalate (PET) in a Redesigned Breadboard”, Department of Mathematics, Ateneo de Manila University Philippines.
Index Terms
Keywords