The week's pick
Random Articles
Reseach Article
SIGNIFY: A Pre-Primary Learning and Practice Hub for Indian Sign Language
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 186 - Number 82 |
| Year of Publication: 2025 |
| Authors: Suraj Dora, Aditya Gupta, Jyotirmay Prasad, Vasudha Kadam, K.S. Suresh Babu |
10.5120/ijca2025924793
|
Suraj Dora, Aditya Gupta, Jyotirmay Prasad, Vasudha Kadam, K.S. Suresh Babu . SIGNIFY: A Pre-Primary Learning and Practice Hub for Indian Sign Language. International Journal of Computer Applications. 186, 82 ( Apr 2025), 23-34. DOI=10.5120/ijca2025924793
Abstract
Signify is an interactive e-learning platform that has an influence on Machine Learning (ML) and Deep Learning (DL) to make Indian Sign Language (ISL) learning easier for pre-primary students. The system combines advanced hand detection models like MediaPipe and OpenCV to isolate hand gestures from the camera feed with accuracy, which ensures precise recognition. A convolutional neural network (CNN) handles these gestures in real time, allowing sign-to-text and text-to-sign conversions while giving quick feedback through interactive quizzes. Also, an analytical dashboard keeps track of student progress offering insights into learning patterns and unlocking extra resources as students move forward. By joining deep learning with real-time hand tracking, Signify promotes inclusivity, boosts communication skills, and backs a structured engaging approach to sign language education.
References
- Z. Liang, H. Li, and J. Chai, "Sign Language Translation: A Survey of Approaches and Techniques," Electronics, vol. 12, no. 12, p. 2678, Jun. 2023.
- Z. Jiang, A. Moryossef, M. Müller, and S. Ebling, "Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting," Findings of the Association for Computational Linguistics: EACL 2023, pp. 1232–1243, May 2023.
- B. Zhou, Z. Chen, A. Clapes, J. Wan, Y. Liang, S. Escalera, Z. Lei, and D. Zhang, "Gloss-free Sign Language Translation: Improving from Visual-Language Pretraining," in Proc. IEEE/CVF Int. Conf. Comput. Vision (ICCV), 2023, pp. 1234–1243.
- Y. Chen, F. Wei, X. Sun, Z. Wu, and S. Lin, "A Simple Multi-Modality Transfer Learning Baseline for Sign Language Translation," arXiv preprint arXiv:2203.04287v2, Mar. 2022.
- A. Yin, Z. Zhao, W. Jin, M. Zhang, X. Zeng, and X. He, "MLSLT: Towards Multilingual Sign Language Translation," in Proc. IEEE/CVF Conf. Comput. Vision Pattern Recognit. (CVPR), 2022, pp. 15707–15716.
- P. Sharma, D. Tulsian, C. Verma, P. Sharma, and N. Nancy, "Translating Speech to Indian Sign Language Using Natural Language Processing," Future Internet, vol. 14, no. 9, p. 253, Aug. 2022.
- A. Duarte, S. Palaskar, L. Ventura, D. Ghadiyaram, K. DeHaan, F. Metze, J. Torres, and X. Giro-i-Nieto, "How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Language," in Proc. IEEE/CVF Conf. Comput. Vision Pattern Recognit. (CVPR), 2021, pp. 1–10.
- F. Roelofsen, L. Esselink, S. Mende-Gillings, and A. Smeijers, "Sign Language Translation in a Healthcare Setting," in Proc. Translation and Interpreting Technology Online Conf. (TRITON), 2021, pp. 110–124.
- N. K. Kahlon and W. Singh, "Machine translation from text to sign language: a systematic review," Universal Access in the Information Society, vol. 22, no. 1, pp. 1–35, Jul. 2021.
- J. Zheng, Z. Zhao, M. Chen, J. Chen, C. Wu, Y. Chen, X. Shi, and Y. Tong, "An Improved Sign Language Translation Model with Explainable Adaptations for Processing Long Sign Sentences," Computational Intelligence and Neuroscience, vol. 2020, Article ID 8816125, Oct. 2020.
- S. He, "Research of a Sign Language Translation System Based on Deep Learning," in Proc. 2019 Int. Conf. Artificial Intelligence and Advanced Manufacturing (AIAM), 2019, pp. 1–5.
- Indian Sign Language Research and Training Center (ISLRTC), "ISLRTC Official Website." https://islrtc.nic.in
- Pragya Gupta, "Indian Sign Language 101- Numbers - Learn with Pragya," YouTube, [Online Video]. Available:https://www.youtube.com/watch?v=vnH2BmcSRMA
- Indian Sign Language Research and Training Centre, "Alphabets A-Z in ISL," YouTube, [Online Video]. Available:https://www.youtube.com/watch?v=VdwKSyza5oI.
- Sharma, S., Singh, S. "Recognition of Indian Sign Language (ISL) Using Deep Learning Model," in Wireless Pers Commun 123, 671–692 (2022).
Index Terms
Keywords