The week's pick
Reseach Article
Sign Language to Number by Neural Network
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 40 - Number 10 |
| Year of Publication: 2012 |
| Authors: Shekhar Singh, Pradeep Bharti, Deepak Kumar |
10.5120/5004-7289
|
Shekhar Singh, Pradeep Bharti, Deepak Kumar . Sign Language to Number by Neural Network. International Journal of Computer Applications. 40, 10 ( February 2012), 38-45. DOI=10.5120/5004-7289
Abstract
In this paper is presented an automatic deaf language to number recognition system. Sign language number recognition system lays down foundation for hand shape recognition which addresses real and current problems in signing in the deaf community and leads to practical applications. The scheme is based on neural network (NN) classifier using a back propagation. The input for the sign language number recognition system is 1000 Indian Sign Language number images with 640 x 480 pixels size. The input parameter vector to neural network is the Fisher score, which represents the derivate of the matrix of symbol probability in hidden Markov model (HMM). The HMM, which needs a sequence to be trained and used, is fed by the hand contour chain code. Besides, an improvement on the calculation of Fisher score is introduced by means of reducing the kernel scores variance. The error ratio classifying hand number of the proposed system is less than 1.4% with our database. The system learns and recognizes the Indian Sign Language number in training and testing phase using Hidden Markov Model and neural network. The system uses neural network for training and testing phase. The sign language recognizer could recognize Indian sign language number with 98.52% accuracy.
References
- Jaakola, T., Diekhans, M., and Haussler, D. (1998). “A discriminative framework for detecting remote protein homologies”. Unpublished, available from http://w.cse.ucsc.edu/research/comphio/research.htnd.
- Christopher J. C. Burges, “A Tutorial on Support Vector Machines for Pattern Recognition”, Data Mining and Knowledge Discovery, vol. 2, number 2, pp, 121-167, 1998.
- Lawence R. Rabiner, “A tutorial on Hidden Markov models and Selected Applications in Speech Recognition”, in Proceedings of the IEEE, vol. 77, no. 2, pp. 257-286, 1989.
- L. O’Gorman and R. Kasturi, Document Image AnalJsis, IEEE Computer Society Press, 1995.
- J. Serra, Image Analysis and Mathematical Morphology, Academic Press, 1982.
- C. Travieso, C. Morales, I. Alonso y M. Ferrer, “Handwritten digits parameterisation for HMM based recognition”, Proceedings of the Image Processing and its Applications,vol.2, pp. 770-774, julio de 1999.
- E. Gomez, C.M. Travieso, J.C. Briceiio, M.A. Ferrer, “Biometric Identification Svstem by Lip Shape”, in Proceeding of 361h International Carnahan Conference on Security Technology, Atlantic City, October 2002,pp. 39-42.
- Carlos M. Travieso, Jesus B. Alonso, Miguel A. Ferrer,”Sign language to text by SVM”, 0-7803-7946-2/03, IEEE , 2003.
- Zhang, L.-G., Chen, Y., Fang, G., Chen, X., & Gao, W. (2004). A vision-based sign language recognition system using tied-mixture density hmm. In ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces, pages 198–204, New York, NY, USA. ACM.
- Wang, Q., Chen, X., Zhang, L.-G., Wang, C., & Gao, W. (2007). Viewpoint invariant sign language recognition. Computer Vision and Image Understanding, 108:87–97.
- Starner, T., Weaver, J., & Pentland, A. (1998). Real-time American sign language recognition using desk and wearable computer based video. Transactions on Pattern Analysis and Machine Intelligence, 20(12):1371–1375.
- Vogler, C. & Metaxas, D. (2004). Handshapes and movements: Multiple-channel ASL recognition. In Springer Lecture Notes in Artificial Intelligence. Proceedings of the Gesture Workshop'03, Genova, Italy., pages 247–258.
Index Terms
Keywords