The week's pick
Reseach Article
Sign Language Recognition in Robot Teleoperation using Centroid Distance Fourier Descriptors
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 48 - Number 2 |
| Year of Publication: 2012 |
| Authors: Rayi Yanu Tara, Paulus Insap Santosa, Teguh Bharata Adji |
10.5120/7318-0100
|
Rayi Yanu Tara, Paulus Insap Santosa, Teguh Bharata Adji . Sign Language Recognition in Robot Teleoperation using Centroid Distance Fourier Descriptors. International Journal of Computer Applications. 48, 2 ( June 2012), 8-12. DOI=10.5120/7318-0100
Abstract
Commanding in robot teleoperation system can be done in several ways, including the use of sign language. In this paper, the use of centroid distance Fourier descriptors as hand shape descriptor in sign language recognition from visually captured hand gesture is considered. The sign language adopts the American Sign Language finger spelling. Only static gestures in the sign language are used. To obtain hand images, depth imager is used in this research. Hand image is extracted from depth image by applying threshold operation. Centroid distance signature is constructed from the segmented hand contours as a shape signature. Fourier transformation of the centroid distance signature results in fourier descriptors of the hand shape. The fourier descriptors of hand gesture are then compared with the gesture dictionary to perform gesture recognition. The performance of the gesture recognition using different distance metrics as classifiers is investigated. The test results show that the use of 15 Fourier descriptors and Manhattan distance-based classifier achieves the best recognition rates of 95% with small computation latency about 6. 0573 ms. Recognition error is occurred due to the similarity of Fourier descriptors from some gesture.
References
- Kwok, K. 1999. Research on the use of robotics in hazardous environments at Sandia National Laboratories. 8th International Topical Meeting on Robotics and Remote System, Pittsburgh.
- Ariyanto, G. 2007. Hand gesture recognition using Neural Networks for robotic arm control. National Conference on Computer Science & Information Technology, Indonesia.
- Wachs, J. 2007. Real-time hand gesture telerobotic system using the Fuzzy C-Means clustering, Fifth Biannual World Automation Congress.
- Liu, Y. , Gan, Z. , and Sun, Y. 2008. Static hand gesture recognition and its application based on Support Vector Machines. Ninth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel / Distributed Computing.
- Conseil, S. , Bourennane, S. , and Martin, L. 2007. Comparison of fourier descriptors and hu moments for hand posture recognition. European Signal processing Conference (EUSIPCO).
- Triesch, J. and Malsburg, C. v. d. 1996. Robust classification of hand postures against complex backgrounds. IEEE International Conference on Automatic Face and Gesture Recognition, 1996, pp. 170-175.
- Barczak, A. L. C. , Gilman, A. , Reyes, N. H. , and Susnjak, T. 2011. Analysis of feature invariance and discrimination for hand images: Fourier descriptors versus moment invariants. International Conference Image and Vision Computing New Zealand IVCNZ2011.
- Bourennane, S. , and Fossati, C. 2010. "Comparison of shape descriptors for hand posture recognition in video. " Signal Image and Video Processing, 2010: 1-11.
- Wah Ng, C. 2002. "Real-time gesture recognition system and application. " Image and Vision Computing 20. 13-14, 2002: 993-1007.
- Chen, F. 2003. "Hand gesture recognition using a real-time tracking method and hidden Markov models. " Image and Vision Computing 21. 8 2003: 745-758.
- Zhang, D. , and Lu, G. 2002. A comparative study of fourier descriptors for shape representation and retrieval. Proceedings of Fifth Asian Conference on Computer Vision. 2002: 1-6.
- Santosa, P. I. , and Tara, R. Y. 2012. Dictionary of basic hand gesture sign language. 2012 International Conference on Future Information Technology and Management Science & Engineering (FITMSE 2012), Hongkong.
- Microsoft Kinect. http://en. wikipedia. org/wiki/Kinect. 2012.
- Tara, R. Y. , Santosa, P. I. , and Adji, T. B. 2012. "Hand Segmentation from Depth Image using Anthropometric Approach in Natural Interface Development", International Journal of Scientific and Engineering Research Vol: 3-5, May 2012.
- Shih, F. Y. 2008. Image Processing and Pattern Recognition: Fundamentals and Techniques, Wiley and Sons, Canada.
- Zhang, D. 2002. Image Retrieval Based on Shape. PhD Thesis, Monash University.
- ASL Fingerspelling. http://www. lifeprint. com/asl101/fin-gerspelling/images/abc1280x960. png. 2011.
Index Terms
Keywords