CFP last date
20 June 2024
Reseach Article

Real Time 3D-Handwritten Character and Gesture Recognition for Smartphone

by Neelasagar K, K. Suresh
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 123 - Number 13
Year of Publication: 2015
Authors: Neelasagar K, K. Suresh

Neelasagar K, K. Suresh . Real Time 3D-Handwritten Character and Gesture Recognition for Smartphone. International Journal of Computer Applications. 123, 13 ( August 2015), 1-8. DOI=10.5120/ijca2015905662

@article{ 10.5120/ijca2015905662,
author = { Neelasagar K, K. Suresh },
title = { Real Time 3D-Handwritten Character and Gesture Recognition for Smartphone },
journal = { International Journal of Computer Applications },
issue_date = { August 2015 },
volume = { 123 },
number = { 13 },
month = { August },
year = { 2015 },
issn = { 0975-8887 },
pages = { 1-8 },
numpages = {9},
url = { },
doi = { 10.5120/ijca2015905662 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
%0 Journal Article
%1 2024-02-06T23:12:34.609112+05:30
%A Neelasagar K
%A K. Suresh
%T Real Time 3D-Handwritten Character and Gesture Recognition for Smartphone
%J International Journal of Computer Applications
%@ 0975-8887
%V 123
%N 13
%P 1-8
%D 2015
%I Foundation of Computer Science (FCS), NY, USA

This Paper presents two different models for smartphone based 3D-handwritten character and gesture recognition. Smartphones available today are equipped with inbuilt sensors like accelerometer, gyroscope, and gravity sensor, which are able to provide data on motion of the device in 3D space. The sensor readings are easily accessible through native operating system provided by the smartphone. The accelerometer and gyroscope sensors data have been used in the models to make the systems more expressive and to disambiguate recognition. The acceleration generated by the hand motions are generated by the 3-axes accelerometer present in smartphone. Data from gyroscope is used to obtain the quaternion rotation matrix, which is used to remove the tilting and inclination offset. An automatic segmentation algorithm is implemented to identify individual gesture or character in a sequence. First model is based on training and evaluation mode, while second one is based on training-less algorithm. The recognition models as presented in this paper can be used for both user dependent and user independent 3d-character and gesture recognition. Results shows that, Model I gives an efficient recognition rate ranging from 90% to 94% obtained with minimal training sequence, while the Model II gives a recognition rate of 88%.

  1. Ahmad Akl, Shahrokh Valaee, “Accelerometer-based gesture recognition via dynamic-time warping, Affinity propagation, and compressive sensing,” in Proc. of IEEE ICASSP, pp. 2270– 2273, march 2010.
  2. Ruize Xu, Shengli Zhou, Wen J. Li, “MEMS Accelerometer Based Nonspecific-User Hand Gesture Recognition,” in IEEE Sensors Journal, vol. 12, no. 5, pp. 1166–1173, may 2012.
  3. Sethu Janaki V M, Satish Babu and Sreekanth S S, “Real Time Recognition of 3D Gestures in Mobile Devices,” in Proc. of IEEE RAICS,2013
  4. Jiahui Wu, Gang Pan, Daqing Zhang, Guande Qi, Shijian Li, “Gesture Recognition with a 3-D Accelerometer,”in UIC 2009,LNCS 5585 pp. 25–38, 2009.
  5. Mark Pedley, “Tilt Sensing Using a Three-Axis Accelerometer,” Application Note of Freescale Semiconductor, Doc No. AN3461,Rev. 6, 03/2013.
  6. Duan Hong,Luo Yang, “A Gestures Trajectory Recognition Method Based on DTW,” in proc. of International Conference on Computer Science and Electronics Engineering (ICCSEE ), 2013.
  7. Jiayang Liu, Zhen Wang, and Lin Zhong,Jehan Wickramasuriya, Venu Vasudevan, “uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications,”in Proc. of IEEE International Conference on Pervasive Computing and Communications, pp. 1–9, march 2009.
  8. Oliver J. Woodman, “An introduction to inertial navigation,” Technical Report, UCAM-CL-TR-696, ISSN 1476-2986, Aug 2007.
  9. J. Yang, W. Chang, W. C. Bang, E. S. Choi, K. H. Kang, S. J. Cho, and D. Y. Kim“Analysis and compensation of errors in the input device based on inertial sensors,”in Proc. IEEE Int. Conf. Inf. Technol.-Coding and Computing ,pp. 790–796, 2004.
  10. Talat Ozyagcilar, “Implementing a Tilt-Compensated eCompass using Accelerometer and Magnetometer Sensors,” Application Note of Freescale Semiconductor , Document Number: AN4248, Rev. 3, 01/2012.
  11. Pylv¨an¨ainen T, “Accelerometer Based Gesture Recognition Using Continuous HMMs,”in Springer Berlin / Heidelberg, Pattern Recognition and Image Analysis, pp. 411–430, 2005.
  12. Niezen G and Hancke GP, “Gesture recognition as ubiquitous input for mobile phones,” in Proc. of theWorkshop on Devices that Alter Perception, 2008.
  13. Joselli M and Clua E, “A Framework for Touch and Accelerometer Gesture Recognition for Mobile Games, ”in VIII IEEE Brazilian Symposium on Games and Digital Entertainment, pp. 141–150, 2009.
  14. Westeyn T, Brashear H, Atrash A and Starner T, “Georgia Tech gesture toolkit: supporting experiments in gesture recognition, ”in Proc. of the 5th Int. Conf. on Multimodal Interfaces ACM, pp. 85–92, 2003.
  15. T. Schl¨omer, B. Poppinga, N. Henze,and S. Boll., “Gesture recognition with a wii controller” In Proc.TEI ,pp. 11–15, New York, NY, USA, 2008.ACM.
  16. L. Kratz, M. Smith, and F.J. Lee. Wiizards, “3D gesture recognition for game play input” In Proc.Future Play ,pp. 209– 212, New York, NY, USA, 2007. ACM.
  17. S. D. Choi, A. S. Lee, and S. Y. Lee, “On-line handwritten character recognition with 3D Accelerometer, ” in Proc.IEEE Int. Conf. Inf. Acquisition, pp. 845–850, 2006.
  18. Wu J, Pan G, Zhang D, Qi G, and Li S, “Gesture recognition with a 3D accelerometer. Ubiquitous Intelligence and Computing, ”in LNCS,Springer, pp. 25–38, 2009.
  19. T. Yang and Y. Xu’, “A Hidden Markov Model for Gesture Recognition, ” CMU-RI-TR-94 10, Robotics Institute, Carnegie Mellon Univ., Pittsburgh, PA, May 1994.
  20. S. Zhou, Q. Shan, F. Fei, W. J. Li, C. P. Kwong, and C. K. Wu et al., “Gesture recognition for interactive controllers using MEMS motion sensors,” in Proc. IEEE Int. Conf. Nano/Micro Engineered and Molecular Systems, pp. 935–940, Jan. 2009.
  21. John C Hart, George K Francis,and Louis H Kauffman “Visualizing Quaternion Rotation,” ACM Transactions on Graphics, vol. 13, no. 3, pp. 256–276,July 1994.
  22. Jack B.Kuipers, “Quaternions and Rotation Sequences,” Geometry, Intergrability and Quantization, Coral Press,pp. 127– 143, 2000.
  23. Marko Gargenta, and Masumi Nakamura, “Learning Android,” O’reilly , Second Edition, Jan 2014.
  24. Android ,
Index Terms

Computer Science
Information Sciences


Accelerometer Dynamic time warping Gyroscope Mahalanobis distance Quaternion Rotation