Gesture and Speech based human Computer interaction is attractive attention across various areas such as pattern recognition, computer vision. Thus kind of research areas find many kind of application in Multimodal HCI, Robotics control, Sign language recognition. This paper presents head and hand Gesture as well as Speech recognition system for human computer interaction (HCI).This kind of vision based system can show the capability of computer. Which understand and responding to the hand and head gesture also for Speech in form of sentence. This recognition system consists of two main modules namely 1.Gesture recognition 2.Speech recognition, Gesture recognition consists of various phases. i. image capturing, ii. Feature extraction of gesture iii. Gesture modeling (Direction, Position , generalized ), 2.Speech recognition consists of various phases i. taking voice signals ii. Spectral coding iii. unit matching(BMU) iv. Lexical decoding v. syntactic, semantic analysis. Compared with many existing algorithms for gesture and speech recognition, SOM provides flexibility, robustness against noisy environment.

1. Soloman Raju Kota,J.L Reheja,Ashutosh component analysis for Gesture recognition using Gupta,Archna rathi ,Shashikant Sharma”Principal systemC”2009 international conferences in advance technology in communication and computing 2009IEEE.
2. Sivalogeswaran Ratnasingam , T. M. McGinnity “Object Recognition Based on Tactile Form Perception” in IEEE2011.
3. Tan Wenjun, Wu Chengdong, Zhao Shuying Jiang Li “Dynamic Hand Gesture Recognition Using Motion Trajectories and Key Frames”2010.
4. G.R.S Murthy ,R.S Jadon “Hand gesture recognition using Neural network” in 2nd International Advance Computing Conference .
5. Yonas Fantahun Admasu and Kumudha Raimond ”Ethiopian Sign Language Recognition using Artificial Neural Network” in2010.
6. Chun Zhu and Weihua Sheng “Online Hand Gesture Recognition Using Neural Network Based segmentation2010.
7. E. Stergiopoulou and N. Papamarkos “A New Technique For Hand Gesture Recognition” 1-4244-0481-9/06/ © 2006 IEEE.
8. Anjali Kalra, Sarbjeet Singh, Sukhvinder Singh”SpeechRecognition” International Journal of Computer Science and Network Security, VOL.10,2010.
9. George Caridakis , Kostas Karpouzis, Athanasios Drosopoulos, Stefanos Kollias” SOMM: Self organizing Markov map for gesture recognition” Pattern Recognition Letters 31,2010.
10. WU Song-Lin, CUI Rong-Yi “Human Behavior Recognition Based on Sitting Postures” 2010 International Symposium on Computer, Communication, Control and Automation. 978-1-4244-5567-6/10/ © 2010 IEEE
11. Jagdish Lal Raheja, Radhey shyam “Real Time Robotic Hand Control Using Hand Gesture” 978-0-7695-3977-5/10 © 2010 IEEE.

Human computer interaction gesture recognition speech recognition self organizing map (Kohonen algorithm)