Call for Paper - September 2020 Edition
IJCA solicits original research papers for the September 2020 Edition. Last date of manuscript submission is August 20, 2020. Read More

A Survey on Various Approach used in Named Entity Recognition for Indian Languages

Print
PDF
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Year of Publication: 2017
Authors:
Dikshan N. Shah, Harshad Bhadka
10.5120/ijca2017913878

Dikshan N Shah and Harshad Bhadka. A Survey on Various Approach used in Named Entity Recognition for Indian Languages. International Journal of Computer Applications 167(1):11-18, June 2017. BibTeX

@article{10.5120/ijca2017913878,
	author = {Dikshan N. Shah and Harshad Bhadka},
	title = {A Survey on Various Approach used in Named Entity Recognition for Indian Languages},
	journal = {International Journal of Computer Applications},
	issue_date = {June 2017},
	volume = {167},
	number = {1},
	month = {Jun},
	year = {2017},
	issn = {0975-8887},
	pages = {11-18},
	numpages = {8},
	url = {http://www.ijcaonline.org/archives/volume167/number1/27734-2017913878},
	doi = {10.5120/ijca2017913878},
	publisher = {Foundation of Computer Science (FCS), NY, USA},
	address = {New York, USA}
}

Abstract

Named Entity Recognition (NER) is an application of Natural Language Processing (NLP). NER is a activity of Information Extraction. NER is a task used for automated text processing for various industries, key concept for academics, artificial intelligence, robotics, Bioinformatics and many more. NER is always essential when dealing with chief NLP activity such as machine translation, question-answering, document summarization etc. Most NER work has been done for other European languages. Among Indian constitutional languages, NER work has been done for few languages. Not enough work is possible due to some challenges such as lack of resources, ambiguity in language, morphologically rich and many more. In this paper, we found many challenges available in NER for Indian languages and compared by measuring standard evaluation metrics values of accuracy, precision, recall and F-measure.

References

  1. Shruti Mathur, Varun Prakash Saxena [2014], “Hybrid Approach to English-Hindi Name Entity Transliteration”
  2. S Amarappa & Dr. S V Sathyanarayana [2015], “Kannada Named Entity Recognition And Classification (Nerc) Based On Multinomial Naïve Bayes (Mnb) Classifier”, International Journal on Natural Language Computing (IJNLC) Vol. 4, No.4, August 2015
  3. Ines Boujelben, Salma Jamoussi, Abdelmajid Ben Hamadou [2014], “A hybrid method for extracting relations between Arabic named entities”, Journal of King Saud University – Computer and Information Sciences (2014) 26, 425–440
  4. Yavrajdeep Kaur, Er.Rishamjot Kaur [2015], “Named Entity Recognition (NER) System for Hindi Language Using Combination of Rule Based Approach and List Look up Approach”, International Journal of scientific research and management (IJSRM, Volume 3 Issue 3 Pages 2300-2306
  5. Shilpi Srivastava, Mukund Sanglikar, D.C Kothari [2011], “Named Entity Recognition System for Hindi Language: A Hybrid Approach”, International Journal of Computational Linguistics (IJCL), Volume (2): Issue (1)
  6. Amir Bashir Malik and Khushboo Bansal [2015], “Named Entity Recognition for Kashmiri Language using Noun Identification and NER Identification Algorithm”, Volume-3, Issue-9
  7. Kishorjit Nongmeikapam * [2011], “CRF Based Name Entity Recognition (NER) in Manipuri: A Highly Agglutinative Indian Language”, 978-1-4244-9581-8/11 IEEE
  8. Sadiq Hussain et al [2016], “The First Step towards Named Entity Recognition inMising Language”, 978-1-4673-9939-5/16 IEEE
  9. Saeeda Naz et al [2014], “Challenges of Urdu Named Entity Recognition: A Scarce Resourced Language”, Res. J. App. Sci. Eng. Technol., 8(10): 1272-1278
  10. Jaspreet singh, Gurpreet singh lehal [2015], “Named entity recognition for Punjabi language using Hmm and Memm”, IRF International Conference, 8th March 2015, Pune, India, ISBN: 978-93-82702-75-7
  11. 11] Amandeep Kaur, Gurpreet Singh Josan, [2015], “Evaluation of Named Entity features for Punjabi Language”, Procedia Computer Science 46 ( 2015 ) 159 – 166
  12. Nusrat Jahan, Mohammad Alamgir Siddiqui [2014], “Urdu Named Entity Recognition Using Hidden Markov Model”, IJACKD Journal of Research, Vol 3, Issuse 1
  13. Sobhana N V [2015], “A Hybrid Approach of Similarity Based SVM and CRF for Named Entity Recognition”, International Journal of Advanced Research in Computer Science and Software Engineering 5(6), June- 2015, pp. 229-233
  14. Vaishnavi Singhal, Neha Tyagi [2015], “A Hybrid Approach Of English- Hindi Named-Entity Transliteration”, International Journal of Advanced Technology in Engineering and Science, Volume No.03, Special Issue No. 02
  15. Sudha Morwal, Nusrat Jahan [2013], “Named Entity Recognition Using Hidden Markov Model (HMM): An Experimental Result on Hindi, Urdu and Marathi Languages”, International Journal of Advanced Research in Computer Science and Software Engineering 3(4), pp. 671-675
  16. Deepti Chopra and Sudha Morwal [2013], “Detection And Categorization Of Named Entities In Indian Languages Using Hidden Markov Model”, International Journal of Computational Science and Information Technology (IJCSITY) Vol.1, No.1
  17. Deepti Chopra and Sudha Morwal, “Named Entity Recognition In English Using Hidden Markov Model”, International Journal on Computational Sciences & Applications (IJCSA) Vo3, No.1
  18. Sitanath Biswas *, “A Hybrid Oriya Named Entity Recognition system: Harnessing the Power of Rule”, International Journal of Artificial Intelligence and Expert Systems (IJAE), Volume (1): Issue (1)
  19. Deepti Chopra, Nusrat Jahan, Sudha Morwal [2012], “Hindi Named Entity Recognition By Aggregating Rule Based Heuristics And Hidden Markov Model”, International Journal of Information Sciences and Techniques (IJIST) Vol.2, No.6, November 2012
  20. S Amarappa, Dr. S V Sathyanarayana, “Named Entity Recognition and Classification inKannada Language”, V2N1-281-289
  21. Sudha Morwal and Deepti Chopra, “Identification And Classification Of Named Entities In Indian Languages”, International Journal on Natural Language Computing
  22. Remmiya Devi G, Veena P V, Anand Kumar M, Soman K P [2016], “Entity Extraction for Malayalam Social Media Text using Structured Skip-gram based Embedding Features from Unlabeled Data”, Procedia Computer Science 93 (2016) 547 – 553
  23. Komil Vora, Dr. Avani Vasant, Rachit Adhvaryu, “Named Entity Recognition and Classification for Gujarati Language”
  24. Saatvik Shah et al, “Hierarchical classification for Multilingual Language Identification and Named Entity Recognition”
  25. Vira Bagiya et al, “Entity Extraction from Social Media Text Indian Languages (ESM-IL)”
  26. S Amarappa1and S V Sathyanarayana [2013], “A Hybrid approach for Named Entity Recognition, Classification and Extraction (NERCE) in Kannada Documents”, Proc. of Int. Conf. on Multimedia Processing, Communication and Info. Tech., MPCIT
  27. Vivekananda Gayen, Kamal Sarkar [2013], “An HMM Based Named Entity Recognition System for Indian Languages”
  28. Arindam Dey, Bipul Syam Prukayastha [2013], “Named Entity Recognition using Gazetteer Method and N-gram Technique for an Inflectional Language: A Hybrid Approach”, International Journal of Computer Applications (0975 – 8887) Volume 84 – No 9, December 2013
  29. Abinaya.N, Neethu John, Dr.M.Anand Kumar and Dr.K.P Soman [2014], “Named Entity Recognition for Indian Languages”
  30. Pallavi K P., Srividhya K., Rexiline Ragini John Victor, Ramya M. M. [2015], “Twitter based Named Entity Recognizer for Indian Languages”,
  31. Rupal Bhargava, Bapiraju Vamsi, Yashvardhan Sharma, “Named Entity Recognition for Code Mixing in Indian Languages using Hybrid Approach”
  32. Poonam Kumari, Dr. Mahesh Yadav [2015], “Study And Implementation Of Named Entity Recognition In Hindi Language Using Php”, International Journal of Engineering Sciences & Research Technology
  33. Sadiq Hussain *[2016], “The First Step towards Named Entity Recognition in Mising Language”, 978-1-4673-9939-5/16 IEEE
  34. Maithilee L. Patawar, M. A. Potey [2016], “Named Entity Recognition from Indian tweets using Conditional Random Fields based Approach”, International Journal of Advanced Research in Computer Engineering & Technology (IJARCET) Volume 5, Issue 5
  35. Rayner Alfred, Leow Chin Leong, Chin Kim On, and Patricia Anthony [2014], “Malay Named Entity Recognition Based on Rule-Based Approach”, International Journal of Machine Learning and Computing, Vol. 4, No. 3, June 2014
  36. Kamaldeep Kaur, Vishal Gupta [2012], “Name Entity Recognition for Punjabi Language”, IRACST - International Journal of Computer Science and Information Technology & Security (IJCSITS), ISSN: 2249-9555, Vol. 2, No.3
  37. Mai Mohamed Oudah, Khaled Shaalan, “A Pipeline Arabic Named Entity Recognition Using a Hybrid Approach”, Proceedings of COLING 2012: Technical Papers, pages 2159–2176,
  38. Nusrat Jahan, Sudha Morwal and Deepti Chopra [2012], “Named Entity Recognition in Indian Languages Using Gazetteer Method and Hidden Markov Model: A Hybrid Approach”, International Journal of Computer Science & Engineering Technology (IJCSET), Vol. 3
  39. Khaled Shaalan, Mai Oudah [2014], “A hybrid approach to Arabic named entity recognition”, Journal of Information Science, Vol. 40(1) 67–87
  40. Kommaluri VIJAYANAND and R. P. Seenivasan [2011], “Named Entity Recognition and Transliteration for Telugu Language”, Problems of Parsing in Indian Languages 64

Keywords

Natural Language, Named Entity Recognition, NER approach, Indian languages