CFP last date
22 July 2024
Reseach Article

Automated Image Annotation for Semantic Indexing and Retrieval of Medical Images

by Krishna A N, B G Prasad
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 55 - Number 3
Year of Publication: 2012
Authors: Krishna A N, B G Prasad

Krishna A N, B G Prasad . Automated Image Annotation for Semantic Indexing and Retrieval of Medical Images. International Journal of Computer Applications. 55, 3 ( October 2012), 26-33. DOI=10.5120/8736-2843

@article{ 10.5120/8736-2843,
author = { Krishna A N, B G Prasad },
title = { Automated Image Annotation for Semantic Indexing and Retrieval of Medical Images },
journal = { International Journal of Computer Applications },
issue_date = { October 2012 },
volume = { 55 },
number = { 3 },
month = { October },
year = { 2012 },
issn = { 0975-8887 },
pages = { 26-33 },
numpages = {9},
url = { },
doi = { 10.5120/8736-2843 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
%0 Journal Article
%1 2024-02-06T20:56:19.519318+05:30
%A Krishna A N
%A B G Prasad
%T Automated Image Annotation for Semantic Indexing and Retrieval of Medical Images
%J International Journal of Computer Applications
%@ 0975-8887
%V 55
%N 3
%P 26-33
%D 2012
%I Foundation of Computer Science (FCS), NY, USA

Medical image retrieval to search for clinically relevant and visually similar images depicting suspecious lesions have been attracting research interest. Content-based image retrieval (CBIR) is an important alternate and complement to traditional text-based retrieval using keywords. We have implemented CBIR system based on effective use of texture information within the images obtained by statistical cooccurrence matrix method. Also, the method is improved by bridging the semantic gap between low-level visual features and the high-level semantic concepts using automated image annotations. In this paper, we have proposed a classification-based multi-class multi-label semantic model and the corresponding learning procedure to address the problem of automatic image annotation using J48 decision tree classifier and show its application to medical image retrieval. Hash structure is used to index images. Eucledian distance measure is used for similarity measurement. Both the methods are compared using precision and recall measures. Semantic indexing is shown to outperform CBIR for MR-T2 axial brain images.

  1. Md. Mahmudur Rahman, Tongyuan Wang and Bipin C. Desai, Medical Image Retrieval and Registration: Towards Computer Assisted Diagnostic Approach, Proc. of the IDEAS Workshop on Medical Information Systems: The Digital Hospital (IDEAS-DH04).
  2. Ying Liu, Dengsheng Zhang, Guojun Lu and Wei-Ying Ma, A survey of content-based image retrieval with high-level semantics, Pattern Recognition 40 (2007) 262-282.
  3. Y Mori, H Takahashi and R Oka, Image-to-word transformation based on dividing and vector quantizing images with words, In MISRM99 First Intl. Workshop on Multimedia Intelligent Storage and Retrieval Management, 1999.
  4. Duygulu P et al. , Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary. in proceedings of 7th European Conference on Computer Vision, 2002.
  5. Monay F and D Gatica-Perez, On Image Auto-Annotation with Latent Space Models, in proc. of ACM International Conference on Multimedia, 2003.
  6. Blei D and M Jordan, Modeling Annotated Data, in proceedings of 26th International Conference on Research and Development in Information Retrieval (SIGIR), 2003.
  7. Chang E et al. , Cbsa: Content-Based Soft Annotation for Multimodal Image Retrieval Using Bayes Point Machines, CirSysVideo, 13(1): pp. 26-38, 2003.
  8. Cusano C, G Ciocca and R Schettini, Image Annotation Using SVM, in proceedings of Internet Imaging IV, Vol. SPIE 5304, 2004.
  9. Li J and J Z Wang, Automatic Linguistic Indexing of Pictures by a Statistical Modeling Approach, IEEE Trans. on Pattern Analysis and Machine Intelligence, 25(19): pp. 1075-1088.
  10. Jeon J, V Lavrenko and R Manmatha, Automatic Image Annotation and Retrieval Using Cross-Media Relevance Models, in Proceedings of the 26th annual international ACM SIGIR conference on Research and development in information retrieval, 2003.
  11. Lavrenko V, R Manmatha and J Jeon, A Model for Learning the Semantics of Pictures, in Proceedings of Advance in Neutral Information Processing, 2003.
  12. Rong Jin Joyce Y and Chai Luo Si, Effective Automatic Image Annotation Via A Coherent Language Model and Active Learning, MM04, October 10-16, 2004, New York, USA, ACM 1-58113-000-0/00/0004.
  13. Wei Li and Maosong Sun, Automatic Image Annotation Using Maximum Entropy Model, IJCNLP 2005, LNAI 3651, pp. 34-45, 2005 Springer-Verlag Berlin Heidelberg.
  14. Munirathnam S, Joshua V, Mitchell B and Dan M, Exploiting Ontologies for Automatic Image Annotation, SIGIR05, August 15-19, 2005, Salvador, Brazil, ACM 1-59593-034-5/05/0008.
  15. Gexiang Zhang, Weidong Jin and Laizhao Hu, Radar Emitter Signal Recognition Based on Support Vector Machines, 2004 8th International Conference on Control, Automation, Robotics and Vision Kunming, China, 6-9th December 2004 IEEE.
  16. Madhubanti Maitra, Amitava Chatterjee and Fumitoshi Matsuno, A Novel Scheme for Feature Extraction and Classification of Magnetic Resonance Brain Images Based on Slantlet Transform and Support Vector Machine, SICE Annual Conference, August 20-22 2008, The University Electro-Communications, Japan, PR0001/08/0000-1130 2008 SICE.
  17. Ahmed Kharrat et al. , Automated Classification of Magnetic Resonance Brain Images Using Wavelet Genetic Algorithm and Support Vector Machine, Proc. 9th IEEE Int. Conf. on Cognitive Informatics (ICCI10) 978-1-4244-8040-1/10 2010 IEEE .
  18. Bai Xing-li, Qian Xu, Medical Image Classification based on Fuzzy Support Vector Machines, 2008 International Conference on Intelligent Computation Technology and Automation, 978-0-7695-3357-5 2008 IEEE.
  19. Bai Xingli, Tian Zhengjun, Medical Images Classification Based on Least Square Support Vector Machines, 978-1-4244-4507-3 2009 IEEE.
  20. Wilburn E. Reddick et al. , Automated Segmentation and Classification of Multispectral Magnetic Resonance Images of Brain Using Artificial Neural Networks, IEEE Transactions on Medical Imaging, Vol. 16, No. 6, December 1997.
  21. Jan Larsen, Lars Nonboe Andersen, Mads Hintx-Madsen and Lars Kai Hansen, Design of Robust Neural Network Classifiers, 0-78034428-6198, 1998 IEEE.
  22. Qiang Ye, Paul W. Munro, Improving a Neural Network Classifier Ensemble with Multi-Task Learning, 2006 International Joint Conference on Neural Networks Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada July 16-21, 2006.
  23. J Anitha, C Kezi Selva Vijila and D Jude Hemanth, An Enhanced Counter Propagation Neural Network for Abnormal Retinal Image Classification, 978-1-4244-5612-3/09 2009 IEEE.
  24. Jiang Yun, Li Zhanhuai, Wang Yong and Zhang Longbo, A Better Classifier Based on Rough Set and Neural Network for Medical Images, Sixth IEEE International Conference on Data Mining - Workshops (ICDMW'06) 0-7695-2702-7 2006 IEEE.
  25. Bo Pang, David Zhang, Naimin Li and Kuanquan Wang,Computerized Tongue Diagnosis Based on Bayesian Networks, IEEE Transactions on Biomedical Engineering, No 10, Vol. 51, October 2004.
  26. Boaz Lerner and Roy Malka, Learning Bayesian Networks for Cytogenetic Image Classification, 18th Int. Conf. on Pattern Recognition (ICPR'06) 0-7695-2521-0/06 2006 IEEE.
  27. Rong Chen, Edward H Herskovits, A Bayesian Network Classifier with Inverse Tree Structure for Voxelwise Magnetic Resonance Image Analysis, KDD05, August 2124 2005, Chicago, Illinois, USA, Copyright 2005 ACM 1-59593-135-X/05/0008.
  28. Chunyi Lin, Lihong Ma, Jianyu Chen, Semantic Modeling for Multi-level Medical Image Semantics Retrieval, Third International Workshop on Advanced Computational Intelligence August 25-27 2010, Suzhou, Jiangsu, China.
  29. Maria-Luiza Antonie, Osmar R. Zaane and Alexandru Coman, Application of Data Mining Techniques for Medical Image Classification, Proceedings of the Second International Workshop on Multimedia Data Mining (MDM/KDD2001), in conjuction with ACM SIGKDD conference, San Francisco, USA, August 26, 2001.
  30. Sumeet Dua, Vineet Jain and Hilary W. Thompson, Patient Classification Using Association Mining of Clinical Images, 978-1-4244-2003-2/08 2008 IEEE.
  31. P Rajendran and M Madheswaran, Pruned Associative Classification Technique For The Medical Image Diagnosis System, 2009 Second International Conference on Machine Vision, 978-0-7695-3944-7/10 2010 IEEE.
  32. Lior Rokach and Oded Maimon, Top-Down Induction of Decision Trees ClassifiersA Survey, IEEE Transactions on Systems, Man, And CyberneticsPart C: Applications and Reviews, Vol. 35, No. 4, November 2005.
  33. Dengsheng Zhang, Md. MonirulIslam and GuojunLu, A review on automatic image annotation techniques, Pattern Recognition 45(2012) pp. 346-362.
  34. Julie M. David and Kannan Balakrishnan, Significance of Classification Techniques In Prediction Of Learning Disabilities, International Journal of Artificial Intelligence & Applications (IJAIA), Vol. 1, No. 4, October 2010.
  35. Anil Rajput et al. , Approaches of Classification to Policy of Analysis of Medical Data, IJCSNS International Journal of Computer Science and Network Security, VOL. 9 No. 11, November 2009.
  36. K P Soman, Shyam Diwakar and V Ajay, Insight into Data Mining: Theory and Practice, PHI Learning Private Limited, New Delhi, 2009.
  37. G Meera Gandhi and S K Srivatsa, Adaptive Machine Learning Algorithm (AMLA) Using J48 Classifier for an NIDS Environment, Advances in Computational Sciences and Technology, ISSN 0973-6107 Vol. 3, No. 3 (2010), pp. 291304 Research India Publications.
  38. R Haralick, K Shanmugam, and I Dinstein, Textural features for image classification, IEEE Trans. Systems on Man and Cybernetics, 3(6):610-621, 1973.
  39. Wei Li and Maosong Sun, Multi-modal Multi-label Semantic Indexing of Images using Unlabeled Data, Int. Conf. on Advanced Language Processing and Video Technology, 978-0-7695-3273-8/08 2008 IEEE.
Index Terms

Computer Science
Information Sciences


Cooccurrence matrix Decision tree classifier Semantic indexing. ifx