Call for Paper - January 2023 Edition
IJCA solicits original research papers for the January 2023 Edition. Last date of manuscript submission is December 20, 2022. Read More

Dimensionality Reduction and Classification through PCA and LDA

International Journal of Computer Applications
© 2015 by IJCA Journal
Volume 122 - Number 17
Year of Publication: 2015
Telgaonkar Archana H.
Deshmukh Sachin

Telgaonkar Archana H. and Deshmukh Sachin. Article: Dimensionality Reduction and Classification through PCA and LDA. International Journal of Computer Applications 122(17):4-8, July 2015. Full text available. BibTeX

	author = {Telgaonkar Archana H. and Deshmukh Sachin},
	title = {Article: Dimensionality Reduction and Classification through PCA and LDA},
	journal = {International Journal of Computer Applications},
	year = {2015},
	volume = {122},
	number = {17},
	pages = {4-8},
	month = {July},
	note = {Full text available}


Information explosion has occurred in most of the sciences and researches due to advances in data collection and storage capacity in last few decades. Advance datasets with large number of observations present new challenges in data, mining, analysis and classification. Traditional statistical method breaks down partly because of the increase in the number of variables associated with each observation which is known as high dimensional data. Much of the data is highly redundant which can be ignored to extract features of dataset. The process of mapping of high dimensional data to lower dimensional space in such a way to discard uninformative variance from the dataset or finding subspace in which data can be easily detected is known as Dimensionality Reduction. In this paper, well known techniques of Dimensionality Reduction namely Principle Component Analysis (PCA) and Linear Discriminant Analysis (LDA) are studied. Performance analysis is carried out on high dimensional data set UMIST, COIL and YALE which consists of images of objects and human faces. Classify the objects using knn classifier and naive bayes classifier to compare performance of these techniques. Difference between supervised and unsupervised learning is also inferred using these results.


  • Y. pang, Y. Yuan, and X. Li. 2008 Effective feature extraction in high dimensional space, IEEE Trans. Syst. , Man, Cybern. B, Cybern.
  • Y. Yang, F. Wu, D. Xu, Y. Zhuang, and L. -T. Chia. 2010 Cross-media retrieval using query dependent search methods, Pattern Recognition.
  • R. Dudoit, J. Fridly, and T. P. Speed . 2002 Comparison of discrimination methods for the classification of tumors using gene expression data, J. Amer. Stat. Assoc.
  • S. Xiang, F. Nie, C. Zhang, and C. Zhang. 2009 Interactive natural image segmentation via spline regression, IEEE Trans. Image Process.
  • M. Turk, A. Pentland. 1991 Face recognition using Eigenfaces, Computer Vision and Pattern Recognition, Proceedings CVPR'91, IEEE Computer Society Conference on (1991).
  • P. N. Belhumeur, J. P. Hespanha, D. J. Kriegman. 1997 Eigenfaces vs. fisherfaces: recognition using class specific linear projection, IEEE Trans. Pattern Anal. Mach. Intell.
  • Feiping Nie, Dong Xu, Xuelong Li. 2011 Semi supervised Dimensionality Reduction and Classification through Virtual Label Regression.
  • Lindsay I Smith. 2002A tutorial on Principal Components Analysis.
  • Creative Commons Attribution-Share Alike 3. 0 Unported http:/ / creativecommons. org/ licenses/ by-sa/ 3. 0/
  • Anil K. Ghosh. 2005 On optimum choice of k in nearest neighbor classification, Theoretical Statistics and Mathematics Unit, Indian Statistical Institute.
  • Shakhnarrovish, Darrell and Indyk. 2005 Nearest Neighbor Methods in learning and vision, MIT-press.
  • D. B. Graham and N. M. Allinson. 1998 Characterizing virtual eigensignatures for general purpose face recognition, in Face Recognition: From Theory to Applications
  • S. A. Nene, S. K. Nayar, and H. Murase. 1996 Columbia object image library (COIL-20), Columbia Univ. , New York, Tech. Rep. CUCS-005-96
  • A. Georghiades, P. Belhumeur, and D. Kriegman. 2001 From few too many: Illumination cone models for face recognition under variable lighting and pose, IEEE Trans. Pattern Anal. Mach. Intell.