Call for Paper - November 2023 Edition
IJCA solicits original research papers for the November 2023 Edition. Last date of manuscript submission is October 20, 2023. Read More

Incremental Dimensionality Reduction in Hyperspectral Data

Print
PDF
 
Download Full Text
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 163 - Number 7
Year of Publication: 2017
Authors:
Preeti Mahadev, P. Nagabhushan
10.5120/ijca2017913575

Preeti Mahadev and P Nagabhushan. Incremental Dimensionality Reduction in Hyperspectral Data. International Journal of Computer Applications 163(7):21-34, April 2017. BibTeX

@article{10.5120/ijca2017913575,
	author = {Preeti Mahadev and P. Nagabhushan},
	title = {Incremental Dimensionality Reduction in Hyperspectral Data},
	journal = {International Journal of Computer Applications},
	issue_date = {April 2017},
	volume = {163},
	number = {7},
	month = {Apr},
	year = {2017},
	issn = {0975-8887},
	pages = {21-34},
	numpages = {14},
	url = {http://www.ijcaonline.org/archives/volume163/number7/27407-2017913575},
	doi = {10.5120/ijca2017913575},
	publisher = {Foundation of Computer Science (FCS), NY, USA},
	address = {New York, USA}
}

Abstract

Conventionally, pattern recognition problems involve both samples and features that get collected over time or that gets generated from distributed sources. The system starts to falter when the number of features reaches a certain threshold and exhibits the curse of dimensionality. Traditionally dimensionality reduction (DR) is performed to prevent the curse of dimensionality when all features are available or when the system starts to degrade in its performance. But in the current digital age systems, the enormous and continuous influx of both samples and features mandates performing DR at regular intervals to keep up with the system performance. The massive amount of feature space and sample space that gets accumulated instantaneously allows little chance to extract the knowledge effectively that can be used promptly and hence mandates performing the DR at regular intervals of time. In real time scenarios, for any domain, decisions have to be made as and when the data is made available to realize the best outcome and to mitigate the risks. The various ways in which the features flow or get generated can be different depending on the domain of the dataspace. Due to its ever changing environment, extraction of knowledge can get more challenging. To overcome this problem of big data, an incremental dimensionality reduction (IDR) approach to extract, carry forward, build and accumulate the knowledge without recalling the previous data is explored in this case study. Both Feature subsetting and Feature transformation methods are employed for the purpose of illustrating the incremental reduction of attributes. The hyperspectral image generated from an AVIRIS sensor provides a versatile environment required to demonstrate the in depth study of an IDR approach. This case study attempts to showcase a novel approach of maximizing the knowledge while minimizing the information loss through the use of IDR techniques in a multifaceted environment with hyperspectral data.

References

  1. https://purr.purdue.edu/publications/1947/1
  2. http://www.cse.msu.edu/~cse802/Feature_selection.pdf
  3. Plaza, J., Plaza, A. J., & Barra, C. (2009). Multi-Channel Morphological Profiles for Classification of Hyperspectral Images Using Support Vector Machines. Sensors, 9, 196-218.
  4. Zhang, Y., Du, B., Zhang, L., & Liu, T. (2017). Joint Sparse Representation and Multitask Learning for Hyperspectral Target Detection. IEEE Transactions on Geoscience and Remote Sensing, 55(2), 894-906.
  5. http://www.microimages.com/documentation/Tutorials/hyprspec.pdf
  6. http://lesun.weebly.com/hyperspectral-data-set.html AND https://purr.purdue.edu/publications/1947/1
  7. Aggarwal, C. C., & Yu, P. S. (2001, May). Outlier detection for high dimensional data. In ACM Sigmod Record (Vol. 30, No. 2, pp. 37-46). ACM.(sparsity)
  8. Signal Theory Methods in Multispectral Remote Sensing. David A Landgrebe. ISBN: 978-0-471-42028-6. 528 pages. January 2003
  9. Subramanian, S., Gat, N., Ratcliff, A., & Eismann, M. (2000). Real-time hyperspectral data compression using principal components transformation. In In Proceedings of the AVIRIS Earth Science & Applications Workshop.
  10. C.-I Chang, Hyperspectral Data Exploitation: Theory and Applications. New Jersey: John Wiley and Sons, 2007.
  11. P. Zhong, P. Zhang, and R. Wang, “Dynamic learning of SMLR for feature selection and classification of hyperspectral data,” IEEE Geoscience and Remote Sensing Letters, vol. 5, no. 2, pp. 280-284, April 2008
  12. Preet, P., & Batra, S. S. (2015). Feature Selection for classification of hyperspectral data by minimizing a tight bound on the VC dimension. arXiv preprint arXiv:1509.08112.
  13. Pal, Mahesh, and Giles M. Foody. ”Feature selection for classification of hyperspectral data by SVM.” Geoscience and Remote Sensing, IEEE Transactions on 48.5 (2010): 2297-2307.
  14. Agarwal, Abhishek, Tarek El-Ghazawi, Hesham El-Askary, and Jacquline Le-Moigne. ”Efficient hierarchical-PCA dimension reduction for hyperspectral imagery.” In Signal Processing and Information Technology, 2007 IEEE International Symposium on, pp. 353-356. IEEE, 2007.
  15. Syed Zakir Ali., P Nagabhushan., Pradeep Kumar R, Incremental datamining using Clustering Intelligent Methods of Fusing the Knowledge During Incremental Learning via Clustering in A Distributed Environment , PhD Thesis, 2010
  16. Meenakshi, H. N., & Nagabushan, P (2017). Target Class Guided Compression in Feature Subspace, IJCST, 4(6).
  17. Nagabhushan, P., & Mahadev, P. (2014). Incremental Feature Subsetting useful for Big Feature Space Problems. International Journal of Computer Applications, 97(12).
  18. Preeti Mahadev and P Nagabhushan. Incremental Feature Transformation for Temporal Space. International Journal of Computer Applications 145(8):28-38, July 2016
  19. P. Nagabhushan, An efficient method for classifying remotely sensed data (incorporating dimensionality reduction), Ph.D thesis, Universityof Mysore, 1988
  20. Datta, Aloke, Susmita Ghosh, and Ashish Ghosh. "Unsupervised band extraction for hyperspectral images using clustering and kernel principal component analysis." International Journal of Remote Sensing 38.3 (2017): 850-873.
  21. NASA JPL, AVIRIS Data Portal [online]. Available at http://aviris.jpl.nasa.gov/alt_locator/. [Accessed June 2016].
  22. Principal Component. Analysis, Second Edition. I.T. Joliffe. Springer, NewYork, 2002
  23. Liu, H., & Motoda, H. (1998). Feature transformation and subset selection. IEEE Intell Syst Their Appl, 13(2), 26-28.
  24. https://people.eecs.berkeley.edu/~vazirani/algorithms/chap2.pdf

Keywords

Airborne Visible/Infrared Imaging Spectrometer (AVIRIS), dimensionality reduction (DR), Incremental dimensionality reduction (IDR), Principal Component Analysis (PCA), Prims like approach, Kruskals like approach