Classification is one of the important data mining techniques. Learning from a given data set to build a classification model becomes difficult when available sample size is small. How to extract more effective information from a small data set is thus of considerable interest. In this paper we provide a review of different classification methods which will help us build more amounts of data, so that classification performance is improved. We discuss different techniques which will work with small data set such as attribute construction, bootstrap method, incremental method and different diffusion functions. Different classification methods such as neural network, decision tree classifiers, Bayesian classifiers etc. are also discussed.

1. Der-chiang Li and Chiao Wen Liu "Extending Attribute Information for Small Data Set Classification," IEEE Transactions On Knowledge And Data Engineering, Vol. 24, No. 3, March 2012.
2. W. C. Li and C. W. Yeh, "A Non-Parametric Learning Algorithm for Small Manufacturing Data Sets," Expert Systems with Applications vol. 34, pp. 391-398, 2008.
3. D. C. Li, C. S. Wu, T. I Tsai, and Y. S. Lina, "Using Mega-Trend-Diffusion and Artificial Samples in Small Data Set Learning for Early Flexible Manufacturing System Scheduling Knowledge," Computers and Operations Research, vol. 34, pp. 966-982, 2007.
4. Kanthida Kusonmano, Michael Netzer, Bernhard Pfeifer, Christian Baumgartner, Klaus R. Liedl, and Armin Graber, "Evaluation of the Impact of Dataset Characteristics for Classification Problems in Biological Applications," World Academy of Science, Engineering and Technology 34 2009
5. http://www. let. rug. nl/~tiedeman/ml05/03_bayesian_handout. pdf
6. Guoqiang Peter Zhang "Neural Networks for Classification: A Survey," IEEE Transactions on systems, man, and cybernetics—part c: applications and reviews, vol. 30, no. 4, November 2000
7. Chongfu Huang, Claudio Moraga, "diffusion-neural-network for learning from small samples," International Journal of Approximate Reasoning 35 (2004) 137–161
8. Yao San Lin, Der Chiang Li, "The Generalized Trend Diffusion modeling algorithm for small data sets in the early stages of manufacturing systems"
9. Tung-I Tsai, Der-Chiang Li , "Utilize bootstrap in small data set learning for pilot run modeling of manufacturing systems" Expert Systems with Applications 35 (2008) 1293–1300

Data Preprocessing Small Data Set Attribute Construction Smo