Genetic Algorithm based Rule Extraction from Pruned Modified Fuzzy Hyperline Segment Neural Network for Pattern Classification

Abstract

The Pruned modified fuzzy hyperline segment neural network (PMFHLSNN) is pruned extension of Fuzzy hyperline segment neural network (FHLSNN) with modification in the testing phase. In this paper, a genetic algorithm based rule extractor (GA-PMFHLSNN) is proposed to extract a small set of compact and comprehensible fuzzy if-then rules with high classification accuracy from the PMFHLSNN. After pruning, open hyperline segments are generated from the remaining hyperline segments and a "don't care" approach is adopted by GA rule extractor to minimize the number of features in the extracted rules with higher classification accuracy. The performance of FHLSNN, PMFHLSNN and GA-PMFHLSNN are evaluated using tenfold cross-validation for five benchmark problems and handwritten character database. All the results show that the proposed approach can extract a set of compact and comprehensible rules with high classification accuracy for all the selected datasets.

References

• Jang, J. , Sun, C. and Mizutani, E. 2008Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Pearson Prentice Hall, South Asia, New Delhi, India.
• Simpson, P. "Fuzzy min–max neural networks—Part 1: Classification," IEEE Trans. on Neural Networks, Vol. 3, No. 5, pp. 776–786, Sep. 1992.
• Simpson, P. "Fuzzy min–max neural networks—Part 2: Clustering," IEEE Trans. on Fuzzy systems, Vol. 1, No. 1, pp. 32–45, Feb. 1993.
• Kwan, H. and Yaling, C. "A fuzzy neural network and its applications to pattern recognition," IEEE Trans. on Fuzzy Systems,Vol. 2, No. 3, pp. 185-192, Aug. 1994.
• Gabrys, B. and Bargiela, A. "General Fuzzy Min-Max Neural Network for Clustering and Classification," IEEE Trans. on Neural Networks, Vol. 11, pp. 769-783, May 2000.
• Kulkarni, U. , Sontakke, T. and Randale, G. 2001 Fuzzy hyperline segment neural for rotation invariant handwritten character recognition. In Proceeding of the Int. joint conf. on neural networks: IJCCNN'01 held in Washington DC, USA, pp. 2918–2923.
• Kulkarni, U. , Sontakke, T. and Kulkarni, A. "Fuzzy Hyperline Segment Clustering Neural Network," in IEE Electronics Letters Vol. 37, No. 05, pp. 301-303, Mar. 2001.
• Patil, P. and Sontakke, T. 2006"Rotation, scale and translation invariant handwritten Devanagari numeral character recognition using general fuzzy Neural Network",Journal of Pattern Recognition, Vol. 40, pp. 2110–2117, 2007.
• Wang, Y. and Fan, K. 1996Applying genetic algorithms on pattern recognition: an analysis and survey. In International Conference on Pattern Recognition, Vienna, Vol. 2, pp. 740-744.
• Cho, S. 1999Pattern recognition with neural networks combined by genetic algorithm, Fuzzy Sets and Systems, Vol. 103, No. 2, pp. 339-347, May 1998.
• Oh, S. , Pedrycz, W. and Park, B. "Multilayer hybrid fuzzy neural networks: synthesis via technologies of advanced computational intelligence", IEEE Trans. on Circuits and Systems-I, Vol. 53, No. 3, pp. 687-703, Mar. 2006.
• Sabo, D. and Yu, X. 2008A New Pruning Algorithm for Neural Network Dimension Analysis in IEEE International Joint Conference on Neural Networks, Hongkong, China, pp. 3313-3318.
• Marsland, S. , Shapiro, J. and Nehmzow, U. "A self-organizing network that grows when required", Neural Networks, Vol. 15, pp. 1041- 1058, Special issue 2002.
• Reed, R. "Pruning algorithms-A survey," IEEE Trans. on Neural Networks, Vol. 4, pp. 740-747, 1993.
• Benitez, J. , Castro, J. and Requena, I. "Are artificial neural networks black boxes?", IEEE Trans. on Neural Networks, Vol. 8, No. 5, pp. 1156–1164, Sep. 1997.
• Kolman, E. and Margaliot, M. "Are artificial neural networks white boxes?", IEEE Trans. on Neural Networks, Vol. 16, No. 4, pp. 844–852, Jul. 2005.
• Andrews, R. , Diederich, J. and Tickle, A. B. "Survey and critique of techniques for extracting rules from trained artificial neural networks", Knowledge Based Systems, Vol. 8, No. 6, pp. 373-389, Dec. 1995.
• Anas, Q. , Lim, C. P. and Tan, K. S. "A modi?ed fuzzy min–max neural network with a genetic-algorithm-based rule extractor for pattern classi?cation", IEEE Trans. on Systems, Man, and Cybernetics—Part A: Systems and Humans, Vol. 40, No. 3, pp. 641-650, May2010.
• Yap, K. , Lim, C. and Au, M. "Improved GART neural network model for pattern classification and rule extraction with application to power systems", IEEE Trans. on Neural Networks, Vol. 22, No. 12, pp. 2310-2323, Dec. 2011.
• Chen, Y. , Pal, N. and Chung, I. "An integrated mechanism for feature selection and fuzzy rule extraction for classification", IEEE Trans. on Fuzzy Systems, Vol. 20, No. 4, pp. 683-698, Aug. 2012.
• Yang, X. , Mingming, Z. , Quanhui, L. and Xiaofeng, W. "A genetic algorithm based multilevel association rule mining for big datasets", Mathematical Problems in Engineering, Vol. 2014, pp. 1-9, Aug. 2014.
• Bagal, S. and Kulkarni, U. 2014. Modified Fuzzy hyperline segment neural network for pattern classification and recognition. In Proceeding of the International Conference of Computational Intelligence and Intelligent Systems (ICCIIS'14), London, UK, Vol. 1.
• Bagal, S. and Kulkarni, U. "Pruned modified fuzzy hyperline segment neural network and its application to pattern classification", International Journal of Computer Application, Vol. 93, No. 12, pp. 43–50, May 2014.
• Ishibuchi, H. , Murata, T. and Turksen, I. "Single-objective and two- objective genetic algorithms for selecting linguistic rules for pattern classification problems", Fuzzy Sets and Systems, Vol. 89, No. 2, pp. 135–150, Mar. 1996.
• Murphy, P. and Aha, D. 1995UCI Repository of Machine Learning Databases, (Machine-Readable Data Repository). Irvine, CA: Dept. Inf. Computer Sci. , Univ. California.
• Perantonis, S. and Lisboa, P. "Translation, rotation and scale invariant pattern recognition by high-order neural networks and moment classifiers," IEEE Trans. on Neural networks, Vol. 3, No. 2, pp. 241-251, 1992.
• Udea, K. and Nakamura, Y. 1984Automatic verification of sealimpression pattern. In Proceeding of 9th Int. Conf. on pattern recognition. Vo1. 2, pp. 1019-1021.
• Chiu, H. and Tseng, D. "Invariant handwritten Chinese character recognition using fuzzy min-max neural networks," Pattern Recognition Letters, Vol. 18, pp. 481-491, 1997.
• Hoang, A. 1997 Supervised classifier performance on the UCI data set, in Department of Computer Science, M. Sc. Thesis, University of Adelaide, Australia.

Index Terms

Keywords