The week's pick
Reseach Article
Optimizing the Multilayer Feed-Forward Artificial Neural Networks Architecture and Training Parameters using Genetic Algorithm
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 96 - Number 10 |
| Year of Publication: 2014 |
| Authors: Osman Ahmed Abdalla, Abdelrahman Osman Elfaki, Yahya Mohammed Almurtadha |
10.5120/16832-6596
|
Osman Ahmed Abdalla, Abdelrahman Osman Elfaki, Yahya Mohammed Almurtadha . Optimizing the Multilayer Feed-Forward Artificial Neural Networks Architecture and Training Parameters using Genetic Algorithm. International Journal of Computer Applications. 96, 10 ( June 2014), 42-48. DOI=10.5120/16832-6596
Abstract
Determination of optimum feed forward artificial neural network (ANN) design and training parameters is an extremely important mission. It is a challenging and daunting task to find an ANN design, which is effective and accurate. This paper presents a new methodology for the optimization of ANN parameters as it introduces a process of training ANN which is effective and less human-dependent. The derived ANN achieves satisfactory performance and solves the time-consuming task of training process. A Genetic Algorithm (GA) has been used to optimize training algorithms, network architecture (i. e. number of hidden layer and neurons per layer), activation functions, initial weight, learning rate, momentum rate, and number of iterations. The preliminary result of the proposed approach has indicated that the new methodology can optimize designing and training parameters precisely, and resulting in ANN where satisfactory performance.
References
- H. Patrick C. L. (2007). "Application of artificial neural networks to the prediction of sewing performance of fabrics", International Journal of clothing and Technology, Vol. 19, No. 5, pp. 291318.
- F. Fred F. , G. James D. , and L. Juliet N. (2000). "Predicting temperature profiles in producing oil wells using artificial neural networks", Engineering Computation, Vol. 17, No. 6, pp. 0264-4401.
- K. Okyay, Springer, 2003. "Artificial Neural Networks and Neural Information", ISBN 3540404082.
- D. Satyanarayana, K. Kamarajan, and M. Rajappan (2005). "Genetic Algorithm Optimized Neural Networks Ensemble for Estimation of Mefenamic Acid and Paracetamol in Tablets", Genetic Algorithm Optimized Neural Networks Ensemble, Acta Chim. Slov. , Vol. 52, pp. 440–449.
- M. Izadifar, M. Zolghadri Jahromi (2007). "Application of genetic algorithm for optimization of vegetable oil hydrogenation process", Journal of Food Engineering, Vol. 78, Issue 1, pp. 1-8.
- F. Konstantinos P. (2005). "Biological engineering applications of feedforward neural networks designed and parameterized by genetic algorithms", Neural Networks, Vol. 18, Issue 7, pp. 934-950.
- M. Majors, J. Stori, C. Dong-I (2002), "Neural network control of automotive fuel-injection systems", Control Systems Magazine, IEEE, Vol. 14, Issue 3, pp. 31-36.
- C. Arzum E. , K. Yalcin (2007). "Evaluating and forecasting banking crises through neural network models: An application for Turkish banking sector", Expert Systems with Applications, Vol. 33, Issue 4, pp. 809-815.
- L. Bor-Ren and R. G. Hoft (2003). "Neural networks and fuzzy logic in power electronics", Control Engineering Practice, Vol. 2, Issue 1, pp. 113-121.
- Z. Xiaotian, X. Hong Wang, Li, and L. Huaizu Li (2008). "Predicting stock index increments by neural networks: The role of trading volume under different horizons", Expert Systems with Applications, Vol. 34, Issue 4, pp. 3043-3054.
- G. R. Cheginia, J. Khazaeia, B. Ghobadianb, and A. M. Goudarzic Constructing ANN (2008). "Prediction of process and product parameters in an orange juice spray dryer using artificial neural networks", Journal of Food Engineering, Vol. 84, Issue 4, pp 534-543.
- N. Perambur S. and A. Preechayasomboon (2002). "Development of a neuroinference engine for ADSL modem applications in telecommunications using an ANN with fast computational ability", Neurocomputing, Vol. 48, Issues 1-4, pp. 423-441.
- F. Fred F. , G. James D. , and L. Juliet N. (2000). "Predicting temperature profiles in producing oil wells using artificial neural networks", Engineering Computation, Vol. 17, No. 6, pp. 0264-4401.
- N. Huang, K. K. Tan, and T. H. Lee (2008), "Adaptive neural network algorithm for control design of rigid-link electrically driven robots", Neurocomputing, Vol. 71, Issues 4-6, pp 885-894.
- D. E. Goldberg (1989). In: (second ed. ), Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, Reading, MA.
- S. L. Mok, C. K. Kwong, and W. S. Lau (2001). "A Hybrid Neural Network and Genetic Algorithm Approach to the Determination of Initial Process Parameters for Injection Moulding", The International Journal of Advanced Manufacturing Technology, Vol. 18, pp. 404-409.
- H. Paul S. , G. Ben S. , T. Thomas G. , and W. Robert S. (2004). "Use of genetic algorithms for neural networks to predict community-acquired pneumonia", Artificial Intelligence in Medicine, Vol. 30, Issue 1, pp. 71-84.
- F. Konstantinos P. (2005). "Biological engineering applications of feedforward neural networks designed and parameterized by genetic algorithms", Neural Networks, Vol. 18, Issue 7, pp. 934-950.
- S. S. Panda, D. Chakraborty, and S. K. Pal (2008). "Flank wear prediction in drilling using back propagation neural network and radial basis function network", Applied Soft Computing, Issue 8, pp. 858–871.
- J. P. Marques de Sá, Joaquim P. Marques de Sa, Joaquim P. Marques de S? (2007). "Applied Statistics Using SPSS, STATISTICA, MATLAB and R", ISBN 3540719717, pp. 78-83, Springer
- E. A. Osman, M. A. Ayoub, and M. A. Aggour (2005). "Artificial Neural Network Model for Predicting Bottomhole Flowing Pressure in Vertical Multiphase Flow", SPE Middle East Oil and Gas Show and Conference.
- D. E. Rumelhart, G. E. Hinton, and R. J. Williams (1986). "Learning internal representation by back propagating errors", Nature 323, pp. 533–536.
Index Terms
Keywords