The week's pick
Random Articles
Reseach Article
Prediction Improvement using Optimal Scaling on Random Forest Models for Highly Categorical Data
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 108 - Number 3 |
| Year of Publication: 2014 |
| Authors: Saurabh Mangal, Aditya Shankar |
10.5120/18895-0183
|
Saurabh Mangal, Aditya Shankar . Prediction Improvement using Optimal Scaling on Random Forest Models for Highly Categorical Data. International Journal of Computer Applications. 108, 3 ( December 2014), 40-43. DOI=10.5120/18895-0183
Abstract
Random Forests are an effective ensemble method which is becoming increasingly popular, particularly for binary classification prediction problems. One of the most popular algorithms for implementing the Random Forest model is the Breiman and Cutler's algorithm and this forms the basis of the "randomForest" package in R. However, a Random Forest model implemented using this package has a limitation, especially in a milieu which has limited computational power, that it cannot handle highly categorical data. In this paper, we present one of the many techniques we tried to improve the performance of a Random Forest Model using highly categorical data. The performance improvement was solely achieved using advanced pre-processing techniques like Optimal Scaling, hence the title of the paper.
References
- Greer, J. E. and G. McCalla, 1994. Evaluating a Simulated Student using Real Students Data for Training and Testing.
- Anderson, J. R. 1995, Cognitive tutors: Lessons learned, Carnegie Mellon University.
- Noboru Matsuda1, William W. Cohen 2010, Tuning Cognitive Tutors into a Platform for Learning by-Teaching with SimStudent Technology Carnegie Mellon University.
- Noboru Matsuda, Applying Machine Learning to Cognitive Modelling for Cognitive Tutors 2006, in Machine Learning Department Technical Report (CMU ML).
- Muggleton, S. and L. de Raedt 1994, Inductive Logic Programming: Theory and methods
- Lau, T. A. and D. S. Weld, 1998 an inductive learning formulation.
- Johnson, W. L. 1998, Integrating pedagogical agents into virtual environments.
- Baffes, P. and R. Mooney, 1996, Refinement-Based Student Modelling and Automated Bug Library Construction.
- Merceron, A and K. Yacef, A web-based tutoring tool with mining facilities to improve learning and teaching, 2003.
- Mertz, J. S. 1997, Using Simulated Student for Instructional Design.
- Koedinger, K. R. and A. Corbett, 2006, Cognitive Tutors: Technology Bringing Learning Sciences to the Classroom, in The Cambridge Handbook of the Learning Sciences.
- Matsuda, N. , W. W. Cohen, and K. R. Koedinger 2005, Applying Programming by Demonstration in an Intelligent Authoring Tool for Cognitive Tutors.
Index Terms
Keywords