The week's pick
Random Articles
Reseach Article
Coding with a Co-Pilot: A Systematic Review of Generative AI's Impact on Novice Programming Education
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 187 - Number 134 |
| Year of Publication: 2026 |
| Authors: Shashank Reddy Srinivasa Reddy, Rushit Dave, Mansi Bhavsar |
10.5120/ijca7dd144fd5d1d
|
Shashank Reddy Srinivasa Reddy, Rushit Dave, Mansi Bhavsar . Coding with a Co-Pilot: A Systematic Review of Generative AI's Impact on Novice Programming Education. International Journal of Computer Applications. 187, 134 ( Aug 2026), 29-34. DOI=10.5120/ijca7dd144fd5d1d
Abstract
The integration of Generative Artificial Intelligence (GenAI) tools into introductory programming (CS1) education challenges established pedagogical and assessment models. This systematic review synthesizes recent empirical literature, anchored by a meta-analysis of 32 controlled studies (2020-2024), to examine what GenAI assistance does and does not do for novice learning. The evidence reveals an efficiency-understanding paradox: relative to unassisted instruction, GenAI use significantly improves student performance scores (Standardized Mean Difference, SMD = 0.86), while gains in conceptual understanding are statistically negligible (SMD = 0.16, falling to -0.03 under sensitivity analysis). A five-profile taxonomy of novice-AI interaction indicates that learning impact depends on how students engage rather than on tool presence. This paper proposes an AI-integrated curriculum redesign framework grounded in constructive alignment, recalibrating learning outcomes, teaching activities, and assessment strategies toward process-based evaluation of the student's problem-solving journey.
References
- Becker, B. A., Denny, P., Finnie-Ansley, J., Luxton-Reilly, A., Prather, J., and Santos, E. A. 2023. Programming is hard - or at least it used to be: Educational opportunities and challenges of AI code generation. In Proceedings of the 54th ACM Technical Symposium on Computer Science Education (SIGCSE TS 2023), 500–506. DOI: 10.1145/3545945.3569759.
- Denny, P., Prather, J., Becker, B. A., Finnie-Ansley, J., Hellas, A., Leinonen, J., Luxton-Reilly, A., Reeves, B. N., Santos, E. A., and Sarsa, S. 2024. Computing education in the era of generative AI. Communications of the ACM 67, 2, 56–67. DOI: 10.1145/3624720.
- Güner, H. and Er, E. 2025. AI in the classroom: Exploring students' interaction with ChatGPT in programming learning. Education and Information Technologies 30, 12681–12707. DOI: 10.1007/s10639-025-13337-7.
- Mason, R., Simon, Becker, B. A., Crick, T., and Davenport, J. H. 2024. A global survey of introductory programming courses. In Proceedings of the 55th ACM Technical Symposium on Computer Science Education (SIGCSE TS 2024). DOI: 10.1145/3626252.3630761.
- Avouris, N., Sgarbas, K., Caridakis, G., and Sintoris, C. 2025. Teaching introduction to programming in the times of AI: A case study of a course re-design. arXiv preprint arXiv:2508.06572. DOI: 10.48550/arXiv.2508.06572.
- Biggs, J. 1996. Enhancing teaching through constructive alignment. Higher Education 32, 3, 347–364.
- Prather, J., Reeves, B. N., Denny, P., Becker, B. A., Leinonen, J., Luxton-Reilly, A., Powell, G., Finnie-Ansley, J., and Santos, E. A. 2023. "It's weird that it knows what I want": Usability and interactions with Copilot for novice programmers. ACM Transactions on Computer-Human Interaction 31, 1, Article 4. DOI: 10.1145/3617367.
- Ghimire, A. and Edwards, J. 2024. Coding with AI: How are tools like ChatGPT being used by students in foundational programming courses. In Artificial Intelligence in Education (AIED 2024), Lecture Notes in Computer Science, vol. 14830. Springer, Cham, 259–267. DOI: 10.1007/978-3-031-64299-9_20.
- Zviel-Girshin, R. 2024. The good and bad of AI tools in novice programming education. Education Sciences 14, 10, 1089. DOI: 10.3390/educsci14101089.
- Prather, J., Reeves, B. N., Leinonen, J., MacNeil, S., Randrianasolo, A. S., Becker, B. A., Kimmel, B., Wright, J., and Briggs, B. 2024. The widening gap: The benefits and harms of generative AI for novice programmers. In Proceedings of the 2024 ACM Conference on International Computing Education Research (ICER 2024). DOI: 10.1145/3632620.3671116.
- Mahon, J., Mac Namee, B., and Becker, B. A. 2024. Guidelines for the evolving role of generative AI in introductory programming based on emerging practice. In Proceedings of the 2024 Conference on Innovation and Technology in Computer Science Education (ITiCSE 2024). DOI: 10.1145/3649217.3653602.
- Alanazi, M., Soh, B., Samra, H., and Li, A. 2025. The influence of artificial intelligence tools on learning outcomes in computer programming: A systematic review and meta-analysis. Computers 14, 5, 185. DOI: 10.3390/computers14050185.
- Speth, S., Meißner, N., and Becker, S. 2023. Investigating the use of AI-generated exercises for beginner and intermediate programming courses: A ChatGPT case study. In Proceedings of the 35th IEEE Conference on Software Engineering Education and Training (CSEE&T 2023). DOI: 10.1109/CSEET58097.2023.00030.
Index Terms
Keywords