Call for Paper - May 2019 Edition
IJCA solicits original research papers for the May 2019 Edition. Last date of manuscript submission is April 20, 2019. Read More

Automated Software Testing Frameworks: A Review

International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Year of Publication: 2018
Milad Hanna, Amal Elsayed Aboutabl, Mostafa-Sami M. Mostafa

Milad Hanna, Amal Elsayed Aboutabl and Mostafa-Sami M Mostafa. Automated Software Testing Frameworks: A Review. International Journal of Computer Applications 179(46):22-28, June 2018. BibTeX

	author = {Milad Hanna and Amal Elsayed Aboutabl and Mostafa-Sami M. Mostafa},
	title = {Automated Software Testing Frameworks: A Review},
	journal = {International Journal of Computer Applications},
	issue_date = {June 2018},
	volume = {179},
	number = {46},
	month = {Jun},
	year = {2018},
	issn = {0975-8887},
	pages = {22-28},
	numpages = {7},
	url = {},
	doi = {10.5120/ijca2018917171},
	publisher = {Foundation of Computer Science (FCS), NY, USA},
	address = {New York, USA}


Manual software testing has been traditionally used in the software industry. It depends completely on human testers without the help of any tool to detect the unexpected behavior of an application. However, the main problem in the manual testing approach is that it is a time-consuming task in addition to the fact that tests cannot be reused. Automation software testing has been introduced to reduce testing efforts and detect as many faults as possible. Test cases are executed not only to test the functional requirements for the first time, but also to check the functions which have been already tested. This study aims to present the main features of different automation testing frameworks. In addition, an overview of different scripting techniques is presented during the study.


  1. Q. A. Malik, "Combining Model-Based Testing, Stepwise Formal Development," Abo Akademi University, Department of Information Technologies Joukahaisenkatu, [PhD Thesis], 2010.
  2. Banerjee, B. Nguyen, V. Garousi and A. Memona, "Graphical User Interface (GUI) Testing Systematic Mapping and Repository," Information and Software Technology, vol. 55, no. 10, p. 1679–1694, 2013.
  3. P. Yadav and A. Kumar, "An Automation Testing Tool Using Selenium," International Journal of Emerging Trends & Technology in Computer Science (IJETTCS), vol. 4, no. 5, pp. 068-071, 2015.
  4. G. Tassey, "The Economic Impacts of Inadequate Infrastructure for Software Testing," National Institute of Standards and Technology Acquisition and Assistance Division, 2002.
  5. Jain and S. Sharma, "An Efficient Keyword Driven Test Automation Framework for Web Applications," International Journal of Engineering Science & Advanced Technology, vol. 2, no. 3, pp. 600-604, 2012.
  6. K. M. Mustafa, R. E. Al-Qutaish and M. I. Muhairat, "Classification of Software Testing Tools Based on the Software Testing Methods," Second International Conference on Computer and Electrical Engineering, vol. 2, 2009.
  7. O. A. Lemosa, F. C. Ferrari, M. M. Eler, C. J. Maldonado and P. C. Masiero, "Evaluation Studies of Software Testing Research in Brazil, In The World: A Survey of Two Premier Software Engineering Conferences," Journal of Systems and Software, vol. 86, no. 4, p. 2013, 951–969.
  8. Santiago, W. P. Silva and N. L. Vijaykumar, "Shortening Test Case Execution Time for Embedded Software," Second International Conference on Secure System Integration and Reliability Improvement, 2008.
  9. R. K. Chauhan and I. Sing, "Latest Research and Development on Software Testing Techniques and Tools," International Journal of Current Engineering, Technology, vol. 4, no. 4, 2014.
  10. Singh and B. Tarika, "Comparative Analysis of Open Source Automated Software Testing Tools: Selenium, Sikuli, Watir," International Journal of Information and Computation Technology, vol. 4, pp. 1507-1518, 2015.
  11. Divya and S. D. Mahalakshmi, "An Efficient Framework for Unified Automation Testing: A Case Study on Software Industry," International Journal of Advanced Research in Computer Science & Technology, vol. 2, 2014.
  12. T. Kanstrén, "A Review of Domain-Specific Modelling, Software Testing," The Eighth International Multi-Conference on Computing in the Global Information Technology, 2013.
  13. Pillai, "Designing Keyword Driven Framework mapped at Operation Level," 2017. [Online]. Available:
  14. S. Thummalapenta, S. Sinha, N. Singhania and S. Chandra, "Automating Test Automation," 34th International Conference on Software Engineering (ICSE), 2012.
  15. V. N. Maurya and R. Kumar, "Analytical Study on Manual vs. Automated Testing Using with Simplistic Cost Model," International Journal of Electronics and Electrical Engineering, vol. 2, no. 1, 2012.
  16. Jain, M. Jain and S. Dhankar, "A Comparison of RANOREX, QTP Automated Testing Tools, their impact on Software Testing," International Journal of Engineering, Management & Sciences (IJEMS) ISSN-2348 –3733, vol. 1, no. 1, 2014.
  17. J. Mishra, I. Ali and A. K. Upadhyay, "Automated Model Based Testing," International Journal of Engineering Research & Technology (IJERT), vol. 1, no. 4, 2012.
  18. V. Sangave and V. Nandedkar, "Generic Test Automation," International Journal of Science and Research (IJSR), vol. 4, no. 7, 2015.
  19. M. Sadiq and F. Firoze, "A Method for the Selection of Software Testing Automation Framework using Analytic Hierarchy Process," International Journal of Computer Applications, 2014.
  20. S. Maheshwari and D. C. Jain, "A Comparative Analysis of Different Types of Models in Software Development Life Cycle," International Journal of Advanced Research in Computer Science and Software Engineering, vol. 2, no. 5, 2012.
  21. J. A. Clark, H. Danb and R. M. Hierons, "Semantic Mutation Testing," Third International Conference on Software Testing, Verification, and Validation Workshops, vol. 78, no. 4, p. 345–363, 2011.
  22. O.-P. Puolitaival, T. Kanstrén, V.-M. Rytky and A. Saarela, "Utilizing Domain-Specific Modelling for Software Testing," The Third International Conference on Advances in System Testing and Validation Lifecycle, pp. 115-150, 2011.
  23. T. Kosa, M. Mernikb and T. Kosarb, "Test Automation of a Measurement System Using a Domain-Specific Modelling Language," Journal of Systems and Software, vol. 111, p. 74–88, 2016.
  24. S. Paydar and M. Kahani, "An Agent-Based Framework for Automated Testing of Web-Based Systems," Journal of Software Engineering and Applications, vol. 4, pp. 86-94, 2011.
  25. Ema and E. M. Reddyb, "Software Test Automation: An algorithm for solving system management automation problems," International Conference on Information, Communication Technologies (ICICT), vol. 46, pp. 949-956, 2015.
  26. T. R. Devi, "Propose Automated Software Testing Tools to Test Given Application Report Bugs," International Journal of Engineering Research and Technology (IJERT), vol. 2, no. 1, 2013.
  27. B. Bhondokar, P. Ranawade, S. Jadhav and M. Vibhute, "Hybrid Test Automation Framework for Web Application," International Journal of Engineering Research and Technology (IJERT), vol. 4, no. 4, pp. 1007-1012, 2015.
  28. M. Hammoudi, G. Rothermel and P. Tonella, "Why do Record/Replay Tests of Web Applications Break?," IEEE International Conference on Software Testing, Verification and Validation (ICST), 2016.
  29. B. N. Nguyen, B. Robbins, I. Banerjee and A. Memon, "GUITAR: an Innovative Tool for Automated Testing of GUI-driven Software," Automated Software Engineering, vol. 21, no. 1, p. 65–105, 2014.
  30. J. Tang, X. Cao and A. Ma, "Towards Adaptive Framework of Keyword Driven Automation Testing," IEEE International Conference on Automation and Logistics, 2008.
  31. Peethambaran, "Automated Functional Testing Using Keyword-driven Framework," Helsinki Metropolia University of Applied Sciences, Master of Engineering [Master Thesis], 2015.
  32. G. D. Lucca, A. Fasolino and F. Faralli, "Testing web applications," International Conference on Software Maintenance, p. 310, 2002.
  33. R. D. Craig and S. P. Jaskiel, Systematic Software Testing, Artech House Publishers, 2002.
  34. T. Pajunen, T. Takala and M. Katara, "Model-Based Testing with a General Purpose Keyword-Driven Test Automation Framework," Fourth International Conference on Software Testing, Verification and Validation Workshops, 2011.
  35. M. Leotta, D. Clerissi, F. Ricca and P. Tonella, "Capture-Replay vs. Programmable Web Testing," 20th Working Conference on Reverse Engineering (WCRE), 2013.
  36. M. Leotta, D. Clerissi, F. Ricca and P. Tonella, "Visual vs. DOM-Based Web Locators: An Empirical Study," International Conference on Web Engineering (ICWE), p. 322–340, 2014.
  37. H. Liu and H. Lieberman, "Programmatic Semantics for Natural Language Interfaces," Proceeding Extended Abstracts on Human Factors in Computing Systems, pp. 1597-1600, 2005.
  38. C. Kelleher and R. Pausch, "Lowering the Barriers to Programming: A Taxonomy of Programming Environments,Llanguages for Novice Programmers," Journal ACM Computing Surveys (CSUR), vol. 37, no. 2, p. 133–137, 2005.
  39. S. Srivastava, S. Gulwani and J. S. Foster, "From Program Verification to Program Synthesis," Proceedings of the 37th annual ACM SIGPLAN-SIGACT symposium on Principles of programming languages, vol. 45, no. 1, pp. 313-326, 2010.
  40. G. Little and R. C. Miller, "Translating Keyword Commands into Executable Code," Proceeding UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology, pp. 135-144, 2006.
  41. F. Wang and W. Du, "A Test Automation Framework Based on WEB," IEEE/ACIS 11th International Conference on Computer and Information Science, pp. 683-687, 2012.
  42. J. M, S. P and S. Prabu, "Web-Based Automation Testing Framework," International Journal of Computer Applications, vol. 45, no. 16, 2012.
  43. K. V. Arya and H. Verma, "Keyword Driven Automated Testing Framework for Web Application," 9th International Conference on Industrial and Information Systems (ICIIS), 2014.
  44. S. Singla and H. Kaur, "Selenium Keyword Driven Automation Testing Framework," International Journal of Advanced Research in Computer Science, Software Engineering, vol. 4, no. 6, pp. 125-129, 2014.
  45. K. Jha, "Development of Test Automation Framework for Testing Avionics Systems," 29th Digital Avionics Systems Conference (DASC), 2010.
  46. M. Yalla and M. Shanbhag, "Building Automation Framework Around Open Source Technologies," Proceeding of Software Testing Conference, pp. 6-9, 2009.
  47. S. Stresnjak and Z. Hocenski, "Usage of Robot Framework in Automation of Functional Test Regression," The Sixth International Conference on Software Engineering Advances (ICSEA), pp. 30-34, 2011.
  48. Madhavan, "Semi Automated User Acceptance Testing using NLP," Lowa State University, [Master Thesis], 2014.
  49. Cervantes, "Exploring the Use of a Test Automation Framework," IEEE Aerospace conference, 2009.
  50. E. Engström, P. Runeson and M. Skoglund, "A Systematic Review on Regression Test Selection Techniques," Information and Software Technology, vol. 52, p. 14–30, 2010.
  51. Swarnendu and R. Mall, "Regression Test Selection Techniques A Survey," An international Journal of Computing and Informatics, vol. 35, p. 289–321, 2011.
  52. Zarrad, "A Systematic Review on Regression Testing for Web-Based Applications," Journal of Software, vol. 8, pp. 971-990, 2015.
  53. P. K. Chittimalli and M. J. Harrold, "Recomputing Coverage Information to Assist Regression Testing," IEEE Transactions on Software Engineering, vol. 35, no. 4, p. 452–469, 2009.
  54. K. Dobolyi, E. Soechting and W. Weimer, "Automating regression testing using web-based application similarities," International Journal on Software Tools for Technology Transfer, vol. 13, no. 2, p. 111–129, 2011.


Software Testing, Automated Software Testing, Test Data, Test Case, Test Script, Manual Testing, Software Under Test.