Call for Paper - November 2020 Edition
IJCA solicits original research papers for the November 2020 Edition. Last date of manuscript submission is October 20, 2020. Read More

Accessing and Evaluating AspectJ based Mutation Testing Tools

International Journal of Computer Applications
© 2011 by IJCA Journal
Number 1 - Article 1
Year of Publication: 2011
Mayank Singh
Shailendra Mishra
Rajib Mall

Mayank Singh, Shailendra Mishra and Rajib Mall. Article: Accessing and Evaluating AspectJ based Mutation Testing Tools. International Journal of Computer Applications 31(1):33-38, October 2011. Full text available. BibTeX

	author = {Mayank Singh and Shailendra Mishra and Rajib Mall},
	title = {Article: Accessing and Evaluating AspectJ based Mutation Testing Tools},
	journal = {International Journal of Computer Applications},
	year = {2011},
	volume = {31},
	number = {1},
	pages = {33-38},
	month = {October},
	note = {Full text available}


Software testing plays a crucial role in software development life cycle. Without testing, quality of software product is questionable. Mutation testing, widely accepted fault based testing technique. Aspect Oriented Programming is a new methodology that introduces the concept of modularization. AspectJ is an aspect oriented programming language that provides the concept of pointcut and advice. With new features, AOP introduces new faults that can be easily handled by mutation testing. In this paper, we evaluate the available AspectJ based mutation testing tools and identify the basic requirements that must be satisfied by any developed tool.


  • R. A. DeMillo, R. J. Lipton, and F. G. Sayward, “Hints on Test Data Selection: Help for the Practicing Programmer,” Computer, vol. 11, no. 4, pp. 34–41, April 1978.
  • Beizer B., Software Testing Techniques, 1990.
  • Michael C, Promoting Firm Mutation Testing to Strong Mutation Testing with Stochastic Methods, TR 95-003-07, Nov. 1995.
  • R. T. Alexander, J. M. Bieman, S. Ghosh, and B. Ji, “Mutation of Java Objects,” in Proceedings of the 13th International Symposium on Software Reliability Engineering (ISSRE’02). Annapolis, Maryland: IEEE Computer Society, pp. 341–351, 12-15 November 2002.
  • P. Anbalagan and T. Xie, “Efficient Mutant Generation for Mutation Testing of Pointcuts in Aspect-Oriented Programs,” in Proceedings of the 2nd Workshop on Mutation Analysis (MUTATION’ 06). Raleigh, North Carolina: IEEE Computer Society, p. 3, November 2006.
  • P. Anbalagan and T. Xie, “Automated Generation of Pointcut Mutants for Testing Pointcuts in AspectJ Programs,” in Proceedings of the 19th International Symposium on Software Reliability Engineering (ISSRE’08). Redmond, Washington: IEEE Computer Society, pp. 239–248, 11-14 November 2008.
  • Andrew Jackson and Siobhán Clarke, “MuAspectJ: Mutant Generation to Support Measuring the Testability of AspectJ Programs”, Technical report (TCD-CS-2009-38), ACM, September 2009.
  • Y.-S. Ma, A. J. Offutt, and Y.-R. Kwon, “MuJava: An Automated Class Mutation System,” Software Testing, Verification & Reliability, vol. 15, no. 2, pp. 97–133, June 2005.
  • Jeff Offutt, Yu-SeungMa and Yong-Rae Kwon, “The Class-LevelMutants of MuJava”, Workshop on Automation of Software Test (AST 2006). pages 78-84, Shanghai, China, May 2006,
  • T. Sugeta, J. C. Maldonado, and W. E. Wong, “Mutation Testing Applied to Validate SDL Specifications,” in Proceedings of the 16th IFIP International Conference on Testing of Communicating Systems, ser. LNCS, vol. 2978, Oxford, UK, p. 2741, 17-19 March 2004.
  • Uira Kulesza, Claudio Sant'Anna, Alessandro Garcia, Roberta Coelho, Arndt von Staa, and Carlos Lucena, ”Quantifying the effects of aspect-oriented programming: A maintenance study”, in ICSM '06: Proceedings of the 22nd IEEE International Conference on Software Maintenance, IEEE Computer Society, pages 223-233, Washington, DC, USA, 2006.
  • Fabiano Cutigi Ferrari, Jose Carlos Maldonado, and Awais Rashid, ”Mutation testing for aspect-oriented programs” in ICST '08: Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation, IEEE Computer Society, pages 52-61, Washington, DC, USA, 2008.
  • R. Delamare, B. Baudry, and Y. Le Traon, “AjMutator: A Tool For The Mutation Analysis Of AspectJ Pointcut Descriptors,” in Proceedings of the 4th International Workshop on Mutation Analysis (MUTATION’09), published with Proceedings of the 2nd International Conference on Software Testing, Verification, and Validation Workshops. Denver, Colorado: IEEE Computer Society, pp. 200–204, 1-4 April 2009.
  • Roger T. Alexander, Stephan Herrmann, Dehla Sokenou, “Testing aspect-oriented programming Pointcut Descriptors”, in Proceedings of International conference AOSD, ACM, page no 33-38, 2006.
  • E. M. Cagnon and L. J. Hendren. Sablecc, “An object oriented compiler framework”, in TOOLS’98: Proceedings of the Technology of Object-Oriented Languages and Systems, IEEE Computer Society, pages 140–154, August 1998.
  • P. Avgustinov, A. S. Christensen, L. J. Hendren, S. Kuzins, J. Lhot´ak, O. Lhot´ak, O. de Moor, D. Sereni, G. Sittampalam, and J. Tibble, “ abc: an extensible aspectj compiler”, in AOSD’05: Proceedings of the 4th international conference on Aspect-oriented software development, ACM, pages 87–98, New York, NY, USA, 2005.
  • Healthwatcher.
  • Fabiano Cutigi Ferrari, Elisa Yumi Nakagawa, José Carlos Maldonado, Awais Rashid, “Proteum/AJ: a mutation system for AspectJ programs”, in Proceedings of the tenth international conference on Aspect-oriented software development companion (AOSD’11), ACM New York, NY, USA , 2010.
  • José Carlos Maldonado, Márcio Eduardo Delamaro, Sandra C. P. F. Fabbri, Adenilso da Silva Simão, Tatiana Sugeta, Paulo Cesar Masiero, Auri Marcelo Rizzo Vincenzi, ”Proteum: A family of tools to support specification and program testing based on mutation”, in Mutation 2000 Symposium (Tool Session), pages 113–116. Kluwer, 2000.
  • E. Y. Nakagawa, A. S. Sim˜ao, F. C. Ferrari, and J. C. Maldonado, “Towards a reference architecture for software testing tools”, in SEKE’07, pages 157–162, 2007.
  • AspectJ-front. ctJFront - accessed on 01/09/2011.
  • Ant. - accessed on 01/09/2011.
  • iBATIS data mapper. - accessed on 01/09/2011
  • AspectJ documentation, 2010. aspectj/docs.php - accessed on 01/09/2011.
  • R. Delamare, B. Baudry, , S. Ghosh, and Y. Le Traon, “A Test- Driven Approach to Developing Pointcut Descriptors in AspectJ,” in Proceedings of the 2nd International Conference on Software Testing Verification and Validation (ICST’09), Davor Colorado, pp. 376–38, 01-04 April 2009.
  • L. Ye and K. D. Volder, “Tool support for understanding and diagnosing pointcut expressions”, in AOSD’08: Proceedings of the 7th international conference on Aspect oriented software development, New York, NY, USA, ACM, pages 144–155, 2008.
  • C. Koppen and M. Storzer, “Pcdiff: Attacking the fragile pointcut problem”, in European Interactive Workshop on Aspects in Software (EIWAS), September 2004.
  • J. Horgan and A. Mathur, “Assessing testing tools in research and education”, IEEE Software, 9(3):61–69, 1992.
  • L. Madeyski N. Radyk, ”Judy – a mutation testing tool for Java”, Published in IET Softw., Vol. 4, Iss. 1, pp. 32–42, 2010.
  • Scholivé, M., Beroulle, V., Robach, C., Flottes, M.L., Rouzeyre, B., “Mutation Sampling Technique for the Generation of Structural Test Data”, published in proceedings of Design, Automation and Test in Europe (DATE’05), 2005.
  • Derezi´nska, “Object-oriented Mutation to Assess the Quality of Tests,” in Proceedings of the 29th Euromicro Conference, Belek, Turkey, pp. 417– 420, 1-6 September 2003.
  • S. C. P. F. Fabbri, J. C. Maldonado, P. C. Masiero, and M. E. Delamaro, “Proteum/FSM: A Tool to Support Finite State Machine Validation Based on Mutation Testing,” in Proceedings of the 19th International Conference of the Chilean Computer Science Society (SCCC’99), Talca, Chile, p. 96, 11-13 November 1999.
  • R. J. Lipton and F. G. Sayward, “The Status of Research on Program Mutation,” in Proceedings of the Workshop on Software Testing and Test Documentation, pp. 355–373, December 1978.
  • J. Offutt, “The Coupling Effect: Fact or Fiction,” ACM SIGSOFT Software Engineering Notes, vol. 14, no. 8, pp. 131–140, December 1989.
  • J. Offutt, “Investigations of the Software Testing Coupling Effect”, ACM Transactions on Software Engineering and Methodology, vol. 1, no. 1, pp. 5–20, January 1992.
  • K. S. H. T. Wah, “An Analysis of the Coupling Effect I: Single Test Data,” Science of Computer Programming, vol. 48, no. 2-3, pp. 119– 161, August-September 2003.
  • Offutt A., A Practical System for Mutation Testing: Help for the Common Programmer, Twelfth International Conference on Testing Computer Software, 99-109, Washington D.C. June 1995.
  • DeMillo R., Coanstraint-Based Automatic Test Data Generation, IEEE Transactions on Software Engineering, 17(9): 900-910, 1991.