CFP last date
20 May 2024
Reseach Article

Regression Testing: A Spectrum-based Approach

by Shailesh Tiwari, K. K. Mishra, A. K. Misra
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 55 - Number 18
Year of Publication: 2012
Authors: Shailesh Tiwari, K. K. Mishra, A. K. Misra
10.5120/8994-3220

Shailesh Tiwari, K. K. Mishra, A. K. Misra . Regression Testing: A Spectrum-based Approach. International Journal of Computer Applications. 55, 18 ( October 2012), 35-42. DOI=10.5120/8994-3220

@article{ 10.5120/8994-3220,
author = { Shailesh Tiwari, K. K. Mishra, A. K. Misra },
title = { Regression Testing: A Spectrum-based Approach },
journal = { International Journal of Computer Applications },
issue_date = { October 2012 },
volume = { 55 },
number = { 18 },
month = { October },
year = { 2012 },
issn = { 0975-8887 },
pages = { 35-42 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume55/number18/8994-3220/ },
doi = { 10.5120/8994-3220 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T20:57:37.422100+05:30
%A Shailesh Tiwari
%A K. K. Mishra
%A A. K. Misra
%T Regression Testing: A Spectrum-based Approach
%J International Journal of Computer Applications
%@ 0975-8887
%V 55
%N 18
%P 35-42
%D 2012
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Regression testing involves re-run of all test suite or selective run of a sub-set of existing test cases on the modified version of program to reveal the regression faults due to changes in code and use of these non obsolete test cases from pre-existing test suite to explore and eradicate regression faults. This paper addresses the fundamental limitations of conventional regression testing approach and presents a spectrum-based fault localization strategy by which the stated limitations are resolved in effective manner. Spectrum-based fault localization strategy utilizes various program spectra to identify the behavioral differences between old and new version of the program under test. This comparison is also useful in pinpointing the cause of failures or errors and presence of difference in program spectra may indicate those test cases for which the construction of expected output or oracle or specification is not needed. The present approach can identify and localize the faults effectively and also identify those test cases from pre-existing test suite available for existing program that exercise the changed behavior of the modified code. Further the developer can easily identify whether the differences recorded in modified version of code is due to regression faults or due to changes made in the code.

References
  1. Todd L. Graves, Mary Jean Harrold, Jung-Min Kim, Adam Porter, and Gregg Rothermel. 2001. "An empirical study of regression test selection techniques", ACM Trans. Softw. Eng. Methodology. 10, 2 (April 2001).
  2. J. C. Munson and T. M. Khoshgoftaar, "The detection of Fault Prone Programs", IEEE Trans. Software Eng. Vol. 18, No. 5, pp 423-433, May 1992. .
  3. Gregg G. Rothermel and M. J. Harrold, "Analyzing Regression Test Selection Techniques", IEEE Trans. Software Eng. , vol. 22, no. 8, pp. 29-551, Aug. 1996.
  4. K. F. Fischer, F. Raji, and A. Ch ruscicki, "A Methodology for Retesting Modified Software", Proc. National Telecomm. Conf. B-6-3, pp. 1-6, Nov. 1981.
  5. S. Bates and S. Horwitz, "Incremental Program Testing Using Program Dependence Graphs", Proc. 20th ACM Symp. Principles of Programming Languages, Jan. 1993.
  6. M. Hutchins, H. Foster, T. Goradi a, and T. Ostrand, "Experiments on the Effectiveness of Dataflow- and Control flow-Based Test Adequacy Criteria", Proc. 16th Int'l Conf. Software Eng. , pp. 191- 2000, May 1994
  7. T. J. Ostrand and M. J. Balcer, "The Category-Pa rtition Method for Specifying and Generating Functional Tests", Comm. ACM, vol. 31, no. 6, June 1988.
  8. T. J. Ostrand and E. J. Weyuke r, "Using Dataflow Analysis for Regression Testing", Proc. Sixth Ann. Pacific Northwest Software Quality Conf. , pp. 233-247, Sept. 1988.
  9. D. Rosenblum and G. Rothermel, "An Empirical Comparison of Regression Test Selection Techniques", Proc. Int'l Workshop Empirical Studies of Software Maintenance, pp. 89-94, Oct. 1997. Spector, A. Z. 1989.
  10. S. S. Yau and Z. Kishimoto, "A Method for Revalidating Modified Programs in the Maintenance Phase", Proc. 11th Ann. Int'l Computer Software and Applications Conf. (COMPSAC '87), pp. 272-277.
  11. Mary Jean Harrold, Gregg Rothermel, Rui Wu, and Liu Yi. 1998. An empirical investigation of program spectra. SIGPLAN Notes 33, 7 (July 1998), 83-90.
  12. G. Ammons. Ball and . J. R. Laru s. Exploiting hardware performance counters with flow and context sensitive profiling. ACM Sigplan Notes, 32(5):85-~96, June 1997.
  13. T. Reps, T. Ball, M. Das, and . J. Larus. The use of program profiling for software maintenance with applications to the year 2000 problem. ACM Software Engineering Notes, 22(6):432-439, Nov. 1997.
  14. W. E. Wong and V. Debroy, "A survey on software fault localization," Technical Report UTDCS-45-09, Department of Computer Science, University of Texas at Dallas, November 2009.
  15. Tiwari, S. ; Mishra, K. K. ; Kumar, A. ; Misra, A. K. ; , "Spectrum-Based Fault Localization in Regression Testing," Information Technology: New Generations (ITNG), 2011 Eighth International Conference on , vol. , no. , pp. 191-195, 11-13 April 2011 doi: 10. 1109/ITNG. 2011. 40.
  16. M. -C. Gaudel, Testing can be fo rmal, too, Proceedings of the Sixth International Joint CAAP/FASE Conf erence on Theory and Practice of Software Development (TAPSOFT'95), Lecture Notes in Computer Science, vol. 915, Springer, Berlin, 1995, pp. 82–96.
  17. W. E. Howden, Reliability of the path analysis testing strategy, IEEE Transactions on Software Engineering SE-2 (3) (1976) 208–215.
  18. E. J. Weyuker, On testing non-testable programs, The Computer Journal 25 (4) (1982) 465–470.
  19. Gregg Rothermel, Mary Jean Harrold, "A safe, efficient regression test selection technique", ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 6 Issue 2, April „1997, Pages 173 – 210.
  20. Wong, J. R. Horgon, A. P. Mathur, and Pasquini, Test set size minimization and fault detection effectiveness: a case study in a space application", in proceedings of the IEEE Computer Society?s International Computer Software and Applications Conference (COMPSAC?97), pp. 522-528, Washington, DC, USA, August 1997.
  21. Anjaneyulu Pasala and et al. ," Selection of Regression Test Suite to Validate Software Applications upon Deployment of Upgrades", IEEE 19th Australian Conference on Software Engineering, November, 2008.
  22. M. J. Harrold, G. Rothermel, K. Sayre, R. Wu, and L. Yi, "An Empirical Investigation of the Relationship between Spectra Differences and Regression Faults," Journal of Software Testing, Verification and Reliability, 10(3):171-194, September 2000.
  23. Yoo, S. , & Harman, M. (2010). Regression testing minimization, selection and prioritization: A survey. Software Testing, Verification and Reliability. doi:10. 1002/stvr. 430.
  24. T. Ball and J. R. Larus. Efficient Path Profiling in Proc. Of Micro 96, Pages 46-57, Dec 1996.
  25. Xie, T. , Notkin, D. : Checking inside the black box: Regression testing by comparing value spectra. IEEE Transactions on Software Engineering 31(10), 869–883 (2005)
  26. J. F. Bowring, J. M. Rehg, and M. J. Harrold. Active learning for automatic classification of software behavior. InProceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis, pages 195–205, New York, 2004. ACM Press.
  27. Zhenyu Zhang, W. K. Chan, T. H. Tse, Y. T. Yu, Peifeng Hu, Non-parametric statistical fault localization, Journal of Systems and Software, Volume 84, Issue 6, June 2011, Pages 885-905, ISSN 0164-1212, 10. 1016/j. jss. 2010. 12. 048.
  28. Sample programs are taken for experiments from Software Infrastructures Repository (SIR) http://sir. unl. edu/content/sir. php.
  29. A. Orso and T. Xie. BERT: BEhavioral Regression Testing. In Proc. WODA, pages 36–42, 2008.
Index Terms

Computer Science
Information Sciences

Keywords

Regression Testing Fault Localization Program Spectrum Behavioral Regression Testing.