Call for Paper - January 2023 Edition
IJCA solicits original research papers for the January 2023 Edition. Last date of manuscript submission is December 20, 2022. Read More

A Univariate Marginal Approach for Pairwise Testing of Software Product Lines

Print
PDF
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Year of Publication: 2017
Authors:
Mohd Zanes Sahid, Abu Bakar Md Sultan, Abdul Azim Abdul Ghani, Salmi Baharom
10.5120/ijca2017912987

Mohd Zanes Sahid, Abu Bakar Md Sultan, Abdul Azim Abdul Ghani and Salmi Baharom. A Univariate Marginal Approach for Pairwise Testing of Software Product Lines. International Journal of Computer Applications 160(3):6-12, February 2017. BibTeX

@article{10.5120/ijca2017912987,
	author = {Mohd Zanes Sahid and Abu Bakar Md Sultan and Abdul Azim Abdul Ghani and Salmi Baharom},
	title = {A Univariate Marginal Approach for Pairwise Testing of Software Product Lines},
	journal = {International Journal of Computer Applications},
	issue_date = {February 2017},
	volume = {160},
	number = {3},
	month = {Feb},
	year = {2017},
	issn = {0975-8887},
	pages = {6-12},
	numpages = {7},
	url = {http://www.ijcaonline.org/archives/volume160/number3/27051-2017912987},
	doi = {10.5120/ijca2017912987},
	publisher = {Foundation of Computer Science (FCS), NY, USA},
	address = {New York, USA}
}

Abstract

Software Product Line (SPL) is a software engineering paradigm that is inspired by the concept of reusability of common features, formulated for different software products. Complete testing of all software products in SPL is known to be unfeasible. This is due to the very large number of possible products that can be produced or configured using a combination of features in the SPL. Pairwise Testing is a type of Combinatorial Testing, influenced by the perception that two factors (or features in the context of SPL testing) stimulate most faults. The effectiveness of SPL testing can be measured using the pairwise coverage of test configuration. However, to generate minimal test configuration that maximizes the pairwise coverage is not trivial, especially when dealing with a huge number of features and when constraints have to be satisfied, which is the case in most SPL scenarios. Therefore, it is the motivation of this work to investigate the feasibility of an Estimation of Distribution Algorithm (EDA), specifically the Univariate Marginal Distribution Algorithm (UMDA), in generating minimal test configuration for pairwise testing of SPL. The experimental results show that in certain problem instances, UMDA is able to compete with existing greedy and search-based algorithms.

References

  1. K. Lee, K. Kang, and J. Lee, "Concepts and Guidelines of Feature Modeling for Product Line Software Engineering," in Software Reuse: Methods, Techniques, and Tools. vol. 2319, C. Gacek, Ed., ed: Springer Berlin Heidelberg, 2002, pp. 62-77.
  2. M. M. Alam, A. I. Khan, and A. Zafar, "A Comprehensive Study of Software Product Line Frameworks," International Journal of Computer Applications, vol. 151, pp. 11-17, 2016.
  3. S. Apel, D. Batory, C. Kästner, and G. Saake, "Feature Interactions," in Feature-Oriented Software Product Lines: Concepts and Implementation, ed Berlin, Heidelberg: Springer Berlin Heidelberg, 2013, pp. 213-241.
  4. M. F. Johansen, Ø. Haugen, and F. Fleurey, "An algorithm for generating t-wise covering arrays from large feature models," in Proceedings of the 16th International Software Product Line Conference-Volume 1, 2012, pp. 46-55.
  5. C. Henard, et al., "Bypassing the Combinatorial Explosion: Using Similarity to Generate and Prioritize T-Wise Test Configurations for Software Product Lines," Software Engineering, IEEE Transactions on, vol. 40, pp. 650-670, 2014.
  6. R. E. Lopez-Herrejon, S. Fischer, R. Ramler, and A. Egyed, "A first systematic mapping study on combinatorial interaction testing for software product lines," in Eighth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2015, pp. 1-10.
  7. S. Oster, F. Markert, and P. Ritter, "Automated Incremental Pairwise Testing of Software Product Lines," in Software Product Lines: Going Beyond. vol. 6287, J. Bosch and J. Lee, Eds., ed: Springer Berlin Heidelberg, 2010, pp. 196-210.
  8. M. Mendonca, M. Branco, and D. Cowan, "SPLOT: software product lines online tools," in Proceedings of the 24th ACM SIGPLAN conference companion on Object oriented programming systems languages and applications, 2009, pp. 761-762.
  9. M. Pelikan, M. Hauschild, and F. Lobo, "Estimation of Distribution Algorithms," in Springer Handbook of Computational Intelligence, J. Kacprzyk and W. Pedrycz, Eds., ed: Springer Berlin Heidelberg, 2015, pp. 899-928.
  10. S. Shakya and R. Santana, "A Review of Estimation of Distribution Algorithms and Markov Networks," in Markov Networks in Evolutionary Computation. vol. 14, S. Shakya and R. Santana, Eds., ed: Springer Berlin Heidelberg, 2012, pp. 21-37.
  11. D. Simon, "Estimation of Distribution Algorithms," in Evolutionary Optimization Algorithms, First ed: John Wiley & Sons, 2013, pp. 313-34 7.
  12. M. Hauschild and M. Pelikan, "An introduction and survey of estimation of distribution algorithms," Swarm and Evolutionary Computation, vol. 1, pp. 111-128, 2011.
  13. Y. A. Alsariera, M. A. Majid, and K. Z. Zamli, "SPLBA: An interaction strategy for testing software product lines using the Bat-inspired algorithm," in Software Engineering and Computer Systems (ICSECS), 2015 4th International Conference on, 2015, pp. 148-153.
  14. S. Wang, S. Ali, and A. Gotlieb, "Minimizing test suites in software product lines using weight-based genetic algorithms," in Proceedings of the 15th annual conference on Genetic and evolutionary computation, Amsterdam, The Netherlands, 2013, pp. 1493-1500.
  15. E. N. Haslinger, R. E. Lopez-Herrejon, and A. Egyed, "Improving CASA runtime performance by exploiting basic feature model analysis," arXiv preprint arXiv:1311.7313, 2013.
  16. F. Ensan, E. Bagheri, and D. Gašević, "Evolutionary Search-Based Test Generation for Software Product Line Feature Models," in Advanced Information Systems Engineering. vol. 7328, J. Ralyté, et al., Eds., ed: Springer Berlin Heidelberg, 2012, pp. 613-628.
  17. R. Sagarna and J. Lozano, "Software Metrics Mining to Predict the Performance of Estimation of Distribution Algorithms in Test Data Generation," in Knowledge-Driven Computing. vol. 102, C. Cotta, et al., Eds., ed: Springer Berlin Heidelberg, 2008, pp. 235-254.
  18. R. Sagarna, A. Arcuri, and Y. Xin, "Estimation of distribution algorithms for testing object oriented software," in Evolutionary Computation, 2007. CEC 2007. IEEE Congress on, 2007, pp. 438-444.
  19. R. Sagarna and J. A. Lozano, "Scatter Search in software testing, comparison and collaboration with Estimation of Distribution Algorithms," European Journal of Operational Research, vol. 169, pp. 392-412, 2006.
  20. J. Staunton and J. Clark, "Applications of Model Reuse When Using Estimation of Distribution Algorithms to Test Concurrent Software," in Search Based Software Engineering. vol. 6956, M. Cohen and M. Ó Cinnéide, Eds., ed: Springer Berlin Heidelberg, 2011, pp. 97-111.
  21. C. Jin and S.-W. Jin, "Software reliability prediction model based on support vector regression with improved estimation of distribution algorithms," Applied Soft Computing, vol. 15, pp. 113-120, 2014.
  22. H. Mühlenbein and D. Schlierkamp-Voosen, "Predictive Models for the Breeder Genetic Algorithm I. Continuous Parameter Optimization," Evolutionary Computation, vol. 1, pp. 25-49, 1993.
  23. R.-Z. Qi, Z.-J. Wang, and S.-Y. Li, "A Parallel Genetic Algorithm Based on Spark for Pairwise Test Suite Generation," Journal of Computer Science and Technology, vol. 31, pp. 417-427, 2016.

Keywords

product line testing, pairwise testing, combinatorial testing, univariate marginal distribution algorithm, estimation of distribution algorithm