Constructing Cost-Aware Functional Test-Suites Using Nested Differential Evolution Algorithm

Authors

Yuexing Wang, Tsinghua UniversityFollow
Min Zhou, Tsinghua UniversityFollow
Xiaoyu Song, Portland State UniversityFollow
Ming Gu, Tsinghua University
Jiaguang Sun, Tsinghua UniversityFollow

Sponsor

This research is sponsored in part by NSFC Program (No. 91218302, No. 61527812, 61402248), National Science and Technology Major Project (No. 2016ZX01038101), MIIT IT funds (Research and application of TCN key technologies ) of China, and The National Key Technology R&D Program (No. 2015BAG14B01-02).

Published In

IEEE Transactions on Evolutionary Computation

Document Type

Citation

Publication Date

8-2017

Abstract

Combinatorial testing can test software that has various configurations for multiple parameters efficiently. This method is based on a set of test cases that guarantee a certain level of interaction among parameters. Mixed covering array can be used to represent a test-suite. Each row of the array corresponds to a test case.

In general, a smaller size of mixed covering array does not necessarily imply less testing time. There are certain combinations of parameter values which would take much longer time than other cases. Based on this observation, it is more valuable to construct mixed covering arrays that are better in terms of testing effort characterization other than size. We present a method to find cost-aware mixed covering arrays. The method contains two steps. First, simulated annealing algorithm is used to get a mixed covering array with a small size. Then we propose a novel nested differential evolution algorithm to improve the solution with its testing effort. The experimental results indicate that our method succeeds in constructing cost-aware mixed covering arrays for real-world applications. The testing effort is significantly reduced compared with representative state-of-the-art algorithms.

Description

©2017 IEEE

Locate the Document

https://doi.org/10.1109/TEVC.2017.2747638

DOI

10.1109/TEVC.2017.2747638

Persistent Identifier

https://archives.pdx.edu/ds/psu/30645

Citation Details

Wang, Y., Zhou, M., Song, X., Gu, M., & Sun, J. (2017). Constructing Cost-Aware Functional Test-Suites Using Nested Differential Evolution Algorithm. IEEE Transactions on Evolutionary Computation, 22(3), 334-346.