Test Case Prioritization Approach for Sequence of Events Using Complexity Factor

Emyreema Ja’afar, Sa’adah Hassan, Salmi Baharom, Johanna Ahmad

Abstract


Test case prioritization (TCP) is a method to prioritize and schedule test cases. Some approaches have been introduced to minimize the time, cost, and effort for testing the software based on the test cases that are higher priority. Since the more complex the software program, the more intensive the test should be carried out. Thus, complexity is one of the factors that affect the effectiveness of the test case prioritization. However, the existing approaches for measuring complexity have some limitations. This is due to inaccuracy in finding the weightage value for complexity as the value is useful to determine the test case prioritization. Consequently, a complexity metric measurement is needed to determine the weightage value. Hence, this paper presents work on TCP using complexity factors to enhance the accuracy in prioritizing the test cases for event sequences. This work uses Branch Coverage Expectation (BCE) for complexity measurement, in which BCE has been proven its usefulness empirically in the previous research. The event-weightage value based on the complexity is then assigned and used to prioritize the test cases while the Average Percentage of Fault Detected (APFD) metric is used to evaluate the proposed approach. A tool has been developed to ease the process as well as to facilitate the evaluation purposes. The results show the need to combine the complexity factor with other factors to improve the proposed TCP's effectiveness.


Keywords


Test case prioritization; software testing; complexity measurement; branch coverage expectation; sequence of events.

Full Text:

PDF

References


G. Duggal and B. Suri, “Understanding Regression Testing Techniques,†COIT, 2008, India.

C. Catal and D. Mishra, “Test case prioritization: A systematic mapping study,†Software Quality Journal, vol. 21(3), pp.445–478, 2013.

H. Srikanth, M. Cashman, and M. B. Cohen, “Test case prioritization of build acceptance tests for an enterprise cloud application: An industrial case study,†J. Syst. Softw., vol. 119, pp. 122–135, 2016.

X. Zhang, X. Xie, and T. Y. Chen, “Test case prioritization using adaptive random sequence with category-partition-based distance,†2016 IEEE Int. Conf. Softw. Qual. Reliab. Secur., 2016, p. 374–385.

A. Marchetto, M. Islam, and W. Asghar, “A multi-objective technique to prioritize test cases,†IEEE Transactions, 42(10), pp. 918–940, 2016.

C. Y. Huang, J. R. Chang, and Y. H. Chang, “Design and analysis of GUI test-case prioritization using weight-based methods,†Journal of Systems and Software, vol. 83(4), pp.646–659, 2010.

J. Ahmad and S. Baharom, “Comparision of software complexity metrics in measuring the complexity of event sequences,†Information Science and Applications, vol. 424, 2017.

R. Krishnamoorthi and S. A. Sahaaya Arul Mary, “Factor oriented requirement coverage-based system test case prioritization of new and regression test cases,†Information and Software Technology, vol. 51(4), pp. 799–808, 2009.

A. K. Joseph, G. Radhamani, and V. Kallimani, “Improving Test Efficiency through Multiple Criteria Coverage based Test Case Prioritization using Modified Heuristic Algorithm,†in International Conference on Computer and Information Sciences, 2016, p. 430–435.

G. Chaurasia, S. Agarwal, and S. S. Gautam, “Clustering based novel test case prioritization technique,†2015 IEEE Students Conference on Engineering and Systems (SCES), 2015, pp.1–5.

R. Huang, J. Chen, D. Towey, A. T. S. Chan, and Y. Lu, “Aggregate-strength interaction test suite prioritization,†Journal of Systems and Software, 99, pp. 36–51, 2015.

S. Nayak, C. Kumar, and S. Tripathi, “Effectiveness of prioritization of test cases based on Faults,†2016 3rd International Conference on Recent Advances in Information Technology, 2016, p. 657–662.

C. Hettiarachchi, H. Do, and B. Choi, “Risk-based test case prioritization using a fuzzy expert system,†Information and Software Technology, vol. 69, pp. 1–15, 2016.

A. Marchetto, M. M. Islam, W. Asghar, A. Susi, and G. Scanniello, G, “A Multi-Objective Technique to Prioritize Test Cases,†IEEE Transactions on Software Engineering, 42(10), pp. 918–940, 2016.

K. H. Priyanka and N. Chauhan, “A Novel Approach for Selecting an Effective Regression Testing Technique,†2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom), IEEE, 2016, p.1122–1125.

T. B. Noor, and H. Hemmati, “A similarity-based approach for test case prioritization using historical failure data,†2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE), 2015, p. 58–68.

Y. Wang, X. Zhao, and X. Ding, “An effective test case prioritization method based on fault severity,†in 2015 6th IEEE International Conference on Software Engineering and Service Science (ICSESS), 23-25 Sept. 2015, p.737-741.

J. Ferrer, F. Chicano, and E. Alba, “Estimating software testing complexity,†Information and Software Technology, vol. 55(12), pp. 2125–2139, 2013.

J. Ferrer, “Optimization Techniques for Automated Software Test Data Generation,†PhD Thesis, University of Malaga, 2016.

S. Baharom and Z. Shukur, “The conceptual design of module documentation-based testing tool,†Journal of Computer Science, vol. 4 (6), pp.454-462, 2008.

S. Elbaum, A. Malishevsky, and G. Rothermel, “Prioritizing test cases for regression testing,†in Proc. lnt'l. Symp. Softw. Testing and Analysis, Aug. 2000, p. 102-112.

A. Ansari, A. Khan, A. Khan, and K. Mukadam, “Optimized regression test using test case prioritization,†Procedia Comput. Sci., vol. 79, pp. 152–160, 2016.

P. Mahapatra and S. Tripathy, “Code based test case prioritization using APFD metric,†Global J. of Mech., Eng. & Comp. Sciences, vol.3(2), pp.3-5, 2013.

Y. Jia and M. Harman, “An Analysis and Survey of the Development of Mutation Testing,†IEEE Transactions on Software Engineering, vol. 7, no. 2, pp.77-84, 2006.

I. Moore, (2001). “Jester and Pester,†http://jester.sourceforge.net/




DOI: http://dx.doi.org/10.18517/ijaseit.10.2.10171

Refbacks

  • There are currently no refbacks.



Published by INSIGHT - Indonesian Society for Knowledge and Human Development