Automated Test Data Generation for Embedded System Models Using Combinatorial Testing

Authors

  • Do Thi Bich Ngoc

DOI:

https://doi.org/10.54654/isj.v3i17.890

Keywords:

Embedded systems, model-based development, test cases generation, MC/DC coverage, MATLAB/Simulink, combinatorial testing

Tóm tắt

Abstract— Embedded systems have been playing very important roles in modern society. They have appeared in every aspect of life from automotive to avionics industries to home appliances, etc. These embedded systems therefore must satisfy high quality requirements. As a consequence, quality assurance for these kinds of systems has attracted much attention and investment from both academic research and industry communities. In developing embedded systems, testing often requires high coverage with different measures with respect to international standards like Decision Coverage (DC), Condition Coverage (CC), Modified Condition/Decision Coverage (MC/DC) respected to ISO 26262. However, it is difficult to generate test cases with high coverage due to the complexity of the embedded system, the larger number of inputs, and the complex continuous signals of inputs.

In order to have good test cases with high DC, CC, MC/DC coverage measures, this paper proposes a method to automatically generate test-cases by applying Combinatorial testing technique. The requirements of the inputs of the embedded model will be encoded to the input of Combinatorial testing technique in order to generate test cases that cover all pair values of any two inputs. Experiments on case studies showed that proposed method has coverage result better than that of the random testing method.

Downloads

Download data is not yet available.

References

] Combinatorial Testing: https://csrc.nist.gov/projects/automated-combinatorial-testing-for-software [Online; accessed 22-Nov-2022].

Dũng, N. Q., Hoàng, L. V., & Trung, N. H. (2020). Phát hiện mã độc IoT botnet dựa trên đồ thị PSI với mô hình Skip-gram. Journal of Science and Technology on Information Security, 7(1), 29-36. https://doi.org/10.54654/isj.v7i1.53.

Jacek Czerwonka. Pairwise Testing in the Real World. Practical Extensions to Test Case Generators. Microsoft Corporation, Software Testing Technical Articles. February 2008.

Godboley, S., Sridhar, A., Kharpuse, B., Mohapatra, D.P. and Majhi, B., Generation of branch coverage test data for simulink/stateflow models using crest tool. International Journal of Advanced Computer Research, 3(4), p.222, 2013.

Holling, D., Pretschner, A. and Gemmar, M. 8cage: lightweight fault-based test generation for simulink. In Proceedings of the 29th ACM/IEEE international conference on Automated software engineering (pp. 859-862), September 2014, ACM Press.

Kuhn, D. R., Raghu N.K., and Lei, Y., Introduction to combinatorial testing, CRC press, 2013.

Matinnejad, R., Nejati, S., Briand, L.C. and Bruckmann, T. Automated test suite generation for time-continuous simulink models. In Proceedings of the 38th international conference on software engineering (pp. 595-606), May 2016, ACM Press.

Matinnejad, R., Nejati, S., Briand, L. C., Bruckmann, T. SimCoTest : A test suite generation tool for Simulink/Stateflow controllers. In Proceedings of the 38th International Conference on Software Engineering Companion (pp. 585-588), May 2016, ACM Press.

Ngoc, D.T.B. Sinh Dữ Liệu Kiểm Thử Cho Mô Hình Hệ Thống Nhúng Sử Dụng Kỹ Thuật Kiểm Thử Theo Cặp, Journal of Science and Technology on Information and Communications. Vol 1 No 2 (2020).

Peranandam, P., Raviram, S., Satpathy, M., Yeolekar, A., Gadkari, A. and Ramesh, S. An integrated test generation tool for enhanced coverage of Simulink/Stateflow models. In Proceedings of the Conference on Design, Automation and Test in Europe (pp. 308-311). EDA Consortium, March 2012.

Mats G, and Jeff, O. Input parameter modeling for combination strategies. In Proceedings of the 25th conference on IASTED International MultiConference: Software Engineering, pp. 255–260, ACM Press 2017.

Simulink Design Verifier: https://www.mathworks.com/products/sldesignverifier.html [Online; accessed 28-July-2022].

Takashi, T., Daisuke, I., Toru, M., Shigeki, T., and Toshiaki, A. Template- Based Monte-Carlo Test Generation for Simulink Models. In IEICE TRANS. FUNDAMENTALS, VOL.E103–A, NO.2 FEBRUARY 2020. pp, 451-461.

Tran, H. T., Hoang, P. V., Do, T. N., & Nguyen, D. H. (2020). Hardware Trojan Detection Technique Using Frequency Characteristic Analysis of Path Delay in Application Specific Integrated Circuits. Journal of Science and Technology on Information Security, 10(2), 36-43. https://doi.org/10.54654/isj.v10i2.64.

Tzoref-Brill, R. Chapter Two - Advances in Combinatorial Testing. In series Advances in Computers, Volume 112, pp. 79-134, Elsevier 2019.

Downloads

Abstract views: 60 / PDF downloads: 14

Published

2023-04-01

How to Cite

Ngoc, D. T. B. (2023). Automated Test Data Generation for Embedded System Models Using Combinatorial Testing. Journal of Science and Technology on Information Security, 3(17), 78-84. https://doi.org/10.54654/isj.v3i17.890

Issue

Section

Papers