Automated Test Data Generation for Embedded System Models Using Combinatorial Testing
DOI:
https://doi.org/10.54654/isj.v3i17.890Keywords:
Embedded systems, model-based development, test cases generation, MC/DC coverage, MATLAB/Simulink, combinatorial testingTóm tắt
Abstract— Embedded systems have been playing very important roles in modern society. They have appeared in every aspect of life from automotive to avionics industries to home appliances, etc. These embedded systems therefore must satisfy high quality requirements. As a consequence, quality assurance for these kinds of systems has attracted much attention and investment from both academic research and industry communities. In developing embedded systems, testing often requires high coverage with different measures with respect to international standards like Decision Coverage (DC), Condition Coverage (CC), Modified Condition/Decision Coverage (MC/DC) respected to ISO 26262. However, it is difficult to generate test cases with high coverage due to the complexity of the embedded system, the larger number of inputs, and the complex continuous signals of inputs.
In order to have good test cases with high DC, CC, MC/DC coverage measures, this paper proposes a method to automatically generate test-cases by applying Combinatorial testing technique. The requirements of the inputs of the embedded model will be encoded to the input of Combinatorial testing technique in order to generate test cases that cover all pair values of any two inputs. Experiments on case studies showed that proposed method has coverage result better than that of the random testing method.
Downloads
References
] Combinatorial Testing: https://csrc.nist.gov/projects/automated-combinatorial-testing-for-software [Online; accessed 22-Nov-2022].
Dũng, N. Q., Hoàng, L. V., & Trung, N. H. (2020). Phát hiện mã độc IoT botnet dựa trên đồ thị PSI với mô hình Skip-gram. Journal of Science and Technology on Information Security, 7(1), 29-36. https://doi.org/10.54654/isj.v7i1.53.
Jacek Czerwonka. Pairwise Testing in the Real World. Practical Extensions to Test Case Generators. Microsoft Corporation, Software Testing Technical Articles. February 2008.
Godboley, S., Sridhar, A., Kharpuse, B., Mohapatra, D.P. and Majhi, B., Generation of branch coverage test data for simulink/stateflow models using crest tool. International Journal of Advanced Computer Research, 3(4), p.222, 2013.
Holling, D., Pretschner, A. and Gemmar, M. 8cage: lightweight fault-based test generation for simulink. In Proceedings of the 29th ACM/IEEE international conference on Automated software engineering (pp. 859-862), September 2014, ACM Press.
Kuhn, D. R., Raghu N.K., and Lei, Y., Introduction to combinatorial testing, CRC press, 2013.
Matinnejad, R., Nejati, S., Briand, L.C. and Bruckmann, T. Automated test suite generation for time-continuous simulink models. In Proceedings of the 38th international conference on software engineering (pp. 595-606), May 2016, ACM Press.
Matinnejad, R., Nejati, S., Briand, L. C., Bruckmann, T. SimCoTest : A test suite generation tool for Simulink/Stateflow controllers. In Proceedings of the 38th International Conference on Software Engineering Companion (pp. 585-588), May 2016, ACM Press.
Ngoc, D.T.B. Sinh Dữ Liệu Kiểm Thử Cho Mô Hình Hệ Thống Nhúng Sử Dụng Kỹ Thuật Kiểm Thử Theo Cặp, Journal of Science and Technology on Information and Communications. Vol 1 No 2 (2020).
Peranandam, P., Raviram, S., Satpathy, M., Yeolekar, A., Gadkari, A. and Ramesh, S. An integrated test generation tool for enhanced coverage of Simulink/Stateflow models. In Proceedings of the Conference on Design, Automation and Test in Europe (pp. 308-311). EDA Consortium, March 2012.
Mats G, and Jeff, O. Input parameter modeling for combination strategies. In Proceedings of the 25th conference on IASTED International MultiConference: Software Engineering, pp. 255–260, ACM Press 2017.
Simulink Design Verifier: https://www.mathworks.com/products/sldesignverifier.html [Online; accessed 28-July-2022].
Takashi, T., Daisuke, I., Toru, M., Shigeki, T., and Toshiaki, A. Template- Based Monte-Carlo Test Generation for Simulink Models. In IEICE TRANS. FUNDAMENTALS, VOL.E103–A, NO.2 FEBRUARY 2020. pp, 451-461.
Tran, H. T., Hoang, P. V., Do, T. N., & Nguyen, D. H. (2020). Hardware Trojan Detection Technique Using Frequency Characteristic Analysis of Path Delay in Application Specific Integrated Circuits. Journal of Science and Technology on Information Security, 10(2), 36-43. https://doi.org/10.54654/isj.v10i2.64.
Tzoref-Brill, R. Chapter Two - Advances in Combinatorial Testing. In series Advances in Computers, Volume 112, pp. 79-134, Elsevier 2019.
Downloads
Published
How to Cite
Issue
Section
License
Proposed Policy for Journals That Offer Open Access
Authors who publish with this journal agree to the following terms:
1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
Proposed Policy for Journals That Offer Delayed Open Access
Authors who publish with this journal agree to the following terms:
1. Authors retain copyright and grant the journal right of first publication, with the work [SPECIFY PERIOD OF TIME] after publication simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
