Testing Software and Systems: 35th IFIP WG 6.1 International Conference, ICTSS 2023, Bergamo, Italy, September 18–20, 2023, Proceedings

Preface
Organization
Failure Analysis in CPS Simulink Models (Keynotes)
Contents
Test Case Generation
A Rapid Review on Fuzz Security Testing for Software Protocol Implementations
1 Introduction
2 Related Works
3 Rapid Review
3.1 Research Questions
3.2 Data Source and Search Strategy
3.3 Analysis Criteria
3.4 Limitations of the Study
4 Results
5 Final Remarks
References
Enhancing Synthetic Test Data Generation with Language Models Using a More Expressive Domain-Specific Language
1 Introduction
2 Case Study
2.1 Abstract Data Model
2.2 Conceptual Model of Event Generator and Event Specification
3 Domain Specific Language Design and Comparison
3.1 Domain Specific Formal Language - Steve132
3.2 Domain Specifical Language - Steveflex
3.3 Historical Dimension in Expressiveness
3.4 Higher Information Capacity
4 Evaluation Framework
5 Experiment, Result and Comparison
5.1 Result and Comparison
5.2 Experimental Setup
6 Related Work
7 Conclusion
A Steve132 constraints
B Steveflex constraints
References
On the Evaluation of Photometric Stereo Applications Testing Using Image Modifications
1 Introduction
2 The System Under Test
3 Experiments
4 Conclusions
References
Seeding Contradiction: A Fast Method for Generating Full-Coverage Test Suites
1 Overview
2 The Method
2.1 Falsifying a Code Block
2.2 Block Variables
3 Correctness
3.1 Definitions and Assumptions
3.2 Proof of Correctness
3.3 Correctness in Practice
4 Implementation
5 Evaluation and Comparison with Dynamic Techniques
5.1 Comparison Criteria and Overview of the Results
5.2 Detailed Results
6 Limitations and Threats to Validity
7 Related Work
8 Conclusions and Future Work
References
Test Automation and Design
Automated Testing of Systems of Systems
1 Introduction
2 Related Work
3 The Approach and Implementation
4 Motivating Example from the Industry
5 Conclusion and Future Work
References
Empirical Verification of TQED - A New Test Design Heuristic Technique
1 Introduction
2 TQED and Effectiveness of Test Design Techniques
3 TQED Model
4 Experiment
5 Conclusions
References
How Do Different Types of Testing Goals Affect Test Case Design?
1 Introduction
2 Background
3 Related Work
4 Methodology
4.1 Population and Sampling
4.2 Data Collection
4.3 Data Analysis
5 Results and Discussion
5.1 Goals and Goal Importance
5.2 Quantitative Relationship Between Goal Types and Tests
5.3 Influence of Goals on Test Design
6 Threats to Validity
7 Conclusion
References
Multi-device, Robust, and Integrated Android GUI Testing: A Conceptual Framework
1 Introduction
2 Mobile GUI Testing: State of the Art and Practice
3 Conceptualization of the GEM Framework
3.1 Test Generation and Translation
3.2 Test Execution
3.3 Test Maintenance and Repair
4 Discussion
5 Call to Action
6 Conclusions
References
RQCODE: Security Requirements Formalization with Testing
1 Introduction
1.1 Importance of Security by Design
1.2 Importance of Security Testing
2 Related Work
3 The ReQuirements as CODE Approach (RQCODE)
3.1 RQCODE Definition and Concepts
3.2 RQCODE Example
3.3 Use Case of Security Technology Implementation Guide
4 Discussion
4.1 Background Needed
4.2 Security Testing
5 Conclusion and Future Work
References
Understanding Problem Solving in Software Testing: An Exploration of Tester Routines and Behavior
1 Introduction
2 Background and Related Work
3 Method
3.1 Survey Development
3.2 Survey Population and Sampling
3.3 Thematic Analysis
4 Results and Discussions
4.1 Survey Results
4.2 The Extended Problem Solving Model
5 Discussion
5.1 Threats to Validity
6 Conclusions
References
Who Is Afraid of Test Smells? Assessing Technical Debt from Developer Actions
1 Introduction
2 Related Work
3 Methodology
3.1 The Evaluation Context
3.2 Mean Time to Removal
3.3 Data Collection
3.4 Data Analysis
4 Results and Discussion
4.1 Under-Represented Test Smells
4.2 Rapidly Removed Test Smells
4.3 Slowly Removed Test Smells
4.4 Mid Range Test Smells
5 Threats to Validity
6 Conclusions and Future Work
References
Model Based Testing
A Systematic Literature Review on Prioritizing Software Test Cases Using Markov Chains
1 Extended Abstract
References
Complete Property-Oriented Module Testing
1 Introduction
2 Theoretical Foundations
2.1 Black Box Checking
2.2 Equivalence Class Construction for SFSM
3 Optimisation of the Test Method
4 Tool Support: libfsmtest and libsfsmtest
5 Experiments
6 Conclusion
References
Compositionality in Model-Based Testing
1 Introduction
2 Preliminaries
3 Motivating Example: A Parking System
4 Mutual Acceptance
5 Compositionalility for Uioco
6 The Parking System Revisited
7 Component Substitution and Diagnosis
8 Related Work
9 Future Work
10 Conclusion
References
Prioritizing Test Cases with Markov Chains: A Preliminary Investigation
1 Introduction
2 Related Work
3 Background
3.1 Test Case Prioritization
3.2 Markov Chains
4 Markov Chains Applied in TCP
5 Experimental Analysis
5.1 Metrics Definition
5.2 Description of Case Studies
5.3 Results and Analysis
6 Discussion and Conclusion
References
Probabilistic Approach for Minimizing Checking Sequences for Non-deterministic FSMs
1 Introduction
2 Preliminaries
3 Non-initialized Probabilistic FSMs
4 Minimizing a Checking Sequence with a Level of P-Exhaustiveness
5 Conclusion
References
AI and Smart Contracts Testing
Applying Pairwise Combinatorial Testing to Large Language Model Testing
1 Introduction
2 Related Work
3 Instantiating the Combinatorial Testing Process for Testing of LLMs
3.1 A Combinatorial Sentence Model via an IPM
3.2 Generation of t-Way Sentence Test Sets
3.3 Sentence Test Set Translation and Execution
3.4 Test Oracle
4 Outline of Experimental Evaluation
5 Lessons Learned and Threats to Validity
6 Summary and Future Work
References
CATANA: Replay Testing for the Ethereum Blockchain
1 Introduction
2 Background
3 Methodology
4 Experimental Evaluation
5 Related Work
6 Conclusions and Future Work
References
GResilience: Trading Off Between the Greenness and the Resilience of Collaborative AI Systems*-1pc
1 Introduction
2 Related Work
3 Approach - GResilience
4 Conclusion and Future Work
References
Testing Quality of Training in QoE-Aware SFC Orchestration Based on DRL Approach*-1pc
1 Introduction
2 Reinforcement Learning
2.1 RL Agent
2.2 Training (Learning), Testing and Evaluation in RL
2.3 Convergence-Performance Trade-Off in Training RL Algorithms
3 DRL Implementation via Double DQN
3.1 DQN
3.2 Double DQN
4 DRL Approach for SFC Orchestration in SDN/NFV Environments
4.1 SFC Orchestration
4.2 SFC Orchestration Based on DRL Approach
4.3 Reward Design
5 Simulation Results
6 Conclusion
References
Author Index