Improving the Test Process: Implementing Improvement and Change - A Study Guide for the ISTQB Expert Level Module

Table of Contents

Front Cover
Half Title
Title Page
Copyright
Contents
Preface
Acknowledgements
1 Introduction
1.1 About the Authors
1.1.1 Erik van Veenendaal
1.1.2 Graham Bath
1.2 Purpose of the Book
1.3 What Is an Expert?
1.4 Expectations and Business Outcomes
1.5 Career Paths for Testers
1.6 Syllabus Parts
1.7 The Certification Exam
1.8 Certification
2 The Context of Improvement
2.1 Why Improve Testing?
2.2 What Can Be Improved?
2.3 Views on Quality
2.4 The Generic Improvement Process
2.4.1 The Deming Cycle
2.4.2 The IDEAL Improvement Framework
2.4.3 Fundamental Concepts of Excellence
2.5 Overview of Improvement Approaches
2.5.1 Overview of Model-Based Approaches
2.5.2 Overview of Analytical Approaches
2.5.3 Hybrid Approaches
2.5.4 Other Approaches to Improving the Test Process
2.6 Exercises
3 Model-Based Improvement
3.1 Introduction to Test Process Improvement Models
3.1.1 Desirable Characteristics of Test Process Improvement Models
3.1.2 Using Models: Benefits and Risks
3.1.3 Categories of Models
3.2 Software Process Improvement (SPI) Models
3.2.1 Capability Maturity Model Integration (CMMI)
3.2.2 ISO/IEC 15504
3.2.3 Comparing CMMI and ISO/IEC 15504
3.3 Test Process Improvement Models
3.3.1 The Test Process Improvement Model (TPI NEXT)
3.3.2 Test Maturity Model integration (TMMi)
3.3.3 Comparing TPI NEXT to TMMi
3.3.4 Systematic Test and Evaluation Process (STEP)
3.3.5 Critical Testing Processes (CTP)
3.4 Comparing Process Models and Content Models
3.5 Suitability of SPI Models and Test Process Improvement Models
3.6 Exercises
4 Analytical-Based Improvement
4.1 Introduction
4.2 Causal Analysis
4.2.1 Selecting Items for Causal Analysis
4.2.2 Gathering and Organizing the Information
4.2.3 Identifying Root Causes
4.2.4 Drawing Conclusions
4.2.5 Causal Analysis with System Diagrams
4.2.6 Causal Analysis during Formal Reviews
4.2.7 Causal Analysis Lessons Learned
4.3 GQM Approach
4.3.1 Introduction
4.3.2 Paradigms
4.3.3 GQM Process
4.3.4 Supporting Tools and Techniques
4.3.5 Bottom-Up Improvement
4.4 Analysis Using Measures, Metrics, and Indicators
4.4.1 Test Effectiveness Metrics
4.4.2 Test Efficiency / Cost Metrics
4.4.3 Lead-Time Metrics
4.4.4 Predictability Metrics
4.4.5 Product Quality Metrics
4.4.6 Test Maturity Metrics
4.5 Exercises
5 Selecting Improvement Approaches
5.1 Selecting Test Process Improvement Approaches
5.2 Process Models
5.3 Content Models
5.4 Analytical Approaches
5.5 Mixed Approaches
5.6 Analytical Approaches and Improvement Models
5.6.1 Analytical-Based Improvement with CMMI
5.6.2 Analytical-Based Improvement with TPI NEXT
5.6.3 Analytical-Based Improvement with TMMi
5.6.4 Analytical-Based Improvement with CTP and STEP
5.7 Exercises
6 Process for Improvement
6.1 Introduction
6.1.1 IDEAL Process Improvement Framework
6.1.2 Test Policy
6.2 Initiating the Improvement Process
6.2.1 Identify Stimulus for Change
6.2.2 Set Objectives for Test Improvement
6.2.3 Set Context
6.2.4 Build Sponsorship
6.2.5 Charter Infrastructure
6.3 Diagnosing the Current Situation
6.3.1 Planning the Assessment
6.3.2 Assessment Preparation
6.3.3 Performing Interviews
6.3.4 Giving Feedback
6.3.5 Analyzing Results
6.3.6 Performing Solution Analysis
6.3.7 Recommending Improvement Actions
6.4 Establishing a Test Improvement Plan
6.4.1 Set Priorities
6.4.2 Develop an Implementation Approach
6.4.3 Planning the Improvements
6.5 Acting to Implement Improvement
6.5.1 Selecting and Executing a Pilot
6.5.2 Manage and Control the Implementation
6.6 Learning from the Improvement Program
6.7 Exercises
7 Organization, Roles, and Skills
7.1 Organization
7.1.1 The Test Process Group (TPG)
7.1.2 Test Improvement with Remote, Offshore, and Outsourced Teams
7.2 Individual Roles and Staffing
7.2.1 The Test Process Improver
7.2.2 The Lead Assessor
7.2.3 The Co-Assessor
7.3 Skills of the Test Process Improver/Assessor
7.3.1 Interviewing Skills
7.3.2 Listening Skills
7.3.3 Presentation and Reporting Skills
7.3.4 Analytical Skills
7.3.5 Note-Taking Skills
7.3.6 Skills of Persuasion
7.3.7 Management Skills
7.3.8 Summary
7.4 Exercises
8 Managing Change
8.1 Introduction
8.2 Overview
8.2.1 The Fundamental Change Process
8.2.2 The Satir Model
8.2.3 Tipping Points and Change
8.3 Prepare for Change
8.3.1 Establish the Need for Improvement
8.3.2 Create a Sense of Urgency
8.3.3 Establish the Improvement Team
8.4 Decide What to Change
8.4.1 Establish a Vision of the Future
8.4.2 Set Specific Objectives and Align to Business Goals
8.4.3 Decide on an Implementation Strategy
8.4.4 Balance Short-Term and Longer-Term Benefits
8.5 Making Change Happen
8.5.1 Communicating for Buy-In and Understanding
8.5.2 Anticipating Chaos
8.5.3 Managing the Chaos
8.5.4 Handling Resistance to Change
8.5.5 Climbing Out of Chaos: Developing Transforming Ideas
8.6 Making Change Stick
8.6.1 Rollout of New Ideas and Practices
8.6.2 Provide Lasting Support
8.6.3 Create a New Culture of Improvement
8.6.4 Practice Continuous Improvement Principles
8.7 Data Privacy
8.8 Exercises
9 Critical Success Factors
9.1 Critical Success Factors
9.1.1 Getting Started
9.1.2 Getting the Job Done
9.1.3 Critical Success Factors: A Case Study
9.2 Setting a Culture for Improvement
9.2.1 Defining “Improvement Culture”
9.2.2 Aspects of Improvement Culture
9.2.3 Test Process Improvement Manifesto
9.3 Exercises
10 Adapting to Different Life Cycle Models
10.1 Test Process Improvement with Different Life Cycles
10.2 Exercises
Appendix A: Glossary
Appendix B: Literature and References
B.1 Books/Journals
B.2 ISTQB Publications
B.3 Standards
B.4 Web References
Appendix C: The Syllabus Parts
Appendix D: The Exam
D.1 General Exam Aspects
D.2 Part 1 Exam: “Assessing Test Processes”
D.3 Part 2 Exam: “Implementing Test Process Improvement”
D.4 Tips
D.5 Common Problems
Appendix E: Summary of Cognitive Levels (K-Levels)
Appendix F: Answers
Index