A Friendly Introduction to Software Testing

Introduction
The Story So Far
Testing and Quality Assurance
What This Book Covers
What This Book Does Not Cover
A Note on Language Choice
What is Software Testing?
A Definition of Software Testing
Verification and Validation
A Preliminary Definition of Defect
A Real-Life Testing Example
Why Test Software?
To Test Or Not To Test
No Software Developer is Perfect
Catching Defects Sooner Rather than Later
Stability
Customer Advocacy
An Independent, Whole-System Perspective
Ensuring Quality
Risk
Testing Basics
Equivalence Classes and Behavior
Interior and Boundary Values
Base Cases, Edge Cases, Corner Cases
Success Cases and Failure Cases
Black-, White-, and Grey-Box Testing
Static and Dynamic Testing
Requirements
Testability
Functional versus Non-Functional
A Note on Naming Requirements
Test Plans
The Basic Layout of a Test Plan
Developing a Test Plan
Test Fixtures
Executing a Test Plan
Test Run Tracking
Traceability Matrices
Breaking Software
Errors To Look For
The List Goes On and On
A Test Plan Walkthrough
Examining The Requirements
Plotting Out the Test Plan
Filling Out the Test Plan
Determining Focus
Test Cases for a Non-Functional Requirement
Defects
What is a Defect?
The Defect Life Cycle
A Standardized Defect Template
Exceptions to the Template
Defect Examples
Smoke And Acceptance Testing
Smoke Testing
Acceptance Testing
Exploratory Testing
Benefits and Drawbacks of Exploratory Testing
Guidelines for Exploratory Testing
Manual versus Automated Testing
Benefits and Drawbacks of Manual Testing
Benefits and Drawbacks of Automated Testing
The Real World
An Introduction to Unit Testing
Unit Tests: The Very Idea
An Example in Natural Language
Turning Our Example Into a Unit Test
Problems With Unit Testing
Creating a Test Runner
Advanced Unit Testing
Test Doubles
Stubs
Mocks and Verification
Fakes
Setup and Teardown
Testing System Output
Testing Private Methods
Unit Test Structure
Code Coverage
Test-Driven Development
What is TDD?
The Red-Green-Refactor Loop
Principles of Test-Driven Development
Example: Building FizzBuzz via TDD
Benefits of TDD
Drawbacks of TDD
Writing Testable Code
What Do We Mean By Testable Code?
The Basic Strategies for Testable Code
Provide a Scriptable Interface
Write Tests Up-Front
DRYing Up Code
Dependency Injection
TUFs and TUCs
Dealing with Legacy Code
Final Thoughts On Writing Testable Code
Pairwise and Combinatorial Testing
Permutations and Combinations
Pairwise Testing
n-Way Interactions
Working with Larger Variable Sets
Stochastic and Property-Based Testing
Infinite Monkeys and Infinite Typewriters
Property-Based Testing
Smart, Dumb, Evil, and Chaos Monkeys
Mutation Testing
Performance Testing
Categories of Performance Indicators
Testing Performance: Thresholds and Targets
Key Performance Indicators
Testing Service-Oriented Indicators: Response Time
Testing Service-Oriented Indicators: Availability
Testing Efficiency-Oriented Indicators: Throughput
Testing Efficiency-Oriented Indicators: Utilization
General Tips and Advice When Performance Testing
Security Testing
Challenges in Security Testing
Basic Concepts in Computer Security
Common Attacks and How to Test Against Them
Penetration Testing
General Guidelines
Interacting with Stakeholders
Who and What are Stakeholders?
Reporting and Communicating
The Red-Yellow-Green Template
Status Reports
A Note on Managing Expectations
A Note on Meetings
Clarifying Requirements
Ethical Obligations
Respect
Conclusion
Testing Templates
Test Case Template
Defect Reporting Template
Red-Yellow-Green Template
Daily Status Report
Using Reflection to Test Private Methods in Java
Further Reading
Glossary of Terms
Acknowledgments