Professionals in the world of e-business need a reliable way of gauging the risks associated with new endeavours. This hands-on guide presents an effective approach to using risk to conduct test strategies. It helps professionals understand the risks of e-business and conduct risk analysis that identifies the areas of most concern. The book provides the know-how to prepare a test strategy based on early risk analysis and to construct the detailed test process that meets the needs of management. Using a technique called Failure Mode and Effect Analysis (FMEA), the book shows how to use risk-based methodologies in e-business development, especially when developing novel applications using new technologies. This guide should be of interest to: e-business developers, managers and technical staff; software testers; and test and product managers.
Author(s): Paul Gerrard, Neil Thompson
Edition: 1st
Year: 2002
Language: English
Pages: 430
Contents vii......Page 7
Preface xix......Page 19
Structure xxi......Page 21
References xxv......Page 25
Acknowledgments xxvii......Page 27
Risky Project Foundations 3......Page 31
What Is Risk? 11......Page 39
The Definition of Risk 12......Page 40
Product Risk and Testing 16......Page 44
References 19......Page 47
2 Risk Management and Testing 21......Page 49
Risk Workshops 2......Page 50
Risk Identification 23......Page 51
Risk Analysis 25......Page 53
Risk Response Planning 31......Page 59
Summary of Testing’s Risk Management Role 34......Page 62
References 35......Page 63
3 Risk: A Better Language for Software Testing 37......Page 65
Difficult Questions for Testers 38......Page 66
How Much Testing Is Enough (To Plan)? 39......Page 67
When Should We Stop Testing? 42......Page 70
When Is the Product Good Enough? 43......Page 71
The Classic Squeeze on Testing 47......Page 75
A Definition of Good Testing 49......Page 77
References 50......Page 78
4 Risk-Based Test Strategy 51......Page 79
From Risks to Test Objectives 52......Page 80
Master Test Planning 60......Page 88
Method Guidance 70......Page 98
Risk- and Benefit–Based Test Reporting 76......Page 104
References 80......Page 108
E-Business, E-Commerce, and Everything E 85......Page 113
Web Time and Other Challenges to Testers 90......Page 118
References 92......Page 120
6 Types of Web Site Failures 93......Page 121
Web Site As Retail Store 94......Page 122
Many of the Risks Are Outside Your Control 96......Page 124
The Sequence of Points of Failure in a Web Service 102......Page 130
Specialized Knowledge and E-Business Testing Techniques 105......Page 133
Testing Considerations 106......Page 134
Using a Test Process Framework to Build Your Test Strategy 110......Page 138
References 116......Page 144
Many Focused Stages or Bigger, Broader Test Stages? 119......Page 147
Know Your Users 121......Page 149
Build-and-Integration Strategies—an Example 123......Page 151
Automated Regression Testing 126......Page 154
Further Thoughts on Tools 127......Page 155
Reference 128......Page 156
Content Checking 131......Page 159
HTML Validation 134......Page 162
Browser Syntax Compatibility Checking 140......Page 168
Visual Browser Validation 141......Page 169
Tools for Static Testing 144......Page 172
References 145......Page 173
Overview 147......Page 175
Link Checking 149......Page 177
Object Load and Timing 156......Page 184
Transaction Verification 158......Page 186
Tools for Web Page Integration Testing 163......Page 191
References 164......Page 192
Overview 165......Page 193
Browser Page Testing 173......Page 201
Server-Based Component Testing 175......Page 203
Transaction Link Testing 177......Page 205
Application System Testing 179......Page 207
Context Testing 182......Page 210
Localization Testing 185......Page 213
Configuration Testing 186......Page 214
Tools for Functional Testing 189......Page 217
References 190......Page 218
Overview 191......Page 219
What Is Performance Testing? 195......Page 223
Prerequisites for Performance Testing 199......Page 227
Performance Requirements 202......Page 230
The Performance Test Process 206......Page 234
Performance Testing Practicalities 210......Page 238
Reliability/Failover Testing 217......Page 245
Service Management Testing 221......Page 249
Tools for Service Testing 223......Page 251
References 225......Page 253
Overview 227......Page 255
Collaborative Usability Inspection 232......Page 260
Usability Testing 238......Page 266
Web Accessibility Checking 241......Page 269
Tools for Assessing Web Page Accessibility 243......Page 271
References 244......Page 272
Overview 245......Page 273
Security Assessment 253......Page 281
Penetration Testing 256......Page 284
Tools for Security Testing 260......Page 288
References 261......Page 289
Further Reading 262......Page 290
Overview 263......Page 291
Integration Analysis 267......Page 295
SIT 275......Page 303
BIT 276......Page 304
Challenges 278......Page 306
References 280......Page 308
16 Postdeployment Monitoring 281......Page 309
Types of Monitoring 282......Page 310
Security Monitoring 285......Page 313
Remote Monitoring Services and Tool Web Sites 287......Page 315
17 Tools for E-Business Testing 291......Page 319
Proprietary Test Execution Tools 292......Page 320
How Test Execution Tools Work 295......Page 323
Proprietary, Shareware, and Freeware Tools 301......Page 329
Sources of Tool Information 304......Page 332
Further Reading 305......Page 333
Part IV: Making E-Business Testing Happen 307......Page 335
18 The Context of E-Business Testing 309......Page 337
Methods and Requirements Formats 310......Page 338
Architectures, Objects, Components, and Middleware 315......Page 343
Coping with Iterative and Incremental Methods 316......Page 344
References 319......Page 347
19 E-Business Test Organization, Planning, and Specification 321......Page 349
Testing’s Place in the Project 322......Page 350
Organization and Control 323......Page 351
Credibility of Testing 325......Page 353
Explaining Testing to Other Managers 327......Page 355
Estimation in a Vacuum 328......Page 356
Inversion of the Tester’s Role 332......Page 360
Testing Stages, Teams, and Environments 333......Page 361
Getting, Organizing, and Keeping Resources 334......Page 362
Specifying Tests 339......Page 367
Stage-Specific Considerations 342......Page 370
References 345......Page 373
20 E-Business Test Execution 347......Page 375
Incident Management 349......Page 377
Testing in a Live Environment 351......Page 379
Managing the End Game 353......Page 381
Further Reading 354......Page 382
Appendix A: Essential Web Technologies for Testers 355......Page 383
Using Dummy HTML Forms to Test Components 359......Page 387
Using Test Drivers to Test Components 361......Page 389
The Simplest of Test Drivers 363......Page 391
Further Reading 367......Page 395
List of Acronyms and Abbreviations 369......Page 397
Glossary 373......Page 401
About the Authors 385......Page 413
Index 387......Page 415
