Optimize Quality for Business Outcomes: A Practical Approach to Software Testing, 3rd Edition |
|
|
|
|
| Andreas Golze, Mark Sarbiewski, Alain Zahm |
| June 2008, Wiley, Paperback, 304 pages, ISBN 0470404663
|
|
|
|
 |
|
| Published in partnership with HP, this guide shares more than 20 years of software testing wisdom from both HP consultants and customers aimed at improving performance measurement. YouA€™ll learn from the experts how to move through software development and testing processes in the most effective, cost-efficient way as you examine fundamental questions around testing from a business perspective: what to test and how to assure that testing has accomplished its objective, the various behavioral modeling methods, using key performance indicators, and more. |
 |
|
Acknowledgements vii
Introduction ix
What Is the Big Deal About Testing? 1
Quality Goals and Test Phases 11
Requirements Verification 14
Unit Test 15
Integration Test 15
System Test 15
Performance Test 15
User Acceptance Test 16
Operational Readiness Test 16
Case Study: Flight Application 17
Requirements Verification 18
Unit Test 19
Integration Test 20
System Test 22
Performance Test 23
User Acceptance Test 24
Operational Readiness Test 24
Test Concepts and Techniques 25
White-Box Testing 25
Black-Box Testing 26
Wrapping Up 27
Testing the Business Requirements: Start at the Root of the Problem 29
Build a Common Reference 32
Document the Separate Business Functions 34
Link Requirements into the Structure 35
Define Proof Points 36
Test Rules: Build the Backbone for Effective Testing 41
Equivalence Partitioning with Root Cause Analysis 43
Test Cases: Let's Get Down to the Real Stuff 61
Select a Test Rule 64
Specifying Master Data 67
Take Data from Production 70
Build Data Using the Existing Application 72
Generate Data from Scratch 73
Finalize the Test Case Description 74
Test Scenarios 77
Test Execution 78
Test Optimization: Balancing Risk and Effort 83
Risk Assessment 85
Business Impact Analysis 87
Failure Probability 88
Derive Business Risk 89
Test Procedure Definition 90
Functional Complexity 91
Test Effort Estimation 93
How to Calculate the Optimal Level of Automation 98
Test Effort Optimization 103
Improving Test Automation and Manual Testing 103
Improving Regression Test Efficiency 111
Why Bother with Non-Functional Testing? 113
Non-Functional Scope 114
Performance 115
Load 115
Availability 116
Reliability 116
Consider Non-Functional Testing at the Business Level 117
Performance Testing 120
Defining Performance Requirements 121
Performance Breakdown 122
Performance Instrumentation 125
Performance Test Execution 126
Performance Test Analysis 126
Performance Enhancements 127
Load Testing 128
Stability 130
Load Support 131
Scalability 133
Sustainability 135
Overload 136
Availability Testing 137
Expressing Availability 137
Turning Availability Rate into Concrete Terms 139
High Availability Testing 142
Reliability Testing 143
Reliability Requirements 145
Reliability Testing 147
Non-Functional Testing Critical for Success 147
Application Security Testing: The Next Frontier 149
Understanding the Application Security Problem 150
The Technical Problem 151
The Lifecycle Problem 158
The Business Problem 160
The Solution 164
Enterprise Security Strategy and Policies 164
Process and Practices 166
Education and Training 172
Key Stakeholders 172
Technology 173
Static Analysis (aka Source Code Analysis) 174
Dynamic Analysis (aka Black-Box Testing) 174
Hybrid Analysis 174
Secure Code Libraries 175
Continuously Updated Security Knowledge-Bases 175
So Where Does That Leave Us? 177
Test Sourcing: How Outsourcing Improves Cost Effective Testing 179
Why - and How - Does Outsourcing Work in Other Industries? 180
Successful IT Outsourcing 183
Test Rule Definition 184
Test Data Specification 185
Data Load Procedures 185
Test Script Development 185
Compare Utility Development 186
Automated Test Evaluation 186
Manual Test Execution 186
Test Evaluation 186
Successful Goal-Driven KPI Approach 191
Set Business Goals 196
Understand the Impact of Each Department on Business Goals 198
Choose Supporting Business Processes 199
Create Business Process Goals 200
Examine What to Measure 201
Standardize Measurements Across Departments 204
Scope Data Source and Integration Needs 206
Formalize Indicators and Thresholds 206
Utilize and Execute Appropriate Action Plans 209
Lay the Groundwork and Baseline 210
Getting Started: Putting It All Together 213
Quality Agnostic 216
Quality Initializing 217
Process Characteristics 217
Product Characteristics 218
People Characteristics 218
Quality Conscious 219
Process Characteristics 220
Product Characteristics 221
People Characteristics 222
Quality Savvy 223
Process Characteristics 224
Product Characteristics 225
People Characteristics 225
Quality Expert 226
Process Characteristics 227
Product Characteristics 227
People Characteristics 228
Self Evaluation - Designing a Roadmap 228
Common Test Techniques 231
White-Box Testing Techniques 231
Syntax Testing 231
Statement Testing 233
Branch/Decision Testing 233
Data Flow Testing 233
Branch Condition Testing 234
Branch Condition Combination Testing 235
Modified Condition Decision Testing 235
Static Analysis (aka Source Code Analysis) 236
Black-Box Testing Techniques 237
Smoke Test 237
Equivalence Partitioning 237
Boundary Value Analysis 238
User Input Validation 239
Dynamic Analysis (aka Black-Box Security Testing) 239
Hybrid Analysis 240
HP Application Quality Management Solutions Introduction and Overview 243
HP Quality Center 243
HP Performance Center Suite 246
HP Application Security Center 247
Verification 249
Introduction 249
Steps 252
Planning 252
Kickoff 254
Individual Review 255
Collation 257
Discussion 258
Defect Logging 261
Revision, Confirmation 261
Final Report 262
Naming Conventions 263
Numbering of Test Cases 263
Numbering of Expected Results 263
References 265
Glossary 271
|
|
|
