Test metrics and KPIs in Testing Fundamentals - Cheat Sheet & Quick Revision

Recall & Review

beginner

What are test metrics in software testing?

Test metrics are measurements used to assess the quality, progress, and effectiveness of testing activities. They help teams understand how well testing is going and where improvements are needed.

beginner

Define KPIs in the context of software testing.

KPIs (Key Performance Indicators) are specific, important metrics chosen to track the success of testing efforts against goals. They focus on critical areas like defect detection rate or test coverage.

beginner

Why is test coverage an important test metric?

Test coverage shows how much of the software's code or features have been tested. It helps ensure that important parts are not missed and reduces the risk of hidden bugs.

intermediate

Explain the difference between defect density and defect leakage.

Defect density measures the number of defects found per size of the software (like per 1000 lines of code). Defect leakage is the number of defects that escape testing and are found later by users.

intermediate

How can test metrics improve the testing process?

By tracking metrics, teams can spot problems early, measure progress, and make informed decisions to improve test planning, execution, and quality.

Which of the following is a Key Performance Indicator (KPI) in testing?

A Number of test cases executed

B Number of meetings held

C Defect detection percentage

D Lines of code written

Defect detection percentage is a KPI because it measures how effectively defects are found during testing.

What does test coverage measure?

A The number of defects fixed

B The number of testers on the team

C The time taken to write test cases

D The percentage of code or features tested

Test coverage measures how much of the software's code or features have been tested.

Defect leakage refers to:

A Defects found after release by users

B Defects found during testing

C Defects fixed by developers

D Defects ignored by testers

Defect leakage means defects that were missed during testing and found later by users.

Why are test metrics important?

A To measure and improve testing effectiveness

B To replace manual testing

C To increase the number of test cases

D To reduce the number of testers

Test metrics help measure progress and improve the quality and effectiveness of testing.

Which metric would best help track the speed of fixing defects?

A Test coverage

B Defect resolution time

C Defect density

D Number of test cases

Defect resolution time measures how quickly defects are fixed after being found.

Explain what test metrics and KPIs are and why they matter in software testing.

Think about how measuring helps improve any activity, like tracking your exercise progress.

Describe how defect density and defect leakage differ and why both are important to track.

Compare finding problems inside the factory versus problems customers find after buying.