Test progress reporting in Testing Fundamentals - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Understanding Test Progress Metrics

Which metric best describes the percentage of tests that have been executed out of the total planned tests?

A Test Execution Progress

B Test Coverage

C Defect Density

D Test Pass Rate

💡 Hint

Think about how much testing work has been done compared to what was planned.

Test Execution Progress measures how many tests have been run compared to the total planned tests, showing how far testing has advanced.

❓ Predict Output

intermediate

Output of Test Progress Calculation Code

What is the output of this Python code that calculates test progress percentage?

Testing Fundamentals

total_tests = 50
executed_tests = 30
progress = (executed_tests / total_tests) * 100
print(f"Test progress: {progress:.1f}%")

A Test progress: 30.0%

B Test progress: 50.0%

C Test progress: 60.0%

D Test progress: 15.0%

💡 Hint

Calculate the ratio of executed tests to total tests and multiply by 100.

30 executed tests out of 50 total means 30/50 = 0.6, multiplied by 100 is 60.0%.

❓ assertion

advanced

Correct Assertion for Test Progress Value

Which assertion correctly verifies that the test progress variable is at least 75%?

Testing Fundamentals

test_progress = 0.8  # Represents 80%

A assert test_progress > 75

B assert test_progress >= 0.75

C assert test_progress == 75

D assert test_progress >= 75

💡 Hint

Remember the variable is a decimal fraction, not a percentage number.

Since test_progress is 0.8 (80%), comparing it to 0.75 (75%) is correct. Comparing to 75 is wrong because it's not a percentage number.

🔧 Debug

advanced

Identify the Bug in Test Progress Reporting Code

What error will this JavaScript code cause when reporting test progress?

Testing Fundamentals

const totalTests = 100;
const executedTests = 40;
const progress = executedTests / totalTests * 100;
console.log('Test progress: ' + progress.toFixed(1) + '%');
if (progress > 100) {
  console.log('Progress cannot exceed 100%');
}

A Logical error: progress can never be greater than 100

B TypeError because toFixed is called on a string

C ReferenceError due to undefined variable

D No error; outputs 'Test progress: 40.0%'

💡 Hint

Check the data types and calculations carefully.

The code correctly calculates progress as 40, calls toFixed on a number, and prints the progress. No error occurs.

❓ framework

expert

Best Practice for Reporting Test Progress in Automation Framework

In a test automation framework, which approach best ensures accurate and real-time test progress reporting?

A Use event listeners to update progress immediately after each test completes

B Update a shared progress variable after each test and log progress at the end

C Calculate progress only once after all tests finish running

D Manually count passed tests and calculate progress after execution

💡 Hint

Think about how to get progress updates as tests run, not after all finish.

Using event listeners allows the framework to update progress in real-time as each test completes, providing accurate and timely reporting.

Practice

1. What does test progress reporting mainly show during software testing?

easy

A. How many tests have been completed and how many are left

B. The total number of bugs found in the software

C. The time taken to write each test case

D. The number of developers working on the project

Solution

1. Step 1: Understand the purpose of test progress reporting

   Test progress reporting is designed to show the current status of testing, specifically how many tests are done and how many remain.

2. Step 2: Compare options with the definition

   Only How many tests have been completed and how many are left correctly describes this purpose. Other options describe different metrics unrelated to progress reporting.

3. Final Answer:

   How many tests have been completed and how many are left -> Option A

4. Quick Check:

   Progress reporting = tests done vs remaining [OK]

Hint: Focus on tests done and left to find progress [OK]

Common Mistakes:

• Confusing bug count with progress
• Thinking progress shows developer count
• Mixing test writing time with progress

2. Which of the following is the correct way to represent test progress as a percentage?

easy

A. (Total tests / Number of tests completed) * 100

B. (Number of tests completed / Total tests) * 100

C. (Number of tests remaining / Number of tests completed) * 100

D. (Number of tests completed - Number of tests remaining) * 100

Solution

1. Step 1: Recall the formula for percentage progress

   Progress percentage is calculated by dividing completed tests by total tests, then multiplying by 100.

2. Step 2: Evaluate each option

   (Number of tests completed / Total tests) * 100 matches the correct formula. Options B, C, and D use incorrect divisions or operations.

3. Final Answer:

   (Number of tests completed / Total tests) * 100 -> Option B

4. Quick Check:

   Progress % = completed ÷ total x 100 [OK]

Hint: Divide completed by total, then multiply by 100 [OK]

Common Mistakes:

• Reversing numerator and denominator
• Using subtraction instead of division
• Multiplying before dividing

3. Consider this code snippet updating test progress:

total_tests = 50
completed_tests = 20
progress = (completed_tests / total_tests) * 100
print(f"Progress: {progress}%")

What will be the printed output?

medium

A. Progress: 25.0%

B. Progress: 20.0%

C. Progress: 50.0%

D. Progress: 40.0%

Solution

1. Step 1: Calculate the progress value

   progress = (20 / 50) * 100 = 0.4 * 100 = 40.0

2. Step 2: Check the printed output

   The print statement outputs "Progress: 40.0%" exactly.

3. Final Answer:

   Progress: 40.0% -> Option D

4. Quick Check:

   20 ÷ 50 x 100 = 40.0 [OK]

Hint: Divide completed by total, multiply by 100 for percent [OK]

Common Mistakes:

• Misreading completed and total values
• Confusing 20/50 as 25%
• Ignoring multiplication by 100

4. A tester wrote this code to show test progress:

total_tests = 100
completed_tests = 30
progress = completed_tests / total_tests * 100
print("Progress: " + progress + "%")

What is the error in this code?

medium

A. Division by zero error

B. Incorrect formula for progress

C. Cannot concatenate string and float directly

D. Missing parentheses in print statement

Solution

1. Step 1: Identify the data types in the print statement

   progress is a float, and the code tries to concatenate it directly with strings using +.

2. Step 2: Understand Python string concatenation rules

   Python cannot concatenate string and float directly; progress must be converted to string first.

3. Final Answer:

   Cannot concatenate string and float directly -> Option C

4. Quick Check:

   String + float needs conversion [OK]

Hint: Convert numbers to string before concatenation [OK]

Common Mistakes:

• Assuming division by zero
• Thinking formula is wrong
• Ignoring type errors in print

5. You want to create a test progress report that updates after each test and shows both fraction and percentage. Which approach is best?

hard

A. After each test, print: "Completed X/Y tests (Z%)" where Z = (X/Y)*100

B. Print total tests once, then print completed tests separately without percentage

C. Only print percentage after all tests finish

D. Print completed tests count only, no total or percentage

Solution

1. Step 1: Understand the goal of progress reporting

   It should show how many tests are done, total tests, and progress percentage updated continuously.

2. Step 2: Evaluate each option for completeness and clarity

   After each test, print: "Completed X/Y tests (Z%)" where Z = (X/Y)*100 shows fraction and percentage after each test, which is clear and informative. Other options miss key info or delay updates.

3. Final Answer:

   After each test, print: "Completed X/Y tests (Z%)" where Z = (X/Y)*100 -> Option A

4. Quick Check:

   Show fraction and percent continuously [OK]

Hint: Show fraction and percent after each test for clarity [OK]

Common Mistakes:

• Not updating progress continuously
• Omitting total tests count
• Showing only percentage or only count