Parallel test execution in Testing Fundamentals - Test Execution Trace

Test Overview

This test demonstrates running two simple tests at the same time (in parallel). It verifies that both tests complete successfully without waiting for each other.

Test Code - unittest with ThreadPoolExecutor

Testing Fundamentals

import unittest
import time
from concurrent.futures import ThreadPoolExecutor

class SimpleTest(unittest.TestCase):
    def test_one(self):
        time.sleep(2)  # Simulate a delay
        self.assertEqual(1 + 1, 2)

    def test_two(self):
        time.sleep(2)  # Simulate a delay
        self.assertTrue('hello'.islower())

if __name__ == '__main__':
    suite = unittest.TestLoader().loadTestsFromTestCase(SimpleTest)
    with ThreadPoolExecutor(max_workers=2) as executor:
        futures = [executor.submit(unittest.TextTestRunner().run, test) for test in suite]
        results = [f.result() for f in futures]
    # Check all tests passed
    assert all(result.wasSuccessful() for result in results), "Some tests failed"

Execution Trace - 5 Steps

Step	Action	System State	Assertion	Result
1	Test suite loads two test methods: test_one and test_two	Two test cases ready to run	—	PASS
2	ThreadPoolExecutor starts and runs test_one and test_two in parallel threads	Both tests running simultaneously, each sleeping for 2 seconds	—	PASS
3	test_one completes and asserts 1 + 1 equals 2	test_one finished successfully	assertEqual(1 + 1, 2)	PASS
4	test_two completes and asserts 'hello' is lowercase	test_two finished successfully	assertTrue('hello'.islower())	PASS
5	Main thread collects results from both tests	Both tests passed	assert all tests passed	PASS

Failure Scenario

Failing Condition: One of the tests fails its assertion or does not complete

Execution Trace Quiz - 3 Questions

What does running tests in parallel help achieve?

A Skip tests that take too long

B Run tests one after another to avoid conflicts

C Run multiple tests at the same time to save time

D Run only one test to reduce errors

Key Result

Running tests in parallel can greatly reduce total test time, but each test must be independent and thread-safe to avoid conflicts.

Practice

1. What is the main benefit of parallel test execution in software testing?

easy

A. It automatically fixes bugs found during testing.

B. It ensures tests run one after another to avoid conflicts.

C. It runs multiple tests at the same time to save testing time.

D. It slows down tests to check for memory leaks.

Solution

1. Step 1: Understand parallel execution purpose

   Parallel test execution means running tests simultaneously, not sequentially.

2. Step 2: Identify the main benefit

   Running tests at the same time saves overall testing time and speeds feedback.

3. Final Answer:

   It runs multiple tests at the same time to save testing time. -> Option C

4. Quick Check:

   Parallel execution = faster testing [OK]

Hint: Parallel means tests run together, saving time [OK]

Common Mistakes:

• Confusing parallel with sequential execution
• Thinking parallel fixes bugs automatically
• Assuming parallel slows down tests

2. Which of the following is the correct way to enable parallel test execution in a test framework configuration?

easy

A. enableParallelExecution = false

B. runTestsSequentially = true

C. testMode = singleThread

D. parallel = true

Solution

1. Step 1: Identify enabling parallel execution

   Setting parallel = true typically enables parallel runs in configs.

2. Step 2: Check other options

   Options A, B, and D disable or prevent parallel execution.

3. Final Answer:

   parallel = true -> Option D

4. Quick Check:

   Enable parallel = true [OK]

Hint: Look for 'parallel = true' to enable parallel runs [OK]

Common Mistakes:

• Using flags that disable parallel execution
• Confusing sequential and parallel settings
• Misreading boolean values

3. Consider this pseudocode for running tests in parallel:

start test1
start test2
wait for test1
wait for test2
print('All tests done')

What will be the output if both tests pass quickly?

medium

A. test1
test2

B. All tests done

C. Error: tests cannot run in parallel

D. No output

Solution

1. Step 1: Understand parallel start

   Both tests start without waiting, so they run at the same time.

2. Step 2: Wait for both tests to finish

   The code waits for test1 and test2 to complete before printing.

3. Final Answer:

   All tests done -> Option B

4. Quick Check:

   Wait then print = 'All tests done' [OK]

Hint: Wait for all tests before printing output [OK]

Common Mistakes:

• Assuming output prints before tests finish
• Thinking tests run sequentially
• Expecting test names printed automatically

4. You configured parallel test execution but notice tests fail due to shared data conflicts. What is the best way to fix this?

medium

A. Make tests independent by avoiding shared data or using separate data copies.

B. Run tests sequentially instead of parallel.

C. Ignore failures as they are caused by parallelism.

D. Increase the number of parallel threads.

Solution

1. Step 1: Identify cause of failure

   Failures happen because tests share data and interfere with each other.

2. Step 2: Fix by isolating tests

   Making tests independent or using separate data copies avoids conflicts.

3. Final Answer:

   Make tests independent by avoiding shared data or using separate data copies. -> Option A

4. Quick Check:

   Isolate tests to fix conflicts [OK]

Hint: Avoid shared data to fix parallel test conflicts [OK]

Common Mistakes:

• Ignoring failures caused by data conflicts
• Just reducing parallel threads without fixing data
• Assuming parallel always works without changes

5. You have 10 independent tests that each take 1 minute to run sequentially. Your test framework supports running 5 tests in parallel. How long will the total test run take if you use parallel execution correctly?

hard

A. 2 minutes

B. 5 minutes

C. 10 minutes

D. 1 minute

Solution

1. Step 1: Calculate sequential time

   Running 10 tests one by one takes 10 minutes (10 x 1 minute).

2. Step 2: Calculate parallel batches

   With 5 tests running at once, tests run in 2 batches (10 / 5 = 2).

3. Step 3: Calculate total parallel time

   Each batch takes 1 minute, so total time is 2 minutes.

4. Final Answer:

   2 minutes -> Option A

5. Quick Check:

   10 tests / 5 parallel = 2 minutes [OK]

Hint: Divide tests by parallel threads for total time [OK]

Common Mistakes:

• Assuming parallel time equals single test time
• Multiplying instead of dividing tests by threads
• Ignoring batch count in calculation