pytest-timeout for time limits - Test Execution Trace

Test Overview

This test checks that a function completes within a set time limit using pytest-timeout. It verifies the test fails if the function runs too long.

Test Code - pytest

PyTest

import time
import pytest

@pytest.mark.timeout(2)
def test_sleep_short():
    time.sleep(1)  # Sleeps less than timeout, should pass

@pytest.mark.timeout(2)
def test_sleep_long():
    time.sleep(3)  # Sleeps longer than timeout, should fail

Execution Trace - 6 Steps

Step	Action	System State	Assertion	Result
1	Test runner starts and loads test_sleep_short	pytest environment ready, test_sleep_short loaded	—	PASS
2	test_sleep_short executes time.sleep(1)	Function running, sleeping for 1 second	Check if test completes within 2 seconds timeout	PASS
3	test_sleep_short finishes before timeout	Function completed normally	Test passes as execution time < 2 seconds	PASS
4	Test runner starts and loads test_sleep_long	pytest environment ready, test_sleep_long loaded	—	PASS
5	test_sleep_long executes time.sleep(3)	Function running, sleeping for 3 seconds	Check if test completes within 2 seconds timeout	FAIL
6	Timeout triggers after 2 seconds, test_sleep_long interrupted	Test interrupted by pytest-timeout plugin	Test fails due to exceeding time limit	FAIL

Failure Scenario

Failing Condition: Function execution exceeds the 2 seconds timeout limit

Execution Trace Quiz - 3 Questions

What causes test_sleep_long to fail?

A It runs longer than the 2 seconds timeout

B It raises an exception inside the function

C The test code has a syntax error

D The pytest-timeout plugin is not installed

Key Result

Using pytest-timeout helps catch tests that hang or run too long, improving test suite reliability by enforcing time limits.

Practice

1. What is the main purpose of using pytest-timeout in test cases?

easy

A. To stop tests that run longer than a specified time limit

B. To increase the speed of test execution by skipping tests

C. To automatically retry failed tests

D. To generate detailed test coverage reports

Solution

1. Step 1: Understand pytest-timeout functionality

   pytest-timeout is designed to stop tests that exceed a time limit to prevent long waits.

2. Step 2: Compare options with pytest-timeout purpose

   Only To stop tests that run longer than a specified time limit matches this purpose; others describe different pytest features.

3. Final Answer:

   To stop tests that run longer than a specified time limit -> Option A

4. Quick Check:

   pytest-timeout stops long tests = C [OK]

Hint: Remember: pytest-timeout stops tests running too long [OK]

Common Mistakes:

• Confusing timeout with test retries
• Thinking it speeds up tests by skipping
• Mixing it with coverage reporting

2. Which of the following is the correct way to set a 5-second timeout for a test function using pytest-timeout?

easy

A. @pytest.mark.timeout(seconds=5)
def test_example(): pass

B. @pytest.timeout(5)
def test_example(): pass

C. @pytest.mark.timeout(5)
def test_example(): pass

D. @pytest.timeout(seconds=5)
def test_example(): pass

Solution

1. Step 1: Recall correct pytest-timeout decorator syntax

   The correct decorator is @pytest.mark.timeout(5) using a positional argument.

2. Step 2: Check each option's syntax

   @pytest.mark.timeout(5) def test_example(): pass uses correct syntax with positional argument 5. @pytest.mark.timeout(seconds=5) def test_example(): pass incorrectly uses keyword argument 'seconds=5'. The options using @pytest.timeout use wrong decorator names.

3. Final Answer:

   @pytest.mark.timeout(5) def test_example(): pass -> Option C

4. Quick Check:

   Use @pytest.mark.timeout(5) = A [OK]

Hint: Use @pytest.mark.timeout(5) to set 5 seconds [OK]

Common Mistakes:

• Using @pytest.timeout instead of @pytest.mark.timeout
• Passing seconds as a keyword argument
• Missing the @pytest.mark prefix

3. Given the following test code, what will happen when running pytest?

@pytest.mark.timeout(2)
def test_sleep():
    import time
    time.sleep(3)

medium

A. The test will pass because sleep is allowed

B. The test will raise a syntax error

C. The test will be skipped automatically

D. The test will fail due to exceeding the 2-second timeout

Solution

1. Step 1: Analyze the timeout and sleep duration

   The test has a 2-second timeout but sleeps for 3 seconds, exceeding the limit.

2. Step 2: Understand pytest-timeout behavior on timeout

   pytest-timeout stops the test and marks it as failed if it runs longer than the timeout.

3. Final Answer:

   The test will fail due to exceeding the 2-second timeout -> Option D

4. Quick Check:

   Sleep 3s > timeout 2s = fail [OK]

Hint: If test runs longer than timeout, it fails [OK]

Common Mistakes:

• Assuming test passes despite timeout
• Thinking test is skipped automatically
• Confusing timeout with syntax errors

4. Identify the error in the following pytest test using pytest-timeout:

@pytest.mark.timeout(3)
def test_loop():
    for i in range(5):
        time.sleep(1)

medium

A. Timeout value is too low for the loop

B. Missing import of the time module

C. Incorrect decorator syntax

D. The test will pass without errors

Solution

1. Step 1: Check for missing imports

   The test uses time.sleep(1) but does not import the time module.

2. Step 2: Verify other aspects

   The timeout and decorator syntax are correct. The missing import will cause a NameError.

3. Final Answer:

   Missing import of the time module -> Option B

4. Quick Check:

   Using time.sleep without import = error [OK]

Hint: Always import modules before using their functions [OK]

Common Mistakes:

• Ignoring missing imports
• Assuming timeout causes error instead
• Thinking decorator syntax is wrong

5. You want to apply a 10-second timeout to all tests in a pytest file without adding @pytest.mark.timeout to each test. Which is the best way to do this?

hard

A. Add pytestmark = pytest.mark.timeout(10) at the top of the test file

B. Set timeout=10 in pytest.ini configuration file

C. Use @pytest.mark.timeout(10) on a dummy test and inherit it

D. Add timeout=10 as a command line argument every time

Solution

1. Step 1: Understand pytestmark usage

   Setting pytestmark = pytest.mark.timeout(10) applies the timeout decorator to all tests in the file automatically.

2. Step 2: Evaluate other options

   Adding timeout as a command line argument requires specifying --timeout=10 every time pytest is run; setting timeout in pytest.ini applies it globally to all tests in the project; using a dummy test for inheritance is not a valid pytest feature. pytestmark is best for this specific file.

3. Final Answer:

   Add pytestmark = pytest.mark.timeout(10) at the top of the test file -> Option A

4. Quick Check:

   pytestmark applies decorator to all tests [OK]

Hint: Use pytestmark variable to apply timeout to all tests [OK]

Common Mistakes:

• Trying to set timeout in pytest.ini (global, not file-specific)
• Using dummy test inheritance (not valid)
• Relying on command line timeout argument (inconvenient)