Multiple parameters in PyTest - Framework Patterns

Framework Mode - Multiple parameters

Folder Structure

tests/
├── test_example.py       # Test files with multiple parameter tests
├── conftest.py           # Fixtures and hooks
utilities/
├── data_provider.py      # Data sources for parameterization
pytest.ini               # Pytest configuration file

Test Framework Layers

• Tests Layer: Contains test functions using @pytest.mark.parametrize with multiple parameters to run tests with different input combinations.
• Utilities Layer: Provides data providers or helper functions to supply complex parameter sets.
• Fixtures Layer: Defined in conftest.py to setup test preconditions or shared resources.
• Configuration Layer: Manages pytest.ini and environment variables for test runs.

Configuration Patterns

• Use pytest.ini to configure markers and default options.
• Use fixtures in conftest.py to inject environment-specific data or setup.
• Parameterize tests with multiple parameters using @pytest.mark.parametrize decorator, passing tuples or lists of tuples for combinations.
• Use helper functions in utilities to generate complex parameter sets if needed.

Test Reporting and CI/CD Integration

• Use pytest built-in reporting with --junitxml=report.xml for CI systems.
• Integrate with CI tools like GitHub Actions, Jenkins, or GitLab CI to run parameterized tests automatically on code changes.
• Use plugins like pytest-html for readable HTML reports showing each parameter combination as a separate test case.
• Ensure test failures clearly indicate which parameter set caused the failure for easy debugging.

Best Practices

1. Use descriptive test IDs or names for parameter sets to make reports readable.
2. Keep parameter sets manageable in size to avoid very long test runs.
3. Use fixtures to handle setup/teardown separately from parameter data.
4. Organize parameter data in separate utility files if complex or reused across tests.
5. Use explicit tuple unpacking in test function parameters for clarity.

Self Check

Where in this framework structure would you add a new set of complex parameter data for a test that requires three input values?

Key Result

Use @pytest.mark.parametrize with tuples in test files and organize parameter data in utilities for clean multiple parameter testing.

Practice

1. What is the main purpose of using @pytest.mark.parametrize with multiple parameters in pytest?

easy

A. To run the same test function with different sets of input values

B. To skip tests conditionally based on input values

C. To group multiple test functions into one

D. To generate test reports automatically

Solution

1. Step 1: Understand the role of @pytest.mark.parametrize

   This decorator allows running a test multiple times with different inputs.

2. Step 2: Recognize the benefit of multiple parameters

   Using multiple parameters lets you test combinations of inputs easily in one test function.

3. Final Answer:

   To run the same test function with different sets of input values -> Option A

4. Quick Check:

   Multiple parameters = multiple input sets [OK]

Hint: Parametrize runs tests repeatedly with different inputs [OK]

Common Mistakes:

• Thinking it skips tests instead of running multiple times
• Confusing it with grouping tests
• Assuming it generates reports automatically

2. Which of the following is the correct syntax to parametrize a test function with two parameters a and b in pytest?

easy

A. @pytest.mark.parametrize((a, b), [(1, 2), (3, 4)])

B. @pytest.mark.parametrize('a, b', [(1, 2), (3, 4)])

C. @pytest.mark.parametrize([a, b], [(1, 2), (3, 4)])

D. @pytest.mark.parametrize('a b', [(1, 2), (3, 4)])

Solution

1. Step 1: Recall the correct parameter names format

   Pytest expects a string with parameter names separated by commas, e.g., 'a, b'.

2. Step 2: Check the value list format

   Values must be a list of tuples matching the parameters, e.g., [(1, 2), (3, 4)].

3. Final Answer:

   @pytest.mark.parametrize('a, b', [(1, 2), (3, 4)]) -> Option B

4. Quick Check:

   Parameter names as string with commas [OK]

Hint: Use a string with comma-separated names for parameters [OK]

Common Mistakes:

• Using tuple or list instead of string for parameter names
• Missing commas between parameter names
• Using space instead of comma to separate names

3. What will be the output when running this pytest test?

import pytest

@pytest.mark.parametrize('x, y', [(1, 2), (3, 4)])
def test_sum(x, y):
    assert x + y == 3

medium

A. First test passes, second test fails

B. Both tests fail

C. Both tests pass

D. First test fails, second test passes

Solution

1. Step 1: Evaluate first test with inputs (1, 2)

   Sum is 1 + 2 = 3, assertion 3 == 3 passes.

2. Step 2: Evaluate second test with inputs (3, 4)

   Sum is 3 + 4 = 7, assertion 7 == 3 fails.

3. Final Answer:

   First test passes, second test fails -> Option A

4. Quick Check:

   Check sums against 3 [OK]

Hint: Calculate sums for each tuple and compare [OK]

Common Mistakes:

• Assuming all tests pass without checking values
• Ignoring that assertion compares to fixed number 3
• Confusing which test input causes failure

4. Identify the error in this pytest code using multiple parameters:

import pytest

@pytest.mark.parametrize('a, b', [1, 2, 3])
def test_multiply(a, b):
    assert a * b > 0

medium

A. The test function must return a value

B. The parameter names should be a list, not a string

C. The assertion syntax is incorrect

D. The parameter values should be tuples, not integers

Solution

1. Step 1: Check the parameter values format

   Values must be a list of tuples matching parameters (a, b), but here it's a list of integers.

2. Step 2: Understand why this causes error

   Pytest tries to unpack each integer into two variables, causing a TypeError.

3. Final Answer:

   The parameter values should be tuples, not integers -> Option D

4. Quick Check:

   Values must match parameter count [OK]

Hint: Use tuples for multiple parameters values [OK]

Common Mistakes:

• Passing a flat list instead of list of tuples
• Thinking parameter names must be a list
• Expecting test function to return a value

5. You want to test a function is_even_sum(a, b) that returns True if the sum of a and b is even. Which @pytest.mark.parametrize setup with a single decorator correctly tests all combinations of a from [1, 2] and b from [3, 4] respectively?

hard

A. @pytest.mark.parametrize('a', [1, 2])
@pytest.mark.parametrize('b', [3, 4])

B. @pytest.mark.parametrize('a, b', [(1, 2), (3, 4)])

C. @pytest.mark.parametrize('a, b', [(1, 3), (1, 4), (2, 3), (2, 4)])

D. @pytest.mark.parametrize('a, b', [(1, 3), (2, 4)])

Solution

1. Step 1: Understand the need to test all combinations

   We want to test every pair from a=[1,2] and b=[3,4], so all 4 pairs must be covered.

2. Step 2: Recognize the benefit of multiple parameters

   @pytest.mark.parametrize('a, b', [(1, 3), (1, 4), (2, 3), (2, 4)]) lists all pairs explicitly: (1,3), (1,4), (2,3), (2,4).

3. Final Answer:

   @pytest.mark.parametrize('a, b', [(1, 3), (1, 4), (2, 3), (2, 4)]) -> Option C

4. Quick Check:

   All pairs listed explicitly [OK]

Hint: List all pairs explicitly for full coverage [OK]

Common Mistakes:

• Missing some pairs in the list
• Using separate decorators without knowing cartesian product effect
• Confusing parameter order or values