Test result publishing in PyTest - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ Predict Output

intermediate

Understanding pytest result output

What will be the output summary line after running this pytest test file?

PyTest

import pytest

def test_pass():
    assert 1 == 1

def test_fail():
    assert 2 == 3

A No tests ran

B 2 passed in 0.01s

C 1 failed in 0.01s

D 1 passed, 1 failed in 0.01s

💡 Hint

Count how many tests pass and fail based on assertions.

There are two tests: one passes, one fails. Pytest reports both counts in the summary.

❓ assertion

intermediate

Choosing the correct assertion for test result publishing

Which assertion correctly verifies that a test suite published 3 passed tests and 1 failed test?

A assert results.passed == 3 and results.failed == 1

B assert results.failed == 3 and results.passed == 1

C assert results.passed == 4 and results.failed == 0

D assert results.total == 3

💡 Hint

Check the counts for passed and failed tests separately.

The assertion must match the exact counts of passed and failed tests as given.

🔧 Debug

advanced

Debugging missing test result in pytest report

Why does this pytest run not show any test results in the report?

PyTest

import pytest

def test_example():
    assert True

if __name__ == '__main__':
    pytest.main([])

A pytest.main([]) should be pytest.run() to show results

B pytest.main([]) runs tests but no output because no arguments given

C test_example is not detected because it lacks a decorator

D The test function name must start with 'check_' to run

💡 Hint

Check how pytest.main() arguments affect output.

Calling pytest.main([]) runs tests but suppresses output by default; arguments are needed to show results.

❓ framework

advanced

Configuring pytest to publish test results in JUnit XML format

Which pytest command line option correctly publishes test results in JUnit XML format to 'results.xml'?

A pytest --xml=results.xml

B pytest --report=results.xml

C pytest --junitxml=results.xml

D pytest --output=results.xml

💡 Hint

Look for the official pytest option for JUnit XML output.

The correct option is '--junitxml=filename' to generate JUnit XML reports.

🧠 Conceptual

expert

Understanding test result publishing in CI pipelines

In a Continuous Integration (CI) pipeline, why is publishing test results in a standard format like JUnit XML important?

A It allows CI tools to parse and display test results consistently across different projects

B It reduces the total test execution time by caching results

C It automatically fixes failed tests without manual intervention

D It encrypts test results to secure sensitive data

💡 Hint

Think about how CI tools use test reports.

Standard formats like JUnit XML enable CI tools to read and show test results uniformly, improving visibility and automation.

Practice

1. What is the main purpose of publishing test results in pytest?

easy

A. To change the test code behavior

B. To speed up test execution time

C. To write more test cases automatically

D. To share test outcomes with team members or tools

Solution

1. Step 1: Understand test result publishing

   Publishing test results means sharing what happened during tests with others.

2. Step 2: Identify the purpose in pytest context

   In pytest, publishing results helps teams see which tests passed or failed.

3. Final Answer:

   To share test outcomes with team members or tools -> Option D

4. Quick Check:

   Test result publishing = sharing outcomes [OK]

Hint: Publishing means sharing test results with others [OK]

Common Mistakes:

• Thinking publishing speeds up tests
• Confusing publishing with writing tests
• Believing publishing changes test code

2. Which pytest command correctly saves test results to an XML file named results.xml?

easy

A. pytest --junitxml=results.xml

B. pytest --savexml=results.xml

C. pytest --output=results.xml

D. pytest --xmlfile=results.xml

Solution

1. Step 1: Recall pytest command for XML report

   The correct option uses --junitxml to save results in XML format.

2. Step 2: Match the command with the filename

   Using pytest --junitxml=results.xml saves the test report as results.xml.

3. Final Answer:

   pytest --junitxml=results.xml -> Option A

4. Quick Check:

   Use --junitxml to save XML report [OK]

Hint: Use --junitxml=filename.xml to save results [OK]

Common Mistakes:

• Using --savexml instead of --junitxml
• Using --output or --xmlfile which are invalid
• Forgetting the equals sign '='

3. Given this pytest command:

pytest --junitxml=report.xml

What will happen after running tests?

medium

A. Test results will be saved in a file named report.xml

B. Tests will not run due to syntax error

C. Tests will run but no results will be saved

D. Test results will be printed only on the console

Solution

1. Step 1: Understand the command option

   The option --junitxml=report.xml tells pytest to save results in XML format to the file report.xml.

2. Step 2: Predict the outcome after running tests

   Tests run normally and results are saved in the specified XML file.

3. Final Answer:

   Test results will be saved in a file named report.xml -> Option A

4. Quick Check:

   --junitxml saves results to XML file [OK]

Hint: Look for --junitxml to save results to XML file [OK]

Common Mistakes:

• Thinking results only print on console
• Assuming tests won't run with this option
• Confusing file saving with syntax errors

4. You run pytest --junitxml report.xml but no report.xml file is created. What is the likely problem?

medium

A. pytest does not support XML reports

B. The command is missing an equals sign between option and filename

C. The test files are empty so no report is generated

D. The filename must be results.xml exactly

Solution

1. Step 1: Check the command syntax

   The correct syntax requires an equals sign: --junitxml=report.xml.

2. Step 2: Understand effect of missing equals sign

   Without '=', pytest treats report.xml as a positional argument, so no file is created.

3. Final Answer:

   The command is missing an equals sign between option and filename -> Option B

4. Quick Check:

   Use '=' after --junitxml to save file [OK]

Hint: Remember to use '=' after --junitxml option [OK]

Common Mistakes:

• Omitting the equals sign in command
• Thinking empty tests prevent report creation
• Believing pytest can't create XML reports

5. You want to publish pytest results in XML and also ensure the report includes test durations. Which command should you use?

hard

A. pytest --xmlreport=report.xml --showdurations

B. pytest --junitxml=report.xml --duration=all

C. pytest --junitxml=report.xml --durations=0

D. pytest --junitxml report.xml --durations

Solution

1. Step 1: Identify correct option for XML report

   The option --junitxml=report.xml correctly saves results in XML format.

2. Step 2: Add option to show all test durations

   The option --durations=0 tells pytest to show durations for all tests.

3. Step 3: Verify combined command correctness

   Combining both options as pytest --junitxml=report.xml --durations=0 is valid and achieves the goal.

4. Final Answer:

   pytest --junitxml=report.xml --durations=0 -> Option C

5. Quick Check:

   Use --junitxml and --durations=0 together [OK]

Hint: Use --junitxml=filename and --durations=0 for full report [OK]

Common Mistakes:

• Using wrong option names like --xmlreport
• Missing equals sign in options
• Using incorrect values like --duration=all