Newman in CI/CD pipelines in Postman - Practice Problems & Coding Challenges

Challenge - 5 Problems

💻 Command Output

intermediate

Newman run output in CI pipeline

You run the following Newman command in a CI pipeline:

newman run collection.json -e environment.json --reporters cli,json --reporter-json-export result.json

What will be the content of result.json after the run?

Postman

newman run collection.json -e environment.json --reporters cli,json --reporter-json-export result.json

A An empty file because the JSON reporter does not export results automatically.

B A plain text file with only the summary of test results like total tests and failures.

C A JSON file containing detailed test run results including request, response, assertions, and environment variables.

D A CSV file listing all test names and their pass/fail status.

💡 Hint

Think about what the JSON reporter exports when used with --reporter-json-export.

The JSON reporter exports a detailed JSON file with all test run data including requests, responses, and assertion results. It is not a summary or CSV.

🔀 Workflow

intermediate

Integrating Newman in a Jenkins pipeline

You want to add a Newman test run to your Jenkins pipeline script. Which snippet correctly runs a Postman collection and fails the build if any test fails?

A sh 'newman run collection.json --bail'

B sh 'newman run collection.json || true'

C sh 'newman run collection.json --ignore-errors'

D sh 'newman run collection.json --silent'

💡 Hint

Which option stops the pipeline on test failures?

The --bail option stops the run on first failure and causes the command to exit with a non-zero code, failing the Jenkins build.

❓ Troubleshoot

advanced

Newman fails in CI with 'command not found'

Your CI pipeline fails with the error:

sh: newman: command not found

What is the most likely cause?

A Newman is not installed or not in the PATH on the CI agent.

B The CI pipeline script has a syntax error.

C The environment file has invalid JSON syntax.

D The collection file is missing or corrupted.

💡 Hint

The error says the command itself is missing.

The error means the shell cannot find the newman executable, usually because it is not installed or PATH is not set correctly.

✅ Best Practice

advanced

Best practice for storing Postman collections in CI

Which is the best practice for managing Postman collections in a CI/CD pipeline?

A Manually upload collections to the CI server before each run.

B Store collections and environments as JSON files in the source code repository.

C Keep collections only in the Postman cloud and export manually when needed.

D Use a separate private server to host collections and download them during CI runs.

💡 Hint

Think about version control and automation.

Storing collections as JSON files in the repo allows version control, easy updates, and automated CI runs.

🧠 Conceptual

expert

Understanding Newman exit codes in CI

What exit code does Newman return when all tests pass successfully in a CI pipeline?

A 255

B 1

C 2

D 0

💡 Hint

Standard Unix convention for success.

Newman returns exit code 0 when all tests pass, indicating success to the CI system.