Running collections via CLI in Postman - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ Predict Output

intermediate

What is the output of this Newman CLI command?

You run the following command to execute a Postman collection using Newman CLI:

newman run mycollection.json --reporters cli,json

What will be the result of this command?

Postman

newman run mycollection.json --reporters cli,json

A The command runs but outputs only a JSON report file without CLI output.

B The command runs but only outputs the CLI report, ignoring JSON.

C The command fails because multiple reporters cannot be specified together.

D The collection runs and outputs results in both CLI and JSON report formats.

💡 Hint

Newman supports multiple reporters separated by commas.

Newman allows specifying multiple reporters separated by commas. Here, both CLI and JSON reports will be generated and shown.

❓ assertion

intermediate

Which assertion correctly checks the HTTP status code in a Postman test script?

Inside a Postman collection test script, you want to assert that the response status code is 200. Which code snippet correctly does this?

Postman

pm.test('Status code is 200', function () {
    pm.response.to.have.status(200);
});

A pm.test('Status code is 200', function () { pm.response.to.have.status(200); });

B pm.test('Status code is 200', function () { pm.response.status === 200; });

C pm.test('Status code is 200', () => pm.response.to.have.status(200));

D pm.test('Status code is 200', function () { pm.response.statusCode(200); });

💡 Hint

Use pm.response.to.have.status with a function inside pm.test.

Option A uses the correct syntax with a function and the assertion pm.response.to.have.status(200). Option A uses arrow function with implicit return, which is valid. Option A and D are incorrect syntax.

🔧 Debug

advanced

Why does this Newman CLI command fail to run the collection?

You run this command:

newman run collection.json --env environment.json --folder

But it fails with an error. What is the cause?

Postman

newman run collection.json --env environment.json --folder

A The --folder option requires a folder name argument which is missing.

B The collection file must be named collection.postman_collection.json.

C The --env option must be specified after --folder.

D Newman does not support running collections with environment files.

💡 Hint

Check if all options have required arguments.

The --folder option requires the name of the folder inside the collection to run. Omitting the folder name causes an error.

🧠 Conceptual

advanced

What is the purpose of the --delay-request option in Newman CLI?

When running a Postman collection via Newman CLI, what does the --delay-request option do?

A It delays the start of the entire collection run by the specified milliseconds.

B It retries failed requests after the specified delay.

C It adds a delay in milliseconds between each request execution.

D It delays the generation of the report until all requests finish.

💡 Hint

Think about pacing requests to avoid server overload.

The --delay-request option adds a pause between each request in the collection, useful to avoid hitting rate limits or server overload.

❓ framework

expert

How to integrate Newman CLI with a CI/CD pipeline for automated testing?

You want to run Postman collections automatically in your CI/CD pipeline using Newman CLI. Which approach is best practice?

A Run Newman manually on the build server after deployment to production.

B Add a script in the pipeline configuration that runs 'newman run' with collection and environment files, and fail the build if tests fail.

C Use Newman only locally and upload reports manually to the CI server.

D Replace Newman with a GUI tool for CI/CD integration.

💡 Hint

Automation means no manual steps and failing builds on test failures.

The best practice is to add Newman commands in the pipeline scripts to run tests automatically and fail builds if tests fail, ensuring quality gates.

Practice

1. What is the primary command line tool used to run Postman collections via CLI?

easy

A. npm

B. newman

C. curl

D. postman-cli

Solution

1. Step 1: Identify the official CLI tool for Postman collections

   Newman is the official command line tool designed to run Postman collections.

2. Step 2: Differentiate from other tools

   npm is a package manager, curl is a general HTTP client, and postman-cli is not an official tool.

3. Final Answer:

   newman -> Option B

4. Quick Check:

   Postman CLI tool = newman [OK]

Hint: Remember: Newman runs Postman collections in CLI [OK]

Common Mistakes:

• Confusing npm with the CLI runner
• Using curl as a Postman collection runner
• Assuming postman-cli is official

2. Which of the following is the correct syntax to run a Postman collection file named test_collection.json using Newman?

easy

A. newman execute test_collection.json

B. newman start test_collection.json

C. newman run test_collection.json

D. newman launch test_collection.json

Solution

1. Step 1: Recall the Newman command to run collections

   The correct command is newman run <collection-file>.

2. Step 2: Verify the options

   Options like execute, start, or launch are not valid Newman commands.

3. Final Answer:

   newman run test_collection.json -> Option C

4. Quick Check:

   Command syntax = newman run [OK]

Hint: Use 'newman run' to execute collections [OK]

Common Mistakes:

• Using 'execute' instead of 'run'
• Trying 'start' or 'launch' commands
• Omitting the 'run' keyword

3. Given the command newman run my_collection.json -e my_environment.json --delay-request 1000, what effect does the --delay-request 1000 option have?

medium

A. Limits the collection run to 1000 requests total

B. Sets the timeout for each request to 1000 milliseconds

C. Runs the collection 1000 times

D. Delays each request by 1000 milliseconds between executions

Solution

1. Step 1: Understand the --delay-request option

   This option adds a delay between each request in the collection, measured in milliseconds.

2. Step 2: Interpret the value 1000

   1000 milliseconds equals 1 second delay between requests.

3. Final Answer:

   Delays each request by 1000 milliseconds between executions -> Option D

4. Quick Check:

   --delay-request = wait time between requests [OK]

Hint: Delay means wait time between requests in ms [OK]

Common Mistakes:

• Confusing delay with timeout
• Thinking it repeats the collection
• Assuming it limits total requests

4. You run the command newman run collection.json -e env.json --reporters cli,html but get an error saying Unknown reporter: html. What is the most likely cause?

medium

A. The HTML reporter is not installed or supported by Newman

B. The environment file is invalid

C. The collection file is missing

D. The CLI reporter cannot be combined with others

Solution

1. Step 1: Analyze the error message

   The error states 'Unknown reporter: html', meaning Newman does not recognize the 'html' reporter.

2. Step 2: Understand reporter support

   Newman supports some reporters by default; others require installation or are unsupported.

3. Final Answer:

   The HTML reporter is not installed or supported by Newman -> Option A

4. Quick Check:

   Unknown reporter means unsupported or missing plugin [OK]

Hint: Check reporter names and installation before running [OK]

Common Mistakes:

• Blaming environment or collection files
• Assuming CLI reporter conflicts
• Ignoring reporter installation requirements

5. You want to run a Postman collection multiple times with different data sets from a CSV file named data.csv. Which Newman command correctly achieves this?

hard

A. newman run collection.json -d data.csv

B. newman run collection.json --data data.csv

C. newman run collection.json -e data.csv

D. newman run collection.json --env data.csv

Solution

1. Step 1: Identify the option for data files in Newman

   The -d or --iteration-data option is used to specify a data file for iteration.

2. Step 2: Differentiate environment and data options

   -e or --env is for environment files, not data files.

3. Final Answer:

   newman run collection.json -d data.csv -> Option A

4. Quick Check:

   Use -d for data files in Newman [OK]

Hint: Use -d to specify data file for iterations [OK]

Common Mistakes:

• Using -e or --env for data files
• Using --data, an invalid flag
• Confusing environment and data files