Test groups in Selenium Java - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ Predict Output

intermediate

Output of TestNG test group execution

Given the following TestNG test class with groups, what will be the output when running only the "smoke" group?

Selenium Java

import org.testng.annotations.Test;

public class SampleTest {

    @Test(groups = {"smoke"})
    public void testA() {
        System.out.println("Running testA");
    }

    @Test(groups = {"regression"})
    public void testB() {
        System.out.println("Running testB");
    }

    @Test(groups = {"smoke", "regression"})
    public void testC() {
        System.out.println("Running testC");
    }
}

A Running testA\nRunning testC

B Running testB\nRunning testC

C Running testA\nRunning testB\nRunning testC

D Running testC

💡 Hint

Only tests tagged with the 'smoke' group run when that group is selected.

When running the 'smoke' group, TestNG executes tests annotated with 'smoke'. testA and testC have this group, so their print statements appear.

❓ assertion

intermediate

Assertion to verify only 'regression' group tests ran

You have a TestNG test suite that runs only the 'regression' group. Which assertion correctly verifies that only tests from the 'regression' group executed?

Selenium Java

List<String> executedTests = List.of("testB", "testC"); // names of executed tests

A assertTrue(executedTests.contains("testB") || executedTests.contains("testC"));

B assertFalse(executedTests.contains("testA"));

C assertEquals(executedTests.size(), 3);

D assertTrue(executedTests.containsAll(Arrays.asList("testB", "testC")) && executedTests.size() == 2);

💡 Hint

Check that only the expected tests ran and no extra tests.

Option D asserts that executedTests contains exactly 'testB' and 'testC' and no others, matching the 'regression' group tests.

🔧 Debug

advanced

Why does a test not run when included in a group?

You have this TestNG test method: @Test(groups = {"integration"}) public void testIntegration() { // test code } You run your suite with unit in your XML but testIntegration does not run. Why?

A Because the test method is private

B Because the test is in the 'integration' group but the suite runs only the 'unit' group

C Because the test method name does not start with 'test'

D Because the test method is missing @Test annotation

💡 Hint

Check the group names in the test and in the suite XML.

TestNG runs only tests in groups specified in the suite XML. Since 'integration' is not included, testIntegration is skipped.

❓ framework

advanced

Best practice for grouping tests in Selenium with TestNG

Which is the best practice for organizing Selenium tests using TestNG groups to separate fast smoke tests from slower regression tests?

A Annotate fast tests with @Test(groups = {"smoke"}) and slow tests with @Test(groups = {"regression"}), then run groups selectively

B Put all tests in one group and run them all every time

C Use @Test(enabled = false) for slow tests and enable them manually

D Create separate test classes for smoke and regression but do not use groups

💡 Hint

Groups help run subsets of tests based on speed or purpose.

Using groups allows selective execution of tests based on categories like speed or type, improving test suite efficiency.

🧠 Conceptual

expert

Impact of overlapping groups on test execution order

Consider these TestNG tests: @Test(groups = {"fast"}) public void test1() {} @Test(groups = {"fast", "database"}) public void test2() {} @Test(groups = {"database"}) public void test3() {} If you run the suite with groups fast,database, which statement about execution order is true?

A TestNG runs all tests in the order they appear in the class regardless of groups

B Tests in both groups run but tests with multiple groups run last

C All tests in 'fast' and 'database' groups run; order is not guaranteed unless specified

D Only tests in the intersection of 'fast' and 'database' groups run

💡 Hint

Groups select tests, but order depends on configuration or annotations.

TestNG runs all tests belonging to any specified group. Execution order is by default the order in the class but can be changed; groups do not guarantee order.