Test groups in Selenium Java - Framework Patterns

Framework Mode - Test groups

Folder Structure

src/
└── test/
    └── java/
        └── com/
            └── example/
                ├── pages/
                │   └── LoginPage.java
                ├── tests/
                │   ├── LoginTests.java
                │   └── DashboardTests.java
                ├── utils/
                │   └── WebDriverFactory.java
                └── testng.xml

Test Framework Layers

• Driver Layer: WebDriverFactory.java manages browser drivers and setup.
• Page Objects: Classes like LoginPage.java encapsulate UI elements and actions.
• Test Layer: Test classes (LoginTests.java) contain test methods grouped by functionality.
• Utilities: Helper classes for common functions, e.g., waits or data handling.
• Configuration: testng.xml defines test groups and execution settings.

Configuration Patterns

Use testng.xml to define test groups and control which groups run.

<?xml version="1.0" encoding="UTF-8"?>
<suite name="Suite" verbose="1" parallel="false">
  <test name="Regression Tests">
    <groups>
      <run>
        <include name="regression"/>
      </run>
    </groups>
    <classes>
      <class name="com.example.tests.LoginTests"/>
      <class name="com.example.tests.DashboardTests"/>
    </classes>
  </test>
</suite>

In test classes, use @Test(groups = {"groupName"}) to assign tests to groups.

Test Reporting and CI/CD Integration

• TestNG generates HTML and XML reports showing which groups passed or failed.
• CI tools (Jenkins, GitHub Actions) run tests by group using testng.xml files.
• Reports help quickly identify issues in specific test groups like "smoke" or "regression".
• Integrate with Slack or email notifications to alert team on group test results.

Best Practices for Test Groups

1. Group by Purpose: Organize tests into meaningful groups like smoke, regression, or sanity.
2. Keep Groups Small: Avoid very large groups to keep test runs fast and focused.
3. Use Groups for Parallel Runs: Run different groups on separate machines to save time.
4. Document Groups: Clearly describe what each group tests for easy maintenance.
5. Combine with Tags: Use groups with other TestNG features like priorities for flexible runs.

Self Check

Where in this folder structure would you add a new test group called "smoke"?

Answer: In the testng.xml configuration file, add a new <test> section including tests with @Test(groups = {"smoke"}). Also, annotate test methods in test classes under src/test/java/com/example/tests/ with groups = {"smoke"}.

Key Result

Use TestNG groups in test classes and testng.xml to organize and run tests by categories.

Practice

1. What is the main purpose of using groups in Selenium Java tests?

easy

A. To change the browser used in tests

B. To organize tests into categories for selective execution

C. To automatically generate test reports

D. To increase the speed of the WebDriver

Solution

1. Step 1: Understand the role of test groups

   Test groups help organize tests into categories, making it easier to run specific sets of tests.

2. Step 2: Identify the correct purpose

   Groups do not affect WebDriver speed, report generation, or browser choice directly.

3. Final Answer:

   To organize tests into categories for selective execution -> Option B

4. Quick Check:

   Test groups = Organize tests [OK]

Hint: Groups categorize tests to run only what you need [OK]

Common Mistakes:

• Thinking groups speed up WebDriver
• Confusing groups with report generation
• Assuming groups change browser settings

2. Which is the correct syntax to assign a test method to groups "smoke" and "regression" in TestNG?

easy

A. @Test(groups = {"smoke", "regression"})

B. @Test(group = "smoke, regression")

C. @Test(groups = "smoke, regression")

D. @Test(groups = ["smoke", "regression"])

Solution

1. Step 1: Recall TestNG groups syntax

   The correct syntax uses groups = {"group1", "group2"} with curly braces and double quotes for each group.

2. Step 2: Compare options

   @Test(groups = {"smoke", "regression"}) matches the correct syntax. Options A, B, and D misuse quotes or attribute name. @Test(groups = ["smoke", "regression"]) uses square brackets which is invalid in Java annotations.

3. Final Answer:

   @Test(groups = {"smoke", "regression"}) -> Option A

4. Quick Check:

   Groups use curly braces and quotes [OK]

Hint: Use curly braces and quotes for multiple groups [OK]

Common Mistakes:

• Using 'group' instead of 'groups'
• Passing groups as a single string
• Using square brackets instead of curly braces

3. Given the following TestNG test methods, which tests will run if you execute only the "fast" group?

@Test(groups = {"fast"})
public void testA() {}

@Test(groups = {"slow"})
public void testB() {}

@Test(groups = {"fast", "regression"})
public void testC() {}

medium

A. testA only

B. testB only

C. testA and testC

D. testB and testC

Solution

1. Step 1: Identify tests with group "fast"

   testA has group "fast"; testC has groups "fast" and "regression"; testB has "slow" only.

2. Step 2: Determine which tests run when "fast" group is executed

   Only tests assigned to "fast" group run, so testA and testC run; testB does not.

3. Final Answer:

   testA and testC -> Option C

4. Quick Check:

   Run group "fast" = testA, testC [OK]

Hint: Run group runs all tests tagged with it [OK]

Common Mistakes:

• Running tests from other groups
• Ignoring tests with multiple groups
• Assuming only single-group tests run

4. What is wrong with this TestNG test method if the intention is to assign it to groups "ui" and "integration"?

@Test(groups = "ui, integration")
public void testUIIntegration() {}

medium

A. Groups should be passed as an array, not a single string

B. The method name is invalid

C. The annotation @Test is missing parentheses

D. Groups attribute is not supported in @Test

Solution

1. Step 1: Check groups attribute format

   Groups must be passed as an array of strings using curly braces, not a single comma-separated string.

2. Step 2: Identify the error in the code

   The code uses a single string "ui, integration" instead of {"ui", "integration"}.

3. Final Answer:

   Groups should be passed as an array, not a single string -> Option A

4. Quick Check:

   Groups need array syntax [OK]

Hint: Use curly braces for multiple groups [OK]

Common Mistakes:

• Passing groups as one string with commas
• Forgetting curly braces for arrays
• Misunderstanding annotation syntax

5. You have three test methods:

@Test(groups = {"sanity"})
public void testLogin() {}

@Test(groups = {"regression", "sanity"})
public void testCheckout() {}

@Test(groups = {"regression"})
public void testSearch() {}

How would you run only the tests that belong exclusively to the "sanity" group, excluding those that also belong to "regression"?

hard

A. Run tests with groups "sanity" and "regression" together

B. Run all tests with group "sanity" only

C. Run tests with group "regression" only

D. Run tests with group "sanity" and exclude group "regression" in the TestNG XML

Solution

1. Step 1: Identify tests with only "sanity" group

   testLogin belongs only to "sanity"; testCheckout belongs to both "regression" and "sanity"; testSearch belongs only to "regression".

2. Step 2: Determine how to run only exclusive "sanity" tests

   Use TestNG XML to include "sanity" group and exclude "regression" group to run only testLogin.

3. Final Answer:

   Run tests with group "sanity" and exclude group "regression" in the TestNG XML -> Option D

4. Quick Check:

   Include "sanity" exclude "regression" = exclusive tests [OK]

Hint: Include one group, exclude others in XML to filter tests [OK]

Common Mistakes:

• Running all tests with "sanity" ignoring exclusions
• Running "regression" group instead
• Running both groups together without filtering