Code quality gates in JUnit - Test Execution Trace

Test Overview

This test checks if the code quality gate passes by verifying that the code coverage is above a threshold and no critical issues are found.

Test Code - JUnit 5

JUnit

import static org.junit.jupiter.api.Assertions.assertTrue;
import org.junit.jupiter.api.Test;

public class CodeQualityGateTest {

    @Test
    public void testCodeQualityGate() {
        // Simulated metrics from code analysis tool
        int coveragePercentage = 85;
        int criticalIssues = 0;

        // Quality gate conditions
        boolean coveragePass = coveragePercentage >= 80;
        boolean noCriticalIssues = criticalIssues == 0;

        assertTrue(coveragePass, "Code coverage is below the required threshold of 80%.");
        assertTrue(noCriticalIssues, "There are critical issues in the code.");
    }
}

Execution Trace - 6 Steps

Step	Action	System State	Assertion	Result
1	Test starts	JUnit test runner initialized	—	PASS
2	Simulate code coverage metric as 85%	Coverage metric set to 85%	—	PASS
3	Simulate critical issues count as 0	Critical issues count set to 0	—	PASS
4	Check if coverage is >= 80%	Coverage is 85%	assertTrue(coveragePass)	PASS
5	Check if critical issues count is 0	Critical issues count is 0	assertTrue(noCriticalIssues)	PASS
6	Test ends successfully	All assertions passed	—	PASS

Failure Scenario

Failing Condition: Code coverage is below 80% or critical issues count is greater than 0

Execution Trace Quiz - 3 Questions

What does the test verify about code coverage?

A Coverage must be at least 80%

B Coverage must be exactly 85%

C Coverage must be below 80%

D Coverage is not checked

Key Result

Always verify key quality metrics like code coverage and critical issues as part of automated quality gates to prevent low-quality code from progressing.

Practice

1. What is the main purpose of a code quality gate in a JUnit testing process?

easy

A. To check if the code meets predefined quality standards before merging

B. To automatically deploy code to production

C. To write new JUnit test cases

D. To format the source code automatically

Solution

1. Step 1: Understand the role of quality gates

   Quality gates are checkpoints that verify if code meets certain quality criteria before it is merged into the main branch.

2. Step 2: Relate to JUnit testing

   JUnit tests provide results that quality gates use to decide if the code passes or fails the quality standards.

3. Final Answer:

   To check if the code meets predefined quality standards before merging -> Option A

4. Quick Check:

   Quality gate purpose = Check code quality before merge [OK]

Hint: Quality gates stop bad code before merge [OK]

Common Mistakes:

• Confusing quality gates with deployment steps
• Thinking quality gates write tests automatically
• Assuming quality gates only format code

2. Which of the following is the correct way to assert that two values are equal in a JUnit 5 test?

easy

A. assertEqual(expected, actual);

B. assertEquals(expected, actual);

C. assertEquals(actual, expected);

D. assertEqual(actual, expected);

Solution

1. Step 1: Recall JUnit 5 assertion syntax

   The correct method to check equality is assertEquals(expected, actual); with the expected value first.

2. Step 2: Check method names and parameter order

   Method name must be assertEquals (not assertEqual) and parameters order matters: expected first, actual second.

3. Final Answer:

   assertEquals(expected, actual); -> Option B

4. Quick Check:

   assertEquals(expected, actual) is correct [OK]

Hint: Use assertEquals(expected, actual) exactly [OK]

Common Mistakes:

• Using assertEqual instead of assertEquals
• Swapping expected and actual parameters
• Missing parentheses or semicolons

3. Given the following JUnit test snippet, what will be the test result if calculateSum(2, 3) returns 6?

import static org.junit.jupiter.api.Assertions.assertEquals;

@Test
void testSum() {
    assertEquals(5, calculateSum(2, 3));
}

medium

A. Test fails with assertion error

B. Test is skipped

C. Test throws a compilation error

D. Test passes

Solution

1. Step 1: Understand the assertion

   The test expects calculateSum(2, 3) to return 5, but it returns 6 instead.

2. Step 2: Determine test outcome

   Since the actual value (6) does not match the expected value (5), the assertion fails and the test fails with an assertion error.

3. Final Answer:

   Test fails with assertion error -> Option A

4. Quick Check:

   Expected != Actual causes failure [OK]

Hint: Mismatch expected vs actual fails test [OK]

Common Mistakes:

• Assuming test passes if values differ
• Thinking compilation error occurs
• Believing test is skipped automatically

4. Identify the error in this JUnit 5 test method that prevents the quality gate from passing:

@Test
void testIsPositive() {
    int number = -1;
    assertTrue(number > 0);
}

medium

A. The test method name must start with 'test'

B. The test method is missing the @BeforeEach annotation

C. The assertion condition is incorrect for the test data

D. assertTrue is not a valid JUnit assertion

Solution

1. Step 1: Analyze the assertion condition

   The test asserts that number > 0 but number is -1, so the condition is false.

2. Step 2: Understand test failure impact on quality gate

   Because the assertion fails, the test fails and the quality gate will not pass.

3. Final Answer:

   The assertion condition is incorrect for the test data -> Option C

4. Quick Check:

   Assertion false causes test failure [OK]

Hint: Check if assertion matches test data truth [OK]

Common Mistakes:

• Thinking @BeforeEach is required for this test
• Believing method name must start with 'test'
• Assuming assertTrue is invalid in JUnit

5. In a continuous integration pipeline using JUnit tests and a code quality gate, which combination best ensures that only well-tested code is merged?

• 1. All tests must pass
• 2. Code coverage must be above 80%
• 3. No critical bugs reported by static analysis
• 4. Code formatting checks are ignored

hard

A. 2 and 4 only

B. 1 and 4 only

C. All 1, 2, 3, and 4

D. 1, 2, and 3 only

Solution

1. Step 1: Identify essential quality gate criteria

   Tests passing, high code coverage, and no critical bugs are key to ensuring code quality before merge.

2. Step 2: Evaluate code formatting importance

   Ignoring code formatting (point 4) can reduce code quality and maintainability, so it should not be ignored.

3. Final Answer:

   1, 2, and 3 only -> Option D

4. Quick Check:

   Pass tests + coverage + no bugs = good quality gate [OK]

Hint: Include tests, coverage, and bug checks for quality [OK]

Common Mistakes:

• Ignoring code formatting importance
• Assuming only tests passing is enough
• Thinking code coverage below 80% is acceptable