Test suite organization in Testing Fundamentals - Framework Patterns

Framework Mode - Test suite organization

Folder Structure

  test-suite/
  ├── tests/
  │   ├── login_tests/
  │   │   ├── test_login_valid.py
  │   │   └── test_login_invalid.py
  │   ├── shopping_cart_tests/
  │   │   ├── test_add_item.py
  │   │   └── test_remove_item.py
  │   └── user_profile_tests/
  │       ├── test_update_profile.py
  │       └── test_view_profile.py
  ├── fixtures/
  │   └── user_fixtures.py
  ├── utils/
  │   ├── helpers.py
  │   └── data_generators.py
  ├── config/
  │   ├── config.yaml
  │   └── env_variables.py
  └── README.md
  

Test Framework Layers

• Test Cases Layer: Contains organized test files grouped by feature or functionality (e.g., login, shopping cart).
• Fixtures Layer: Holds reusable setup and teardown code to prepare test data or environment.
• Utilities Layer: Contains helper functions and data generators to support tests.
• Configuration Layer: Manages environment settings, credentials, and test parameters.

Configuration Patterns

Use a config.yaml file to store environment-specific settings like URLs and database connections.

Use environment variables or a separate env_variables.py to keep sensitive data like passwords safe and out of code.

Load configuration at test startup so tests can adapt to different environments (development, staging, production) without code changes.

Test Reporting and CI/CD Integration

Generate clear test reports after each test run showing passed and failed tests.

Integrate with CI/CD tools (like Jenkins, GitHub Actions) to run tests automatically on code changes.

Use reports to quickly spot failures and fix bugs early.

Best Practices

• Group tests by feature: Makes it easier to find and run related tests.
• Keep tests independent: Each test should run alone without relying on others.
• Use fixtures for setup: Avoid repeating setup code in every test.
• Separate config from code: Makes switching environments simple and safe.
• Write clear test names: So anyone can understand what is tested.

Self Check

Where would you add a new test file for "password reset" functionality in this test suite structure?

Key Result

Organize tests by feature folders with clear layers for fixtures, utilities, and configuration to keep test suites clean and maintainable.

Practice

1. What is the main purpose of a test suite in software testing?

easy

A. To group related test cases for easier management and execution

B. To write code for the application features

C. To store user data during testing

D. To replace manual testing completely

Solution

1. Step 1: Understand the role of test suites

   A test suite is a collection of related test cases grouped together to organize testing efforts.

2. Step 2: Identify the correct purpose

   Grouping test cases helps testers run many tests together and manage them easily.

3. Final Answer:

   To group related test cases for easier management and execution -> Option A

4. Quick Check:

   Test suite groups tests = A [OK]

Hint: Test suites group tests to run together easily [OK]

Common Mistakes:

• Confusing test suite with application code
• Thinking test suite stores user data
• Believing test suite replaces manual testing

2. Which of the following is the correct way to define a test suite in Python's unittest framework?

easy

A. suite = unittest.TestSuite([TestClass1, TestClass2])

B. suite = unittest.TestSuite([TestClass1(), TestClass2()])

C. suite = unittest.TestSuite(TestClass1, TestClass2)

D. )2ssalCtseT ,1ssalCtseT(etiuStseT.tsettinu = etius

Solution

1. Step 1: Recall unittest TestSuite syntax

   TestSuite expects a list of test case instances, not classes.

2. Step 2: Check each option

   suite = unittest.TestSuite([TestClass1(), TestClass2()]) correctly passes instances: TestClass1() and TestClass2() inside a list.

3. Final Answer:

   suite = unittest.TestSuite([TestClass1(), TestClass2()]) -> Option B

4. Quick Check:

   TestSuite needs instances in list = A [OK]

Hint: Pass test case instances in a list to TestSuite [OK]

Common Mistakes:

• Passing classes instead of instances
• Not using a list to group tests
• Using parentheses incorrectly

3. Given the following test suite code snippet in Python unittest:

import unittest

class TestA(unittest.TestCase):
    def test_one(self):
        self.assertTrue(True)

class TestB(unittest.TestCase):
    def test_two(self):
        self.assertEqual(1, 1)

suite = unittest.TestSuite()
suite.addTest(TestA('test_one'))
suite.addTest(TestB('test_two'))
runner = unittest.TextTestRunner()
result = runner.run(suite)

What will be the result of running this test suite?

medium

A. Both tests pass and the suite completes successfully

B. TestA fails but TestB passes

C. TestB fails but TestA passes

D. Both tests fail and the suite reports errors

Solution

1. Step 1: Analyze each test case

   TestA.test_one asserts True is True, which passes. TestB.test_two asserts 1 equals 1, which also passes.

2. Step 2: Understand test suite execution

   The suite runs both tests; since both assertions are correct, no failures occur.

3. Final Answer:

   Both tests pass and the suite completes successfully -> Option A

4. Quick Check:

   Assertions true = tests pass = D [OK]

Hint: Check each assertion; all true means all tests pass [OK]

Common Mistakes:

• Assuming tests fail without checking assertions
• Confusing test method names
• Ignoring that both tests run in suite

4. You have a test suite that should run three tests, but only two run. The suite code is:

suite = unittest.TestSuite()
suite.addTest(TestClass('test_one'))
suite.addTest(TestClass('test_two'))
runner.run(suite)

What is the likely reason the third test test_three is not running?

medium

A. The test runner does not support more than two tests

B. The test method name test_three is invalid

C. The test class does not inherit from unittest.TestCase

D. The third test was not added to the test suite

Solution

1. Step 1: Review test suite additions

   The suite only adds test_one and test_two. test_three is missing.

2. Step 2: Check other options

   Method name test_three is valid if it starts with 'test'. Runner supports many tests. Class inheritance assumed correct.

3. Final Answer:

   The third test was not added to the test suite -> Option D

4. Quick Check:

   Missing addTest call = C [OK]

Hint: Add all tests explicitly to suite to run them [OK]

Common Mistakes:

• Assuming test runner limits tests
• Thinking method names cause skipping
• Ignoring suite.addTest calls

5. You want to organize a large number of tests into suites that share setup and teardown steps. Which approach best supports this in Python unittest?

hard

A. Write all tests in one TestCase class without setup methods

B. Use print statements to separate tests visually

C. Create multiple TestCase classes with setUp and tearDown methods, then group their instances in TestSuites

D. Run each test individually without grouping

Solution

1. Step 1: Understand setup/teardown in unittest

   setUp and tearDown methods in TestCase classes run before and after each test, helping prepare and clean up.

2. Step 2: Organize tests for sharing setup

   Grouping related TestCase instances in TestSuites allows running tests that share setup/teardown logically.

3. Final Answer:

   Create multiple TestCase classes with setUp and tearDown methods, then group their instances in TestSuites -> Option C

4. Quick Check:

   Use TestCase setup + TestSuite grouping = B [OK]

Hint: Use TestCase setup with TestSuite grouping for shared steps [OK]

Common Mistakes:

• Putting all tests in one class without setup
• Using print instead of setup methods
• Running tests one by one without suites