Error guessing in Testing Fundamentals - Test Execution Trace

Test Overview

This test simulates error guessing by deliberately entering invalid input to check if the system handles errors gracefully. It verifies that the application shows an appropriate error message when invalid data is submitted.

Test Code - Selenium

Testing Fundamentals

import unittest
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

class TestErrorGuessing(unittest.TestCase):
    def setUp(self):
        self.driver = webdriver.Chrome()
        self.driver.get('https://example.com/login')

    def test_invalid_login(self):
        driver = self.driver
        # Find username field and enter invalid username
        username = WebDriverWait(driver, 10).until(
            EC.presence_of_element_located((By.ID, 'username'))
        )
        username.clear()
        username.send_keys('invalid_user!@#')

        # Find password field and enter invalid password
        password = driver.find_element(By.ID, 'password')
        password.clear()
        password.send_keys('wrongpass123')

        # Click login button
        login_button = driver.find_element(By.ID, 'loginBtn')
        login_button.click()

        # Wait for error message to appear
        error_msg = WebDriverWait(driver, 10).until(
            EC.visibility_of_element_located((By.ID, 'errorMessage'))
        )

        # Assert error message text
        self.assertEqual(error_msg.text, 'Invalid username or password.')

    def tearDown(self):
        self.driver.quit()

if __name__ == '__main__':
    unittest.main()

Execution Trace - 5 Steps

Step	Action	System State	Assertion	Result
1	Test starts and browser opens the login page	Browser displays the login page with username, password fields and login button	—	PASS
2	Find username field and enter invalid username 'invalid_user!@#'	Username field is filled with invalid characters	—	PASS
3	Find password field and enter invalid password 'wrongpass123'	Password field is filled with invalid password	—	PASS
4	Click the login button	Login button is clicked, form is submitted	—	PASS
5	Wait for error message to appear with id 'errorMessage'	Error message element is visible on the page	Verify error message text equals 'Invalid username or password.'	PASS

Failure Scenario

Failing Condition: Error message does not appear or text is different after submitting invalid credentials

Execution Trace Quiz - 3 Questions

What is the purpose of entering 'invalid_user!@#' in the username field?

A To check password strength

B To verify successful login

C To test how the system handles invalid input

D To clear the username field

Key Result

Error guessing tests help find hidden bugs by trying inputs that might cause the system to fail, ensuring robust error handling.

Practice

1. What is the main idea behind Error guessing in software testing?

easy

A. Using formal test cases only

B. Writing automated tests for every function

C. Guessing where errors might occur based on experience

D. Ignoring past bugs and testing randomly

Solution

1. Step 1: Understand the concept of error guessing

   Error guessing is a technique where testers use their experience to predict where bugs might be.

2. Step 2: Compare options with the concept

   Only Guessing where errors might occur based on experience matches the idea of using experience to guess errors, others describe different testing methods.

3. Final Answer:

   Guessing where errors might occur based on experience -> Option C

4. Quick Check:

   Error guessing = Experience-based bug prediction [OK]

Hint: Error guessing is about experience, not formal rules [OK]

Common Mistakes:

• Confusing error guessing with automated testing
• Thinking error guessing ignores tester knowledge
• Believing error guessing is random testing

2. Which of the following is a correct example of an error guessing test case?

easy

A. Test all buttons for correct color

B. Test the software without any plan

C. Test only the homepage layout

D. Test input with empty fields to check validation

Solution

1. Step 1: Identify error guessing test case traits

   Error guessing focuses on inputs or actions likely to cause errors, like empty fields.

2. Step 2: Evaluate each option

   Test input with empty fields to check validation tests empty input, a common error source. Others are unrelated or random.

3. Final Answer:

   Test input with empty fields to check validation -> Option D

4. Quick Check:

   Empty input tests = Error guessing [OK]

Hint: Look for tests targeting likely error spots [OK]

Common Mistakes:

• Choosing tests unrelated to error conditions
• Confusing UI checks with error guessing
• Selecting random or unplanned tests

3. Given this scenario: A login form accepts username and password. Which input is best for error guessing?

medium

A. Username: 'admin', Password: '1234'

B. Username: '', Password: ''

C. Username: 'user1', Password: 'password'

D. Username: 'test', Password: 'test123'

Solution

1. Step 1: Identify inputs likely to cause errors

   Empty username and password fields often cause validation errors.

2. Step 2: Compare options for error likelihood

   Username: '', Password: '' uses empty inputs, which is a common error guess. Others are normal inputs.

3. Final Answer:

   Username: '', Password: '' -> Option B

4. Quick Check:

   Empty inputs = Common error guess [OK]

Hint: Empty or invalid inputs are classic error guesses [OK]

Common Mistakes:

• Choosing normal valid inputs
• Ignoring empty or boundary inputs
• Assuming random inputs are best

4. You wrote an error guessing test for a form but it never finds bugs. What is the most likely problem?

medium

A. You guessed errors in unlikely places

B. You wrote too many test cases

C. You automated all tests

D. You tested only the UI colors

Solution

1. Step 1: Understand error guessing effectiveness

   Error guessing works best when testers guess likely error spots based on experience.

2. Step 2: Analyze why tests fail to find bugs

   If guesses are in unlikely places, bugs won't be found. Other options don't explain this well.

3. Final Answer:

   You guessed errors in unlikely places -> Option A

4. Quick Check:

   Wrong guess spots = No bugs found [OK]

Hint: Guess where errors usually happen, not random places [OK]

Common Mistakes:

• Thinking more tests always find more bugs
• Believing automation replaces error guessing
• Focusing on UI style instead of error sources

5. You want to use error guessing to test a calculator app. Which combination of inputs is best to find errors?

hard

A. Very large numbers, zero, and dividing by zero

B. Random letters instead of numbers

C. Only positive integers

D. Normal numbers like 5 + 3, 10 - 2

Solution

1. Step 1: Identify error-prone inputs for calculator

   Calculators often fail with large numbers, zero, or division by zero.

2. Step 2: Evaluate options for error guessing effectiveness

   Very large numbers, zero, and dividing by zero targets these error-prone inputs, while others do not or are invalid inputs.

3. Final Answer:

   Very large numbers, zero, and dividing by zero -> Option A

4. Quick Check:

   Edge and invalid inputs = Best error guesses [OK]

Hint: Test edge cases and invalid inputs for errors [OK]

Common Mistakes:

• Testing only normal inputs
• Ignoring division by zero errors
• Using completely invalid inputs without context