Flaky Test Detection

Occasionally, test steps—whether automated or manual—may encounter inconsistencies, flipping unpredictably between passed and failed states. This phenomenon is known as a flaky test.

Upon the completion of a test run, whether manual or automated, the system automatically conducts a flaky test check in the background. Should this check identify any instance of flakiness within a test plan or during an automated test run, a flag is prominently displayed. This enables users to easily identify any test steps flagged as flaky when reviewing the test plan or automated test results, enhancing the visibility of potential instability within the testing process.