e-volv

CI playbook

FlakyTestDetector

Runs the test suite five times on the same commit and files a ticket for every non-deterministic test.

Runs the repository's test suite five times on the same commit, finds tests whose results are not deterministic, investigates why, and files one ticket per run listing every flaky test with its cause. Set your repository on the Clone step after importing.

Identifier
flaky-test-detector
Version
1.0.2
Steps
4
Triggers
1
  • ci
  • testing
  • flakiness
  • scheduled
  • automated

When it runs

Scheduleschedule.weekly
Schedule
Every Sunday at 03:00 UTC 0 3 * * 0
Timezone
UTC

The pipeline

The graph below is the one the workflow opens with in the builder — same steps, same layout, drawn on the same canvas. The run playing through it is a simulation; the branches and conditions are real.

React Flow
  1. 01
    Weekly Schedule (Sunday 03:00 UTC)trigger

    The event that starts the run.

  2. 02
    Clone Repository ⚠️ SET YOUR REPOgit.clone

    Shallow-clones the repository at the right ref.

  3. 03
    Detect Flaky Testsagent.run

    One agent works the task with its toolkit.

  4. 04
    File Flaky Test Ticketticket.create

    Opens a ticket on the connected tracker.

Branches

  • flake_agent to file_ticket: runs only if outputs.flake_agent.message contains RESULT: FINDINGS

The agent

Flaky Test Detector

Base type
Senior Developer
Temperature
0.2
Max iterations
50
Tools
5

Filesystem · 2

  • read_fileRead File · read
  • list_dirList Directory · read

Terminal · 1

  • run_terminal_cmdRun Terminal Command · write

Code search · 1

  • code_searchCode Search · read

Status · 1

  • update_statusUpdate Status · write