e-volv

Review playbook

VisualRegressionTriage

Triage visual regression diffs against the code diff, approving intended changes and raising only unintended ones.

When a visual regression suite completes with diffs, triages each one against the PR's code diff and decides whether it is intended, unintended, or noise. Unintended diffs are raised as inline PR review threads; intended and noisy diffs are summarized with their reasoning so the report is auditable.

Identifier
visual-regression-triage
Version
1.0.1
Steps
4
Triggers
1
  • visual-regression
  • triage
  • screenshots
  • ui
  • ci
  • automated

When it runs

CI resultci_workflow.completed
Settle delay
30s after the event

Only when all hold

  • ciWorkflow.conclusion equals success
  • ciWorkflow.name in visual-regression, vrt, chromatic, percy, loki, storycap
  • actor.username not contains [bot]

The pipeline

The graph below is the one the workflow opens with in the builder — same steps, same layout, drawn on the same canvas. The run playing through it is a simulation; the branches and conditions are real.

  1. 01
    Visual Regression CI Workflow Completedtrigger

    The event that starts the run.

  2. 02
    Clone Repositorygit.clone

    Shallow-clones the repository at the right ref.

  3. 03
    Triage Visual Regression Diffsagent.run

    One agent works the task with its toolkit.

  4. 04
    Publish Visual Regression Triage Reportreport.publish

    Posts or updates a deduplicated report comment.

The agent

Visual Regression Triage Reviewer

Base type
Code Reviewer
Temperature
0.2
Max iterations
40
Tools
6

Git provider · 2

  • get_pull_request_diffGet Pull Request Diff · read
  • add_pull_request_review_threadAdd PR Review Thread · write

CI/CD · 1

  • get_ci_run_logsGet CI Run Logs · read

Filesystem · 1

  • read_fileRead File · read

Code search · 1

  • code_searchCode Search · read

Status · 1

  • update_statusUpdate Status · write