Skip to content
AnnouncementInitial release: self-hosted on Ubuntu 24.04 and 26.04 LTS. More platforms planned; Cloud and managed services are outside this release.First release: self-hosted on Ubuntu LTS.Release status
Register Cloud interest
Reliability workflow

Diagnose and repair complex failures

Reproduce the failure in a disposable environment before touching the code, repair it, and keep the reproduction and the regression test as evidence that it is actually fixed.

Cloud is a future offering outside the initial self-hosted release. Registering interest creates no service or launch commitment.

What does this reliability workflow workflow cover?

Reproduce the failure in a disposable environment before touching the code, repair it, and keep the reproduction and the regression test as evidence that it is actually fixed.

What should an evaluator inspect?

Inspect the stated requirements, workspace boundary, validation evidence, approval points, and stated deployment scope rather than inferring results from an example workflow.

Is this customer proof?

No. Workflow pages describe an evaluation model and may use fictional product artifacts. They do not assert customer adoption, outcome, or availability evidence.

Can we run this workflow today?

A released self-managed artifact and tested quickstart are not published. Review the self-hosted requirements or register interest in future Cloud or Enterprise offerings.

What is the next step?

Use the ungated sample run and pilot scorecard to frame the evaluation, then choose a request path only if the operating model fits.

The problem

A test fails once a day in CI and passes locally. The stack trace points at a queue worker, the logs are in one tool, and the only person who understands that service is on holiday. Nobody wants to hand this to an agent, because an unreproduced fix is a guess with a diff attached.

The current workflow

1Re-run CI a few times, hope it fails again with more detail
2Add logging, deploy, wait for the next occurrence
3Patch the symptom, mark the test as flaky, move on
4The failure returns in a month with no record of the last attempt

The BranchRunner workflow

  1. 01
    Gather the context

    The task carries the failing job, the trace and the log excerpt. Repository inspection happens in the workspace, not from memory.

  2. 02
    Reproduce first

    The first requirement is a reliable reproduction. Until a check fails on demand, no repair is attempted.

  3. 03
    Repair, with the cause named

    The session records the cause as a decision with evidence, then changes the code. A symptom patch is visible as one.

  4. 04
    Prove it twice

    The reproduction must now pass, and the new regression test must fail against the old code. Both results are attached.

  5. 05
    Keep the environment

    The workspace and logs are retained for the run, so the next person can reproduce the original failure themselves.

In the product

Run 31 on TASK-474: an intermittent checkout test. The reproduction came first, the cause is named, and the regression test is the evidence.

Requirements4 of 4 satisfied
R1Failure reproduces on demandIndependently validated
R2Cause identified with evidenceIndependently validated
R3Regression test fails on the old codeIndependently validated
R4Full suite passes after the repairIndependently validated
Run context

Decision recorded: the worker reused a database connection across retries, so a rolled-back transaction leaked into the next attempt. Evidence: reproduction log lines 412–418.

FailedReproduction · 14 of 200 iterationsbefore
PassedReproduction · 200 of 200 iterationsafter
PassedRegression test · fails on parent commitverified
Reproduction log · env-br-474-aretained with the run
09:12:04iteration 13 · worker picked job 8841
09:12:04connection reused from pool slot 3
09:12:05transaction rolled back, connection not reset
09:12:05iteration 14 · checkout total mismatch (expected 4200, got 0)
09:12:06reproduction confirmed · 14/200
09:41:22after repair · 200/200 passed

Interface built from the product model. Repository, task and log content are examples.

Where a person stays in control

No repair without reproduction

The workflow blocks the repair step until a check fails on demand, so guesses cannot be shipped.

Named cause, reviewed

The stated cause and its evidence are read by a reviewer before the diff is accepted.

Production data stays out

Reproduction runs against seeded data in the workspace. Access to real systems requires an approval.

Retention on purpose

Failed and repaired runs keep their workspace and logs, so the diagnosis can be checked later.

What to expect

·Intermittent failures get a reproduction instead of a flaky tag
·The cause is written down where the next person will find it
·Some failures will not reproduce; the run says so and stops
·Diagnosis runs cost more in worker minutes than feature runs
A run that cannot reproduce the failure ends as a failed run with its investigation attached. That is a useful outcome, not a wasted one — the next attempt starts from it.

Deployment considerations

Environment
Seeded data and the services the failure touches
Budgets
Set a higher time limit; reproduction loops are slow
Retention
Keep diagnosis workspaces longer than delivery ones
Tools
Read-only database access, log access, browser automation for previews
Edition
Any edition; Enterprise for long-term evidence retention

Give the flaky test a reproduction

Disposable environments make reproduction cheap, and evidence makes the fix believable.

Register Cloud interestAll use cases
Cloud is a future offering outside the initial self-hosted release. Registering interest creates no service or launch commitment.