Spitfire 0.14.0 release notes
Released: 2026-10-04
- Comparative runs in CI: spitfire cloud run "<test>" --compare A=<env>,B=<env> --label-a v2.3 --label-b <version> runs both arms at once, prints the per-step difference and answers with its exit code: 0 better or no difference, 98 worse, 97 invalid (an arm failed, or the pre-check failed with --strict), 99 a threshold breach in arm B. Inconclusive exits 0 by default, 98 with --fail-on-inconclusive. GitHub Actions and GitLab CI examples are in the README.
- Scheduled comparative runs: a schedule can compare two environments instead of starting a plain run. Comparisons from CI and schedules come with Growth yearly and Enterprise (compare_ci); starting one in the web UI is unchanged.
- A new run.compared event when a comparison ends: the verdict, the three largest differences and their confidence intervals go out by webhook, and Slack, Teams, e-mail (with the PDF) and SMS channels are notified. "Only problems" channels hear worse and invalid only. Existing channels get the event; JSON webhook receivers will see a new event type, which can be switched off per channel.
- PR/MR comment: "v2.4 vs v2.3: worse. checkout p95 +26% (±4%)." Comparative report: HTML and PDF with the verdict card on the first page, then the difference table; share links keep working after the arm runs are deleted.
Updating
Your installation tells you about a new release itself: admins see its notes and the update command for that installation at the top of the UI. The command backs up the database first and keeps the settings (Updating). You can also follow new releases with the RSS feed.