flakiness.io installs statistics

Flakiness.io is a test analytics platform for GitHub that works with any CI and all popular test runners.

Flakiness.io tracks each test's performance across commits to detect regressions. The GitHub App posts a pass/fail check on every pull request.

What you get

• Separate regressions from flakes. Every result is tied to its commit and environment. Flakiness.io can tell whether a failure is new in the PR, already broken on main, or flipping on the same commit.

• Official reporters. Playwright, Pytest, Vitest, Jest, and CucumberJS, plus a JUnit XML bridge and a Node.js SDK for custom integrations.

• Any CI, one report. Flakiness.io ingests from any CI provider, merges sharded runs automatically, and keeps staging and production histories separate.

• Zoom in, zoom out. Reports range from a week-level view down to a single test in a single run. Slice with the Flakiness Query Language and read system telemetry alongside the test waterfall.

• Keep evidence attached. Logs, screenshots, videos, and Playwright traces upload alongside every report and render in built-in viewers, with configurable retention.

• GitHub-native access. Flakiness.io follows your GitHub repository permissions. No users, teams, or SSO to recreate.

• Compact context for coding agents. Flakiness.io turns a failed run into a compact record (what failed, whether it regressed, how it behaved on main) so agents spend fewer tokens gathering context.

• We charge for storage, not tests or seats. Run as many tests as you need and share results with anyone who has GitHub access, without per-run or per-seat fees.

Full guide: https://docs.flakiness.io/getting-started/

Description from the GitHub Marketplace listing.