Flaky Test Detective

What Flaky Test Detective is

Flaky Test Detective is an open-source tool that analyzes results from repeated test runs to find tests failing inconsistently. It identifies flaky tests, examines possible causes, and can quarantine tests that exceed a chosen threshold. Detection covers timing variance, network errors, and failures that depend on execution order. The tool accepts Playwright JSON and JUnit XML, detecting the input format automatically. Reports can appear in colorized console output, JSON, HTML with SVG charts, or Markdown for GitHub pull request comments. Trend history is stored in SQLite by default, with JSON available as a file-based fallback. The default configuration requires at least three runs before analysis. Quarantine mode tags tests above the threshold and outputs a pattern usable with Playwright’s --grep-invert option. Usage is documented through an npm-installed command-line interface or programmatic Analyzer import. A GitHub Actions example is provided for Playwright results. The repository lists an MIT license and identifies Quvantic as the maker.