Flake

Visit site Alternatives

Score6.5

Rank#16 of 29

Free planNo

Runs onLinux, macOS, Self-hosted, Windows

Summary

Flake is ranked #16 of 29 in test flakiness management software on Everything Xiaomi. It runs on Linux, macOS, Self-hosted, Windows.

Compared on test flakiness management software

Free plan: Yesgithub.com
Flake detection: Yesgithub.com
Quarantine workflow: Nogithub.com
Failure clustering: Yesgithub.com
Rerun policies: Yesgithub.com
Supported frameworks: pytest, Jest, Vitestgithub.com

Facts

Purpose: Flake detects, diagnoses, and replays flaky tests by repeatedly running test suites under controlled variations.github.com · 30 Sept 2026
Supported test runners: Flake supports pytest, Jest, and Vitest.github.com · 30 Sept 2026
Detection: It computes failure rates and normalizes output into stable signatures to group failures into incidents.github.com · 30 Sept 2026
Diagnosis: For ordering failures, Flake uses delta debugging to reduce the preceding test sequence and verify a minimized reproduction.github.com · 30 Sept 2026
Replay: Each incident stores a run specification, and `flake replay <id>` rebuilds the recorded invocation.github.com · 30 Sept 2026
Integrations: Flake is available as a GitHub Action that can write a Markdown job summary, annotate flaky test files, and upload JSON, Markdown, or SARIF reports as an artifact.github.com · 30 Sept 2026
Privacy: The README says Flake does not upload source or test output, and stores its state in a local SQLite database in the OS application-data directory.github.com · 30 Sept 2026
Secret handling: Flake redacts likely-secret values before storing them and rejects secret-looking variable names in the environment allowlist.github.com · 30 Sept 2026
Limitations: With Jest, Flake cannot force an exact cross-file test order because Jest's own sequencer chooses it.github.com · 30 Sept 2026
Dependencies: Flake uses test runners and plugins already installed in the project and does not install dependencies or plugins.github.com · 30 Sept 2026
Availability: The README describes Flake as a cross-platform Go CLI and provides a `go install` command and released binaries for OS and architecture combinations.github.com · 30 Sept 2026
License: The repository lists the MIT license.github.com · 30 Sept 2026
Supported runners: It supports pytest, Jest, and Vitest test suites.github.com · 30 Sept 2026
Detection and replay: Flake computes failure rates, minimizes reproduction conditions, reports suspected causes from observed evidence, and saves replay commands.github.com · 30 Sept 2026
Controlled variations: Runs can vary test order, seeds, sequential or parallel execution, worker count, timezone, locale, temporary-directory handling, and allowed environment variables.github.com · 30 Sept 2026
Security controls: Flake rejects secret-looking variable names from its environment allowlist and does not vary or store likely-secret variables by default.github.com · 30 Sept 2026
Local execution: Flake is a cross-platform Go command-line tool, with released binaries available for operating systems and architectures on its releases page.github.com · 30 Sept 2026
Hosting model: The README states that Flake has no web dashboard, server, or cloud service.github.com · 30 Sept 2026