AUTOTEST
AUTOTEST is an open-source tool that analyzes web pages and generates test cases and Python Selenium scripts.
What AUTOTEST is
AUTOTEST is an open-source tool that analyzes web pages and generates test cases and Python Selenium scripts. It can crawl unique internal URLs from a starting page with breadth-first search, stopping at a depth you specify. Generated tests can cover positive and negative cases for login, registration, and form pages when test data is supplied. Page analysis combines LLM-based metadata extraction with Selenium selector functions as a fallback. The README identifies Selenium and Playwright as supported frameworks; Puppeteer support is described in the development branch. Through LangChain, it supports major open-source and closed-source LLMs, with OpenAI, Groq, and Anthropic among its provider examples. The current version generates Python scripts, while other language support is under development. AUTOTEST is primarily command-line based and stores scripts and reports in local folders. It requires Python 3.10.12 and an LLM provider API key. Generated tests can pause for a user to handle a CAPTCHA or other security requirement. LLM responses can be cached in SQLite or regenerated with the --no-cache option. It is distributed under the MIT License.
Good
- Crawls unique internal URLs to a configurable depth.
- Generates positive and negative test cases when test data is supplied.
- Supports Selenium and Playwright.
- SQLite caching can be bypassed with --no-cache.
Watch out
- The current version generates scripts only in Python.
- Requires Python 3.10.12 and an LLM provider API key.
- Primarily command-line based.
Who it suits
AUTOTEST may suit people who understand web test cases and Selenium scripts and are comfortable using a command-line tool. It is intended for users who can provide an LLM API key and Python 3.10.12.
Verdict
AUTOTEST brings page crawling, LLM analysis, and browser test generation into a CLI workflow. Its current Python-only output and listed prerequisites matter when deciding whether it fits your setup.
The facts
Each one read from AUTOTEST's own pages, with the date it was checked.
What it does
- Caching
- The README describes caching LLM responses in SQLite and a --no-cache option to regenerate test cases or scripts.checked 4 Oct 2001
- CLI and outputs
- AUTOTEST is primarily CLI-based and stores generated scripts and test reports in local folders.checked 4 Oct 2001
- Crawling
- It extracts unique internal URLs from a base URL using breadth-first search up to a configurable depth.checked 4 Oct 2001
- Frameworks
- The README identifies Selenium and Playwright as supported frameworks and describes Puppeteer support in the dev branch.checked 4 Oct 2001
- Human intervention
- Generated tests can pause for a user to resolve security challenges such as CAPTCHAs.checked 4 Oct 2001
- Intended users
- The README lists understanding of web-page test cases and knowledge of Selenium scripts among the prerequisites.checked 4 Oct 2001
- Language limit
- The README says the current version generates test scripts in Python; support for other languages is under development.checked 4 Oct 2001
- License
- The software is distributed under the MIT License, which permits use, copying, modification, and distribution subject to its stated conditions.checked 4 Oct 2001
- LLM options
- The README says it supports major open-source and closed-source LLMs through LangChain’s abstraction layer, with provider configuration examples including OpenAI, Groq, and Anthropic.checked 4 Oct 2001
- LLM providers
- The README says its LangChain abstraction supports major open-source and closed-source LLMs and gives OpenAI, Groq, and Anthropic as provider examples.checked 4 Oct 2001
- Manual intervention
- Generated tests can pause for a user to resolve a CAPTCHA or other stated security requirement.checked 4 Oct 2001
- Page analysis
- It combines LLM-based page metadata extraction with Selenium selector functions as a fallback.checked 4 Oct 2001
- Purpose
- AUTOTEST is an open-source GenAI tool that analyzes web pages and generates automated test cases and Python Selenium scripts.checked 4 Oct 2001
- Requirements
- The README lists Python 3.10.12 and an API key from an LLM provider as prerequisites.checked 4 Oct 2001
- Security and compliance
- The repository describes a manual CAPTCHA handling step but does not state security certifications or compliance claims.checked 4 Oct 2001
- Test coverage
- It can generate positive and negative test cases, including for login, registration, and form pages when test data is supplied.checked 4 Oct 2001
- URL crawling
- It recursively extracts unique internal URLs from a base URL using breadth-first search, up to a specified depth.checked 4 Oct 2001
- Usage
- AUTOTEST is primarily a command-line tool and stores generated scripts and test reports in local folders.checked 4 Oct 2001
- What it does
- AUTOTEST is an open-source GenAI tool that analyzes web pages and generates test cases and Python Selenium scripts.checked 4 Oct 2001
Alternatives to AUTOTEST
- 1
Katalon Studio
Free planAndroidiOSWebAPI8.3From $83.33 a month - 2
Testsigma
Open sourceAndroidiOSWebAPI8.1From $14 a month - 3
aqua
Free planWebAPIExtensionLinux7.7From €19 a month - 4
WalnutAI
AndroidiOSWebExtension7.0From $18 a month - 5
QAEverest
Free planAndroidiOSWebAPI6.9Free plan - 6
TestQuality
Free planWebAPI6.8From $8 a month