Airtest Project

Airtest Project is a UI automation testing toolkit for games and apps, built by NetEase Games. It is best suited to teams comfortable writing Python and testing Android, iOS or Windows targets. Its community tools cover image-based and hierarchy-based automation, while enterprise device-lab needs call for a separate private-cloud solution.

Overview

Airtest gives test teams two ways to interact with interfaces: recognize elements from images, or use Poco to retrieve controls and their runtime hierarchy. That flexibility is useful when testing a mix of games and conventional apps, since not every target exposes controls in the same way. Coverage depends on the framework: Airtest supports Windows, Android and iOS, while Poco supports Android and iOS native apps and several game engines.

Scripts are written in Python, and the documentation recommends basic Python knowledge. AirtestIDE brings Airtest and Poco plugins into a cross-platform editor, but teams seeking a no-code workflow should look elsewhere.

Key features

Image and hierarchy-based automation

Airtest uses image recognition for automated UI testing across platforms. This offers an approach for interfaces where tests need to identify what appears on screen, while Poco provides runtime access to UI controls and their hierarchy for supported targets. Poco supports Unity3D, cocos2dx, UE4 and Egret, as well as Android and iOS native apps. Teams should check each framework against their target mix rather than assume identical coverage.

Web testing and editing

The Selenium plugin uses Chrome DevTools Protocol to record and generate Selenium scripts and access web elements. That adds a web-testing path alongside app and game automation. AirtestIDE is a cross-platform editor with built-in Airtest and Poco plugins, though scripting remains part of the workflow.

Enterprise device lab

Airlab provides test-case and script management, task scheduling, cloud reports, and iOS and Android regression and compatibility testing. NetEase's private-cloud option deploys the device rack and software platform inside the enterprise, a fit for organizations that need device management, test execution, reporting and continuous integration while keeping device use and testing processes private. A dedicated technical support group follows purchase and implementation. Poco can also be integrated into other engines using poco-sdk.

Documentation, official Q&A groups, issue submission and an official website question channel provide support for community users. AirtestIDE downloads are available for Windows 64-bit, Windows 32-bit, macOS and Ubuntu.

Pricing

The free community version is the practical starting point for teams that can run their testing locally and do not need an enterprise device lab. The private-cloud solution is aimed at enterprises needing managed device clusters and related capabilities; its price is determined after requirements are confirmed. No seat or usage caps are stated for either plan.

Platforms

The project lists Android, iOS, Linux, macOS, self-hosted, web and Windows. Airtest specifically supports Windows, Android and iOS; Poco supports Android and iOS native apps plus its supported game engines. AirtestIDE downloads are listed for Windows, macOS and Ubuntu. The broad project platform list should not be read as identical support across every component.

Who it's for

Airtest suits game and app teams that want automated UI testing and can work in Python, particularly those testing Android, iOS or Windows targets. Its image-recognition and hierarchy-based approaches offer useful options across supported apps and game engines. Enterprises that need a private device rack, scheduling, reporting and regression or compatibility testing can consider the private-cloud deployment. It is less suitable for teams that require no-code authoring or targets outside the frameworks' stated coverage.

Pros and cons

• Pros: Free community tools include Airtest, Poco and AirtestIDE, giving teams a usable automation toolkit without a paid entry plan.
• Pros: Image recognition and runtime UI hierarchy access provide different ways to automate supported interfaces.
• Pros: Poco's support for native mobile apps and multiple game engines extends beyond a single app framework.
• Cons: Python scripting requires basic programming familiarity, so it is not a no-code option.
• Cons: Support differs by component and target; teams must match their apps and engines to Airtest or Poco coverage.
• Cons: Enterprise private-cloud pricing is custom, so organizations need to confirm requirements before assessing cost.

Alternatives

For a broader comparison, browse the Game Testing Software category.

• Antidote is worth considering when a time-limited playtesting plan is a better fit: its free trial runs for 14 days and includes one playtest, up to five community players, 20 survey questions and sessions up to 20 minutes.
• GameDriver may suit educators and solo developers seeking full platform access through its free Ambassador Program; its Starter plan costs $200 a month.
• Backtrace is an alternative for teams focused on error monitoring, with a free Developer plan for one developer and up to 25k monthly errors.
• FirstLook Engagement Analytics is a better match for player analytics and playtesting, offering a free plan with 100k player profiles and up to 500 playtesters.
• GameBench is another option for game testing, with a free trial that includes 30 minutes of Pro testing and unlimited sessions for 28 days.
• TBase is a free alternative published under Tencent.
• Obvra may suit teams analyzing recordings rather than automating UI tests; its free Capture plan permits 50 analyzed recordings per month and does not include automated playback.
• Poki Playtesting is a free web-based alternative for playtesting, with Poki controlling the test nature and player numbers.

Verdict

Choose Airtest Project if your team can script in Python and needs free UI automation for supported app or game targets, with image recognition and Poco hierarchy access in one toolkit. Its main draw is the range of automation approaches and included community tools; look elsewhere if you need no-code authoring, different target coverage or a fixed-price enterprise device lab.