NVIDIA AR SDK
NVIDIA AR SDK is a free developer toolkit for adding AI-based face and body modeling to video applications.
What NVIDIA AR SDK is
NVIDIA AR SDK is a free developer toolkit for adding AI-based face and body modeling to video applications. It uses NVIDIA GPUs with Tensor Cores for high-throughput, low-latency processing. Face detection and tracking provide bounding boxes, while facial landmark tracking predicts 68 or 126 points and head poses. 3D Body Pose Estimation predicts 77 body keypoints in both 2D and 3D camera coordinates. Eye Contact estimates gaze angles and can redirect eyes toward the camera within a permissible range. Other features include facial expression estimation, LipSync animation from audio, and Active Speaker Detection using video with synchronized audio. The Core package contains runtime libraries, headers and APIs, documentation, integration guides, installation scripts, and a README. NVIDIA distributes the Core and optional features through NVIDIA GPU Cloud, with samples in GitHub and Linux-container guidance.
Good
- Face and body tracking features
- 68 or 126 facial landmarks
- 77-keypoint 2D and 3D body pose
- LipSync and active speaker detection
- Free Linux and Windows toolkit
Watch out
- NGC account required for Core download
- Uses NVIDIA GPUs with Tensor Cores
- Windows on Arm has feature restrictions
- No no-code authoring or web publishing
Who it suits
The SDK suits developers building video-processing applications with AI-powered augmented-reality features. It supports Linux, Windows, and self-hosted deployments.
Verdict
NVIDIA AR SDK offers a broad set of face, body, gaze, and speech-related video features for developers. NGC distribution, licensing terms, and Windows on Arm limits are important deployment considerations.
The facts
Each one read from NVIDIA AR SDK's own pages, with the date it was checked.
What it does
- Access
- The catalog says users need to be logged in to an NGC account to download the SDK Core.checked 7 Oct 2026
- Additional features
- The SDK also includes facial expression estimation, LipSync animation from audio, and Active Speaker Detection using video and synchronized audio.checked 7 Oct 2026
- Body pose
- 3D Body Pose Estimation predicts 77 body keypoints in 2D and 3D camera coordinates from video frames.checked 7 Oct 2026
- Core package
- The Core package contains runtime libraries, development headers and APIs, documentation, integration guides, feature installation scripts, and a README.checked 7 Oct 2026
- Deployment
- The user guide includes instructions for running the SDK in a Linux container.checked 7 Oct 2026
- Distribution
- The SDK Core and optional features are distributed through NVIDIA GPU Cloud (NGC), and the Core package provides a script to fetch features from NGC.checked 7 Oct 2026
- Eye Contact
- Eye Contact estimates gaze angles and can redirect a person's eyes toward the camera within a permissible range.checked 7 Oct 2026
- Face features
- Face detection and tracking uses bounding boxes, while facial landmark tracking predicts 68 or 126 landmark points and head poses.checked 7 Oct 2026
- Features
- Features include face detection and tracking, facial landmark tracking, body pose estimation, eye contact, facial expression estimation, LipSync, and active speaker detection.checked 7 Oct 2026
- GPU processing
- It uses NVIDIA GPUs with Tensor Cores for high-throughput, low-latency processing.checked 7 Oct 2026
- Integration
- NVIDIA provides sample applications demonstrating the SDK features in a GitHub repository.checked 7 Oct 2026
- Intended users
- The catalog describes the SDK as a resource for developers building video processing applications with AI-powered AR features.checked 7 Oct 2026
- License
- Use is governed by NVIDIA's Software License Agreement and Product-Specific Terms for NVIDIA AI Products; associated models follow the license specified for each model.checked 7 Oct 2026
- NIM containers
- The catalog lists Eye Contact and LipSync as available AR SDK features in ready-to-deploy NIM containers.checked 7 Oct 2026
- Purpose
- The SDK provides AI features for real-time modeling and tracking of human faces and bodies from video.checked 7 Oct 2026
- Samples
- NVIDIA links sample applications for all AR SDK features from its GitHub repository.checked 7 Oct 2026
- Support
- The catalog directs NVIDIA AI Enterprise customers to the NVIDIA AI Enterprise Support Portal and documentation hub.checked 7 Oct 2026
Where it runs
- Platforms
- The catalog lists x86-64 Windows and Linux support; the user guide also describes Windows on Arm support with feature restrictions.checked 7 Oct 2026
- Windows on Arm limit
- On Windows on Arm, LipSync and Active Speaker Detection are unsupported, and only the Body Pose Estimation or Body Detection path is available.checked 7 Oct 2026
Alternatives to NVIDIA AR SDK
- 1
MyWebAR
Free planAndroidiOSWebAPI8.1From $39 a month - 2
MAKAR
Free planAndroidiOSWebAPI8.0From $245 a month - 3
WorldCAST
Free planAndroidiOSWeb7.3From $10 a month - 4
TotalAR
Free planAndroidiOSWebAPI7.2From $90 a month - 5
Zapworks Studio
AndroidiOSmacOSWindows7.1From $64.99 a year - 6
Augment
AndroidiOSWebAPI7.0From $42 a month