
LangSmith
8.0#1 in llm gateway software$39 usage-basedFree planWebAPILinuxmacOS
Visit
| Fact | LangSmith | Manifest |
|---|---|---|
| Data residency | Cloud data is hosted in GCP US or EU regions, while self-hosted data remains in the customer's VPC. | For the self-hosted version, routing and request data stay on the customer's servers except for documented telemetry and Autofix flows. |
| Integrations | Documented integrations cover OpenAI, Anthropic, Bedrock, Gemini, Mistral, LiteLLM, OpenTelemetry, CrewAI, Vercel AI SDK, PydanticAI, AutoGen and many other frameworks and providers. | Manifest connects API keys, paid subscriptions, local models, and custom endpoints; named local integrations include Ollama, llama.cpp, and LM Studio. |
| Observability | Its observability features include agent tracing, cost tracking, online LLM-as-judge and code evaluations, trajectory monitoring, and webhook or PagerDuty alerts. | Usage views show spending, selected models, token consumption and failed requests for each harness. |
| Retention | Base traces are retained for 14 days and extended traces for 180 days at an additional charge. | Cloud request recordings are retained for 7 days on Free and 365 days on Pro. |
LangSmith suits teams building or operating AI agents that need evaluation, prompt workflows, and observability. It supports both hosted and self-hosted deployment options.
Manifest suits AI builders, teams, startups, and platforms or providers that need to route model requests and track inference use. Self-hosting may suit users who want an offline gateway without an account.