LLM Observability

Kubiks

LLM Observability

Freemium

Logs, Traces, Dashboards, Alerts, Automatic Pull Requests with fixes.

Arize Phoenix

LLM Observability

Freemium

Open-source ML observability for LLMs. Focuses on troubleshooting, trace visualization, and embedding analysis.

Helicone

LLM Observability

Freemium

Open-source LLM observability platform and proxy. Provides detailed insights into latency, costs, and errors with caching capabilities.

Langfuse

LLM Observability

Freemium

Open-source LLM engineering platform for tracing, evaluating, and managing prompts. Popular alternative to LangSmith.

Weights & Biases

LLM Observability

Freemium

The standard for ML experiment tracking, now expanded with W&B Prompts for LLM evaluation, tracing, and versioning.

Braintrust

LLM Observability

Freemium

Enterprise-grade AI stack for building reliable AI products. Integrates evaluation, logging, and prompt management in one platform.

LangSmith

LLM Observability

Freemium

Platform by LangChain for debugging, testing, evaluating, and monitoring LLM applications. Essential for moving from prototype to production.