Observability

Making the next 1 billion agents fast, safe, and reliable. Agents suck. We're fixing that.

Arize AI is unified AI observability and LLM evaluation platform - built for AI engineers, by AI engineers.

The Leading LLM Evaluation Platform, powered by DeepEval.

Simulation & Evaluation for AI Voice & Chat Agents. YC S24.

Build trust into AI with Fiddler - the pioneer in AI Observability. Monitor, explain, analyze, and improve your ML models and LLM applications.

Solutions that track and analyze AI agent performance to ensure they’re working effectively and efficiently.

Manage your risk at the speed of AI. AI Guardian is a governance, risk and compliance (GRC) software platform that tracks and manages the use of AI across your business, flagging risks and identifying actions to minimize those risks. AI Guardian enables AI-driven innovation and performance improvement through governance and compliance systems, mitigating AI-related risks and balancing speed with safety. AI Guardian provides: - A centralized system of record for AI projects - At-a-glance visibility into AI projects across your business - AI Policy Intelligence to foster transparency and accountability - Risk tracking and mitigation across the five categories of AI-driven risk

The open-source LLM observability platform for developers.

A platform for operationalising Responsible AI principles in Gen AI enabled enterprise business processes.

The LLM engineering platform thousands of developers love. Easily trace and debug your LLM outputs in production. Keywords AI is basically Datadog for AI applications. Get started with 2 lines of code.

Open Source LLM Engineering Platform. Langfuse is the 𝗺𝗼𝘀𝘁 𝗽𝗼𝗽𝘂𝗹𝗮𝗿 𝗼𝗽𝗲𝗻 𝘀𝗼𝘂𝗿𝗰𝗲 𝗟𝗟𝗠𝗢𝗽𝘀 𝗽𝗹𝗮𝘁𝗳𝗼𝗿𝗺. It helps teams collaboratively develop, monitor, evaluate, and debug AI applications. Langfuse can be 𝘀𝗲𝗹𝗳-𝗵𝗼𝘀𝘁𝗲𝗱 in minutes and is battle-tested and used in production by thousands of users from YC startups to large companies like Khan Academy or Twilio. Langfuse builds on a proven track record of reliability and performance. Developers can trace any Large Language model or framework using our SDKs for Python and JS/TS, our open API or our native integrations (OpenAI, Langchain, Llama-Index, Vercel AI SDK). Beyond tracing, developers use 𝗟𝗮𝗻𝗴𝗳𝘂𝘀𝗲 𝗣𝗿𝗼𝗺𝗽𝘁 𝗠𝗮𝗻𝗮𝗴𝗲𝗺𝗲𝗻𝘁, 𝗶𝘁𝘀 𝗼𝗽𝗲𝗻 𝗔𝗣𝗜𝘀, 𝗮𝗻𝗱 𝘁𝗲𝘀𝘁𝗶𝗻𝗴 𝗮𝗻𝗱 𝗲𝘃𝗮𝗹𝘂𝗮𝘁𝗶𝗼𝗻 𝗽𝗶𝗽𝗲𝗹𝗶𝗻𝗲𝘀 to improve the quality of their applications. Product managers can 𝗮𝗻𝗮𝗹𝘆𝘇𝗲, 𝗲𝘃𝗮𝗹𝘂𝗮𝘁𝗲, 𝗮𝗻𝗱 𝗱𝗲𝗯𝘂𝗴 𝗔𝗜 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝘀 by accessing detailed metrics on costs, latencies, and user feedback in the Langfuse Dashboard. They can bring 𝗵𝘂𝗺𝗮𝗻𝘀 𝗶𝗻 𝘁𝗵𝗲 𝗹𝗼𝗼𝗽 by setting up annotation workflows for human labelers to score their application. Langfuse can also be used to 𝗺𝗼𝗻𝗶𝘁𝗼𝗿 𝘀𝗲𝗰𝘂𝗿𝗶𝘁𝘆 𝗿𝗶𝘀𝗸𝘀 through security framework and evaluation pipelines. Langfuse enables 𝗻𝗼𝗻-𝘁𝗲𝗰𝗵𝗻𝗶𝗰𝗮𝗹 𝘁𝗲𝗮𝗺 𝗺𝗲𝗺𝗯𝗲𝗿𝘀 to iterate on prompts and model configurations directly within the Langfuse UI or use the Langfuse Playground for fast prompt testing.

Ship agents with confidence. LangSmith is a unified observability & evals platform where teams can debug, test, and monitor AI app performance — whether building with LangChain or not.

Enterprise-grade platform for AI evaluation and observability.

AI (Gateway, Guardrails, Governance)∙ Processing 50 Billion+ LLM tokens every day.

Relari helps businesses build reliable, production-ready AI agents—fast. With Nuvi, our natural language-based agent builder, teams can go from idea to deployed agent without writing code. At the core is our Agent Contract framework, which defines agent behavior up front, ensures performance through testing, and speeds up iteration cycles. Trusted by leading companies—from high-growth startups to large enterprises—to power customer experiences and internal workflows with AI.