AI observability 4

Data workspace and prompt engineering platform for AI product teams. Latitude is a data workspace that helps analysts streamline their workflow and build interactive data apps quickly. It is also an end-to-end platform for prompt engineering where domain experts can collaborate with engineers to ship and maintain production-grade LLM features. Latitude is the open-source AI engineering platform for product teams to design prompts, evaluate and refine them using real data, and deploy new changes easily.
End-to-end AI evaluation and observability platform for testing and deploying AI applications. Maxim is an end-to-end AI evaluation & observability platform that helps you test and deploy AI apps with greater speed & confidence. Its developer stack includes tools for the full AI lifecycle: experimentation, pre-release testing, & post-release monitoring. It offers features like agent simulation and evaluation, prompt engineering tools, observability, and continuous quality monitoring. Maxim supports various AI frameworks and provides SDKs, CLI, and webhook support.
Llog: Collaborative analytics and insights tool for LLM interactions and monitoring. Llog is a collaborative analytics and insights tool designed for LLMs. It logs end-user interactions with a single request and facilitates surfacing, sharing, and deriving insights from those logs with all business stakeholders. It's an end-to-end platform for teams to gain insights into their LLM applications post-production, offering a collaborative workspace for reviewing logs, flagging important items, and assigning tasks within the context of model outputs. Llog provides unlimited seats at any price tier and full visibility into end-user interactions, allowing users to understand what their LLM is actually saying. Insights are available within seconds using a simple API format.
LLM observability and prompt A/B testing platform. Currai is an observability and tracing platform designed for LLM applications. It helps developers move away from basic print statement debugging by tracing every prompt, token, and tool call in a single view. The platform enables monitoring production traffic, calculating costs based on processed bytes, running evaluations, and A/B testing prompt versions live without requiring any local infrastructure to run. It offers drop-in Python and TypeScript SDKs and is byte-compatible with Langfuse and OpenTelemetry, making it easy to integrate or migrate existing projects.