LLM testing 7

Platform to evaluate and test LLM-powered applications for faster and reliable product releases. Ottic is a platform designed to evaluate LLM-powered applications, enabling both tech and non-technical teams to test their LLM apps and ship reliable products faster. It offers features like visual prompt management, end-to-end test management, comprehensive LLM evaluation, and user behavior monitoring. Ottic aims to provide a 360º view of the QA process for LLM applications, ensuring quality and reducing time to market.

Cloud-based testing platform for conversational AI and LLM-powered chatbots. LLM Tester is a cloud-based testing platform designed for teams developing conversational AI and LLM-powered chatbots. It's a SaaS solution that allows users to create, manage, and automate conversation flow tests for their bots. The platform helps evaluate, compare, and improve language models through automated conversation flows, offering comprehensive tools to assess and enhance AI conversational models.

glideprompt helps write and test system prompts on various LLMs for optimal selection. glideprompt helps users write system prompts and test them on popular language models (Llama, Mistral, OpenAI, Claude, Gemini) to make better decisions about which model is best for their task. It eliminates the need for A/B tests, price checking, and extra effort in evaluating language models.

Disposable Linux environments for AI agents to test apps end to end TryCase provides disposable Linux environments for AI coding agents to run apps, test changes end to end, capture screenshots and recordings, collect logs and artifacts, and return verified results instead of requiring manual testing.

AI simulation environment for testing LLM apps at scale. Snowglobe is a simulation environment for LLM teams designed to test how their AI applications respond to real-world user behavior. It enables users to run full workflows through realistic scenarios, catch edge cases early, and confidently improve model performance before deploying to production. Snowglobe helps AI teams test LLM apps at scale by simulating real-world conversations, uncovering risks, and improving overall model performance.

AI Prompt Library for LLM Testing. PromptsLabs is an AI Prompt Library for LLM Testing. It provides a comprehensive collection of prompts designed to test new Large Language Models (LLMs). The platform allows users to discover, test, and contribute prompts to evaluate the performance of AI models.

Automated AI voice agent testing, call analytics, and governance platform. Hamming AI is an automated AI voice agent testing, call analytics, and governance platform. It helps teams test their AI voice agents 100x faster than manual calls by creating Character.ai-style personas and scenarios and running hundreds of simultaneous phone calls to find bugs. It provides detailed analytics to improve voice agent performance and ensures trust and safety.