AI Testing 259

Play strategy games against AI and evaluate multi-agent model behavior Olam Labs evaluates AI models in multi-agent simulations focused on capability, behavior, and social intelligence. Its Multi-Agent Arena lets people play social strategy games such as Diplomacy, Poker, and Risk against frontier language models, which negotiate and strategize alongside human players. Olam Labs also works with AI labs and researchers on evaluations and training in simulated environments where agents can cooperate, deceive, and negotiate.

AvantaGPT is an unrestricted AI platform built for developers, cybersecurity researchers, Linux users, and technical power users. AvantaGPT provides flexible AI assistance for coding, cybersecurity research, Linux development, debugging, automation, and complex technical workflows. Designed for users who want fewer restrictions and more control, AvantaGPT supports an OpenAI-compatible API and can integrate with tools such as OpenCode. Use it to analyze code, develop scripts, research vulnerabilities in authorized environments, troubleshoot systems, and work through complex technical problems. AvantaGPT is built around the idea that AI should fit into the tools and environments technical users already rely on.

Receive SMS verification codes online with virtual phone numbers from 180+ countries. DogeSMS lets you receive one-time verification codes (OTP) online using temporary virtual phone numbers. Pick a country and a service, get a number in seconds, and the SMS code shows up in your dashboard. It covers 180+ countries and 5,000+ services such as Telegram, WhatsApp, Google and more, with pay-per-use pricing from $0.05 and number rental for longer-term use. A REST API is available for developers and automation workflows, so verification steps can be handled programmatically.

Platform for comparing AI agents on real computer-use tasks Coarena by Coasty is a computer-use evaluation arena where users watch multiple AI agents complete real computer tasks side by side. It enables users to compare agents based on speed, accuracy, reliability, and task completion quality, then vote for the better-performing agent. The platform focuses on everyday workflows across browsers, applications, and enterprise software rather than synthetic benchmarks.

AI codebase auditing and verified fixes delivered as human-reviewed GitHub pull requests. Hyrax is an AI-powered codebase analysis and improvement platform for engineering teams. It connects to GitHub, maps repository structure, and uses specialized agents to identify issues across security, correctness, performance, maintainability, architecture, and operations. Before reporting a problem, Hyrax writes a failing test to validate it. It then prepares a fix and checks it against the repository's tests, build, lint, and additional verification steps before proposing it as a pull request. Engineers review and merge every change; Hyrax does not merge autonomously.

Platform for building, evaluating, and improving AI agents for business automation. Foundry is a platform to build, evaluate, and improve AI agents that can automate key parts of your business—customer support, hiring, sales, and more. Foundry is a platform for building and evaluating browser agents. Users can configure tasks, define evaluation criteria, and collect high-quality data for reinforcement learning (RL) and agent improvement. Our platform provides a deterministic web simulator and an annotation framework so you can collect labels, benchmark agents, and debug performance without worrying about web drift, IP bans, or rate limits.

Teammately: AI Agent for AI Engineers, automates LLM app development. Teammately is an AI Agent for AI Engineers, designed to automate and fast-track every step of the LLM app development lifecycle, from Dev to Ops. It aims to elevate the Time-to-value, Reliability, and ROI of LLM Apps.

AI-powered tool for automatically seeding relational databases with realistic mock data. Snaplet Seed is an AI-powered tool that lets developers automatically seed their relational databases with realistic, production-like mock data using Typescript. It helps developers stop building data from scratch by providing instant AI-generated seed data, saving time, improving accuracy, and enabling confident assertions. Snaplet provides realistic, production-like data for relational databases, making coding, debugging, and testing easier.

AI-powered mock API creation for rapid development and testing. Celerforge is an AI-powered platform designed for creating mock APIs at lightning speed. It offers a free RESTful API simulator, JSON server, and testing environment to accelerate development with instant fake data generation. It allows users to mock RESTful APIs, create JSON servers, and utilize a free online API server for HTTP mock services. It serves as a REST API simulator, fake API generator, dummy API service, API mocking tool, test API environment, RESTful endpoint simulator, mock data generator, API prototyping tool, temporary API server, development API mock, online API tester, fake JSON server, RESTful API sandbox, API simulation platform, mock backend service, and API testing environment.

Build AI Agents with confidence: Platform for building, deploying, and managing AI agents. Vivgrid is an AI agent infrastructure platform that helps developers and startups build, deploy, and manage AI agents with observability, evaluation, and safety guardrails. It provides a confident path from prototype to production for AI agents by offering tools for AI observability, debugging, evaluation, testing, and deployment, complemented by a globally distributed inference infrastructure designed for low latency and reliable scale. Vivgrid aims to help users master the right mental model to ship resilient AI systems.

Remyx AI: ExperimentOps platform for AI development, model building, and production. Remyx AI helps AI developers and teams run better experiments, build reliable models, and ship production AI with ease. It provides an ExperimentOps studio for AI development, allowing users to learn what’s actually working and why. Remyx operationalizes knowledge, closing the loop between experimentation and AI that delivers on business goals. It captures and surfaces insights that make AI experiments repeatable, trustworthy, and ready for production. The platform supports structured, reusable experiments, customizable evaluation criteria, and guided learning loops.

Discover, evaluate, adopt, and publish ready-to-use OpenClaw AI Agents. Agentcadia is an AI Agent marketplace and evaluation platform built for the OpenClaw ecosystem. Users can test Agent capabilities through structured evaluations, browse and adopt expert-crafted Agent configurations, and download ready-to-use packages, while creators can publish their own Agents, manage adoption, and grow a monetizable AI workflow portfolio.

Open-source, natural-language CLI for AI-powered, code-free browser automation. BrowserBash is an open-source, plain-English command-line interface (CLI) tool designed for AI-driven browser automation. It allows users to execute complex browser actions by describing them in natural language, eliminating the need for manual selectors, code, or flaky locators. BrowserBash supports various execution environments, including local Chrome, Browserbase, LambdaTest, and BrowserStack. It operates on either local models via Ollama or cloud models via OpenRouter, ensuring no API keys or credit cards are strictly required to start. The tool is built for CI/CD integration, offering features like NDJSON output, session recording, and the ability to run automated tests as simple Markdown files.

AI evaluation models to test and improve generative AI applications. Atla provides frontier AI evaluation models to evaluate generative AI, find and fix AI mistakes at scale, and build more reliable GenAI applications. It offers an LLM-as-a-Judge to test and evaluate prompts and model versions. Atla's Selene models provide precise judgments on AI app performance, running evals with accurate LLM Judges. They offer solutions optimized for speed and industry-leading accuracy, customizable to specific use cases with accurate scores and actionable critiques.

AI website audit for crawler visibility and readiness isready.ai is an AI website readiness audit platform that checks whether a site is readable, crawlable, and optimized for AI crawlers and browser-based agents. It simulates how GPTBot, ClaudeBot, PerplexityBot, and other AI systems read raw HTML without JavaScript, scores the site across 32 evidence-based checks, and provides concrete fixes, reports, CLI output, GitHub Actions, and Smart Agent readability testing.

AI platform for faster incident resolution, defect prevention, and production engineering collaboration PlayerZero is an AI production engineering platform that builds a living model of an organization's software using code, tickets, observability data, ownership information, workflows, and deployment context. It helps SRE, support, engineering, and QA teams coordinate production work, investigate incidents, identify root causes, validate fixes, prevent defects, and resolve customer tickets faster. PlayerZero agents automate triage, delegation, investigation, and coordination while retaining decisions, incident patterns, and validation outcomes as institutional memory. Its simulation capabilities run parallel scenarios against software changes to identify regressions and verify expected behavior before release.

AI-powered candidate screening and hiring platform. UpScreen.ai revolutionizes screening and hiring with AI-driven insights and video screening. It reduces manual effort and delivers precise, comprehensive reports for quicker, smarter decisions. The platform automates screening and shortlisting with an AI-based tool that auto-selects interview questions, assesses, scores, and ranks candidates.

Online assessment software with AI and ChatGPT integration for efficient candidate screening. InterviewQueue is an online assessment software platform that helps screen candidates easily. It offers customizable features, insightful analytics, and ChatGPT integration to streamline processes and empower informed hiring decisions. It provides tools for creating custom coding assignments, AI-powered candidate evaluation, and seamless API integration.

AI-powered coding utilities for generating tests, documentation, refactoring, and debugging code. CodeUtils provides AI-powered utilities for an enhanced coding experience. It helps generate unit tests, documentation, refactor code, and debug code using AI. It supports multiple languages including Javascript, Typescript, Kotlin, Java, PHP, Go, Python, C#, C++, Scala, Rust, Dart, and Solidity.

Yadget is a SaaS tool for generating synthetic data for software testing and validation. Yadget is a SaaS tool designed to generate Synthetic Data for testing. It produces realistic, non-identifiable datasets to help test and validate products, ideal for software developers in data testing and validation processes. It helps creators generate tonnes of synthetic data to test and validate digital products, useful for ML and AI projects.

End-to-end testing platform for generative AI models. Contentable.ai is an end-to-end testing platform for generative AI. It allows users to A/B test multiple AI models, compare speed, costs, and outputs, and build and deploy low-code AI models. It supports major AI vendors and facilitates rapid prototyping and collaboration on AI models.

CopilotChat simplifies code generation using Test-Driven Development (TDD). CopilotChat is designed to simplify code generation with the Test-driven development (TDD) process. Developers can easily specify their test cases and let CopilotChat generate code that not only fulfills their needs but also passes through validation. Copilot Chat iteratively interacts with LLM to refine the code until all test cases pass.

Autonomous AI sidekick that iterates and tests code in a safe environment. Otto Engineer is an autonomous AI sidekick that iterates and tests its own code until it works, using Web Containers to execute code safely in an isolated environment. Otto can install npm packages & work across multiple files, and requires zero setup!

AI/ML interview preparation platform with coding challenges and mentorship. AIgrind.me offers comprehensive AI/ML interview preparation with coding challenges, trending MCQs, and personalized mentorship from industry leaders. It helps reinforce skills and stay ahead with real-time feedback and expert guidance. The platform features a coding platform and expert mentorship to master interview prep and land your dream ML job.