Human-in-the-loop 11

Intelligent LLM router and interaction layer for cost-effective AI task management. Toto is an intelligent routing layer and interaction platform designed for the human-agent world model. It optimizes LLM usage by automatically directing tasks to the most cost-effective and capable models from major vendors like OpenAI, Anthropic, and Google. Beyond cost optimization, Toto serves as a bidirectional state management layer where humans and AI agents can interact in a shared, real-time environment. It helps businesses avoid wasting money on expensive 'top-tier' models for simple tasks by scoring model capability against specific needs, ensuring the right model is used for the right prompt.

Enterprise translation AI that adapts and improves from corrections. ModernMT is an enterprise translation AI that improves from corrections and adapts to the context of the document, providing high-quality machine translation. It offers dynamic adaptation for unprecedented quality, human-in-the-loop innovation with AI, and is fast, scalable, cost-effective, and easy to manage.

Full-stack Vercel AI SDK patterns for building AI applications. ai sdk agents provides full-stack Vercel AI SDK patterns for building advanced AI applications. It offers customizable, headless, and production-ready components for functionalities like tool calling, streaming, workflows, human-in-the-loop, and agents. Built with modern web technologies such as React 19, Next.js 15, TypeScript, Tailwind CSS, and shadcn/ui, it supports various AI providers including OpenAI, Anthropic Claude, and Google Gemini. The platform enables developers to quickly ship AI features by providing copy-paste code for chat interfaces, agent orchestration, and multi-step workflows.

Global marketplace for vetted human AI data experts and managed labeling services. OpenTrain AI is a global freelance marketplace that connects existing annotation tools with vetted human data experts worldwide. It enables users to directly hire specialized human data experts for any AI training need, reducing costs, maintaining control, and quickly building high-quality AI training data. The platform supports integration with any data labeling software and offers secure global payments. Additionally, OpenTrain AI provides a fully-managed service where in-house experts handle end-to-end AI data labeling projects.

A no-code platform to build, deploy, and manage AI agents for various use cases. MindStudio is a platform designed to build powerful AI agents without coding. It caters to individuals, teams, and enterprises, offering a visual builder with over 100 templates for various business and personal use cases. It allows for AI-native workflow automation and can be integrated into other systems via APIs and Webhooks. MindStudio supports the creation, deployment, and management of AI-native Agents, enabling users to automate processes and increase operational efficiency.

Moxo is an AI workflow automation platform for business operations. Run processes with humans, AI agents, and systems, across your departments and beyond your walls. Moxo is an AI workflow automation platform for business operations. People and AI agents work the same flow: agents handle the running work, people make the calls that need judgment, and the process runs end to end, across your departments and beyond your walls. Agents prepare documents, chase what's overdue, route work, and monitor progress. Build them in Agent Foundry or bring your own, grounded in your playbooks, no code needed. Choose the model for each task or let Moxo route it automatically, and every run shows its cost and token spend, so you can optimize your AI costs. Agents are graded on real outcomes, not answers, so they get sharper with every run. Moxo is human-in-the-loop automation with supervision and observability built in: decisions that need accountability route to a person, supervisor agents monitor work live, and decision tracing gives you a full audit trail of every run: what the AI saw, what it recommended, what the human decided. In Moxo, building and editing a flow, even at runtime, is as simple as chatting with your AI colleague. Everyone works the same Moxo flow: your teams across departments, your clients, vendors, and partners beyond your walls. Outside participants take action through magic links, with no account needed. Moxo orchestrates the systems you already run, including HubSpot, Salesforce, DocuSign, and Slack, with MCP support and enterprise-grade security (SOC 2 Type II and more).

AI content editing service with human and expert review for enhanced quality and trustworthiness. Eye2.ai offers human-in-the-loop and expert-in-the-loop services, integrating human excellence with cutting-edge AI technologies. It provides AI Content Editing Services where AI-generated content is assessed and enhanced by expert human editors. The service focuses on refining words, structuring sentences, fact-checking, and more, ensuring AI-generated text is ready for publishing. Eye2.ai provides certification for the quality and trustworthiness of the edited content and promises fast delivery within 24 hours.

TypeScript framework for building, deploying, and observing AI agents Mastra is an open-source TypeScript framework for building, deploying, observing, and improving AI agents and AI-powered applications. It provides agent development tools, typed workflows, memory, workspaces, MCP support, human-in-the-loop functionality, model routing, and built-in observability. Developers can use Mastra with React, Next.js, Node.js, Hono, and other JavaScript or TypeScript environments to create internal automation agents, customer-facing assistants, developer platforms, and multi-step workflow applications. Mastra projects can be self-hosted under the Apache 2.0 license or deployed through Mastra Platform with managed infrastructure, monitoring, storage, and enterprise capabilities.

Platform to create AI agents for workflow automation across 100+ apps. Relay.app is a platform to create AI agents that work for you across 100+ apps. It offers workflow automation beyond triggers and actions with one-click AI assistance, human-in-the-loop collaboration, and a multiplayer experience. Users can connect Gmail, Slack, Notion, and 100+ other apps in minutes to automate tasks.

API to automate Windows apps using AI. Pig is an API to launch and automate Windows apps using AI. It allows users to connect their Windows machines to the system and instruct Pig's agent to run automations (click, key entry) using a familiar AI chat interface or build their own agents with the SDK. Pig makes it easy to build complex automations, powered by AI.

AI data factory for building, operating, and staffing AI data. Labelbox is a comprehensive AI data factory that provides software and services to help AI teams build, operate, and staff their data operations. It is designed to generate high-quality training data at scale for any AI project and to evaluate AI model performance. Labelbox offers a complete set of data solutions for modern AI and ML development, serving companies from startups to Fortune 500s.