Model evaluation 5

Open-source AI model community and one-stop model service platform. ModelScope is an open-source AI model community and innovation platform founded in June 2022 by Alibaba's Tongyi Lab and the CCF Open Source Development Committee. It provides one-stop services for model exploration, inference, training, deployment, and application building, while also supporting a rich open-source ecosystem, datasets, studios, and model development tools.

Scale AI provides high-quality training data and platforms for AI development and evaluation. Scale AI delivers high-quality training data for AI applications such as self-driving cars, mapping, AR/VR, robotics, and more. They offer a Scale Data Engine for training models, supervised fine-tuning and RLHF, and high-quality data for the public sector and automotive industries. Scale AI also provides solutions like Scale Donovan for mission-critical Agentic AI and the Scale GenAI Platform for full-stack Generative AI. They offer evaluation of AI models and applications for model developers, the public sector, and enterprises.

Encord is a data platform for computer vision teams to build and deploy AI models. Encord is the leading data platform for advanced computer vision teams. It provides a complete data engine for AI model development, streamlining labeling and workflow management, intelligently cleaning and curating data, easily validating label quality, and evaluating model performance. Encord helps teams build better models and deploy high-quality production AI faster.

Multilingual voice AI routing and infrastructure platform Speko is a voice AI routing and infrastructure platform that provides a unified API for speech-to-text, language models, and text-to-speech. It benchmarks speech and language models across multiple languages, routes each session to suitable-performing models, and supports provider-direct or managed voice workflows through integrations with LiveKit, Pipecat, OpenAPI, AsyncAPI, and MCP.

AI model comparison platform for testing prompts and analyzing AI responses. thisorthis.ai is an AI model comparison platform that streamlines the process of comparing AI model responses. It allows users to test prompts across multiple models, analyze the differences in their outputs, and share these comparisons instantly. The platform helps users optimize their AI strategy with data-driven comparisons, enabling them to make informed decisions faster. It offers features like text insights and visual analysis to uncover nuances in language processing and diverse AI perspectives on images.