MoE 2

DeepSeek is an AI company providing foundation models and APIs for AI applications. DeepSeek is an AI company founded in 2023, focusing on developing leading general artificial intelligence foundation models and technologies. They have released and open-sourced several large-scale models with billions of parameters, including DeepSeek-LLM, DeepSeek-Coder, and DeepSeek-MoE. DeepSeek provides APIs for accessing their models, allowing users to integrate AI capabilities into their applications.

Open-source AI models from OpenAI, free for developers. GPT-Oss offers OpenAI's 120B and 20B open-source language models, designed to be run locally with a Mixture of Experts (MoE) architecture. It is free for developers and provides powerful AI capabilities with features like a 131k context window, hardware flexibility (H100 GPUs or consumer hardware), and a privacy-first approach by running entirely on user hardware. It aims to bring advanced AI to the open-source community, enabling natural conversations, code generation, and complex reasoning.