LLM Gateway 2

Security gateway for LLMs that detects and masks sensitive data and risky code. Cencurity is an enterprise-grade security gateway designed to proxy LLM and agent traffic. It functions by detecting, masking, and blocking sensitive data, PII, and risky code patterns in both requests and responses. The platform provides a centralized dashboard for real-time monitoring and recording of all interactions as audit logs. It is designed to be compatible with any LLM agent or IDE without requiring code rewrites, ensuring safe and governed AI integration for development teams.

LiteLLM: LLM Gateway for managing and accessing 100+ LLMs in OpenAI format. LiteLLM is an LLM Gateway (OpenAI Proxy) designed to manage authentication, load balancing, and spend tracking across 100+ LLMs, all while maintaining the OpenAI format. It simplifies the process of using LLM APIs from various providers like OpenAI, Azure, Cohere, Anthropic, Replicate, and Google. LiteLLM offers consistent outputs and exceptions for all LLM APIs, along with logging and error tracking for all models. It provides features like cost tracking, batches API, guardrails, model access, budgets, LLM observability, rate limiting, prompt management, S3 logging, and pass-through endpoints.