Secure, Open Source AI Gateway at any Scale
Secure, Scalable AI Gateway
Seamlessly Provide Secretless Zero Trust Access for Humans and Workloads to your AI LLM Providers without sharing API keys
Identity-based, L7 Aware Access Control
Identity-based, Context-aware based Routing and L7-aware Access Control to any AI LLM Provider via ABAC and Policy-as-Code using CEL and Open Policy Agent (OPA) on a per-Request basis.
Advanced, Extensible Request/Response Manipulation
Apply your Own Custom Identity-based, Context-aware Request/Response Manipulation, Guardrails, Semantic Caching and Rate Limiting with Lua Scripts and Envoy ExtProc Servers
Scalable Identity Management and Access via OAuth2
Unified, Stable Access for your Workloads written in any Programming Language to all your APIs via Standard OAuth2 Client-Credentials Flow without having to use Special SDKs
Integrate your OIDC/SAML SSO Providers
Instantly integrate your OpenID Connect and SAML 2.0 SSO Provider and Control Access for your Team based on their identity and even Request Body Content.
OpenTelemetry-Ready Visibility
OpenTelemetry-ready Layer-7 Aware, Real-Time Visibility and Auditing to Your Log Management and SIEM Providers
Centralized, Declarative and Programmable Management
Designed to be Administered like Kubernetes via DevOps/GitOps-friendly Centralized and Declarative Way. The Cluster is furthermore fully Programmable over gRPC.
Octelium is Free and Open Source Software