Skip to main content

AI Proxy

Deploy and configure OpenLM AI Proxy to track LLM usage and feed AI FinOps reporting.

AI ProxyOpenLM AI Proxy is a self-hosted gateway that routes LLM API requests and tracks token usage for AI FinOps.
System requirementsHost, runtime, and network requirements for deploying OpenLM AI Proxy.18d ago2 min
Deploy AI ProxyDeploy OpenLM AI Proxy as a Docker Compose stack in your own network.17d ago3 min
Configure AI ProxyConnect AI Proxy to OpenLM Platform, set up LLM providers, and route clients through the proxy.18d ago4 min