Vannus / Catalog / LiteLLM

LiteLLM B- Durable

Graded B- on resilience. In Vannus's assessment it has not disclosed which model it runs — resilient — owns model IP or routes across providers.

Open-source LLM gateway and proxy from BerriAI. Presents one OpenAI-compatible API in front of many model providers, with virtual keys, per-team budgets and rate limits, cost tracking, routing and fallbacks, and a management UI. Self-hosted via Docker or pip on Kubernetes, AWS, GCP or Azure; the enterprise tier adds SSO/SAML and audit logging.

infrastructure, open-source, AI
Model provenance

Not disclosed. LiteLLM does not publish which model it runs, so this criterion is excluded and the grade rests on what we could verify. We say so rather than guess.

Who controls it

Not yet assessed. We publish a sovereignty position only where the vendor documents one — we do not infer it from a domain or a company name.

How this grade is set

Vannus grades LiteLLM against nine dimensions of trust — data sovereignty, training privacy, compliance posture, operational resilience, exit portability, and more. The heaviest criterion asks whether the tool builds its own AI or resells someone else's model; where the vendor discloses it, the grade cites the vendor's own documentation. No paid placements — scoring is walled off from affiliate revenue. See the methodology →

Related tools we grade
Visit LiteLLM ↗ Grade your whole stack →