Skip to main content

Blog

Insights on routing, reliability, and observability from the team building the most widely used open-source AI gateway.

openai

GPT-6.1 Terra API Pricing and Day 0 Support on LiteLLM

GPT-6.1 Terra costs $1 per 1M input tokens and $5 per 1M output tokens, half the price of GPT-6.1 Sol. LiteLLM supports it on day 0.

providers

OpenCode Go is now a LiteLLM provider

Use your OpenCode Go subscription through LiteLLM. Connect once, route models to the right API, preserve sessions, and track estimated usage.

security

The attack chain behind the v1.107.0 LiteLLM release

How a master key committed to a public repository in May led to three stolen GitHub tokens and the compromised litellm v1.107.0 release, step by step.

engineering

Tokenize text across vLLM and Watsonx

Choose token counting for prompt budgets or /tokenize to inspect tokens. Use one request format across vLLM and Watsonx through LiteLLM.

security

Contained: Oct 21, 2026 LiteLLM release v1.107.0 Compromised

LiteLLM release v1.107.0 was compromised by a malicious actor.

engineering

JevRank: decision models through LiteLLM’s rerank API

Preview JevRank for low-cost reranking with Perplexity and TypeSafe decision models. Explore SciFact results, reproducible data and LiteLLM setup.

routing

Cache-Aware Routing for Self-Hosted Models

Route each agent session to the same vLLM pod on Kubernetes to reuse cached prompt prefixes.

typesafe

Day 0 Support: TypeSafe Jev 1.14: Adds images, box questions, and long context

TypeSafe Jev 1.14 reads images, answers box questions with coordinates and takes long-context requests. LiteLLM serves all three on /v1/systemone and /v1/decisions behind TypeSafe's opt-in headers.

openai

Decision models on LiteLLM: /v1/decisions and /v1/systemone

Decision models return probabilities instead of text, which makes routing, triage and guardrail checks cheap and deterministic. LiteLLM serves nine providers of them behind one request shape.

agents

Workshop: Build a self-hosted cloud agent.

Build a self-hosted cloud agent with the LiteLLM team. A two-week remote workshop, October 19–30, to build a working v0 and deploy an internal beta on your infrastructure.

gemini

Gemini 4 Argon API Pricing and Day 0 Support on LiteLLM

Gemini 4 Argon costs $2.00 per 1M input tokens and $10.00 per 1M output tokens until Nov 30. LiteLLM supports it on day 0 on AI Studio and Google Cloud.

announcement

October Townhall: Product + Roadmap Updates

Join the LiteLLM October townhall on Friday, 23 October at 7:30 AM PT to learn about LiteLLM's product updates and roadmap.

announcement

Introducing Microsoft 365 Copilot in LiteLLM

Use Microsoft 365 Copilot from your applications through LiteLLM, with access to your Microsoft 365 work data.