Blog

Topic

#reliability

8 articles

Three separate lifecycle tracks for an interactive CLI, a managed background server and an optional updater

Codex CLI’s Background Server: Why It Starts and What Opting Out Stops

Leo Kaka
Hand-drawn warehouse of sealed sandbox crates, with one narrow network pipe escaping under a wall

DeepSeek DSec runs 3 million agent sandboxes a day. The useful lesson is where the work survives

Leo Kaka
Four clocks of different designs mounted on one wall, each showing a different time; one has a yellow pendulum.

How to measure the latency an LLM gateway adds: six questions to ask before you believe a number

Leo Kaka
Hand-drawn ink illustration: a wooden counter with a person on each side and five objects along it, each caught at a different point of being handed over — a ring of yellow keys still held on the near side, a folded contract half-slid across with a corner in each hand, a sealed conduit resting exactly on the centre line, a brass alarm bell already on the far side, and a toolbox under the far person's hand.

Is a self-hosted LLM proxy better than a managed LLM gateway? Five things that change hands, and what each costs you

Leo Kaka
Hand-drawn ink illustration on warm paper: four brass mail-sorting chutes above one shared tray. Three drop their letters into their tray slots; the fourth diverts its letter out of a small side hatch, leaving its tray slot empty. A single small yellow flag stands on the machine.

Multi-provider failover across LiteLLM, Portkey, OpenRouter and Cloudflare: four decisions the docs make for you

Leo Kaka
Matrix of failover trigger conditions across seven LLM gateways: 5xx, timeouts and 429 are covered everywhere, by default or opt-in; 404 is opt-in or unstated in most; the row for a 200 whose provider state changed is empty in every column, with Portkey's guardrail path as the one partial exception noted in the text

Automatic failover in LiteLLM, Portkey and OpenRouter: what actually triggers it, and the 429 no gateway tracks

Leo Kaka
GitHub's own growth charts from the August 17 post-mortem: merged pull requests, commits and new repositories per month, 2023–2026 (The GitHub Blog)

Retry storms: 9K to 100K RPS, and four rules that stop them

Leo Kaka
Cover: your provider's billing system is part of your failure domain

Tier 3 to Tier 1 mid-flight: the outage no 5xx will catch

Leo Kaka