Blog

Topic

#local-llm

5 articles

Editorial diagram of code moving through tools and verification, with a separate unfinished acceleration component

JetBrains Mellum2.1 turns a fast coding model into an agent worker

PiRouter Team
Editorial illustration of a large archive whose drawers all remain present while only a small subset is illuminated, symbolizing total model weights versus active parameters

Kolibri 1 is a 78B model—not a 3B download

PiRouter Team
Two different sorting machines deliver the same choice, with different costs and ownership

Jev vs GLM-5.3-Flash: similar accuracy, very different reasons to choose either

Linden Kern
Dumbbell chart of bartowski's Nemotron-3.5-Lightning GGUF files: bits per weight the filename claims against bits per weight measured from the tensor table, every k- and i-quant rung landing at or above a 4.5 bpw floor

Why your IQ2 GGUF is the same size as IQ4: the 256-block fallback in llama-quantize

Linden Kern
Path diagram: model tokens become Qwen3 Coder XML, enter the vLLM tool parser, reach a highlighted eval() call and then the host; below it a version bar showing eval() present from v0.10.0 through v0.10.1 and removed in v0.10.1.1

Is the vLLM tool-call parser safe? CVE-2025-9141, the 29-day eval() window, and four checks a gateway owes you

Leo Kaka