Blog

Topic

#local-llm

2 articles

Dumbbell chart of bartowski's Nemotron-3.5-Lightning GGUF files: bits per weight the filename claims against bits per weight measured from the tensor table, every k- and i-quant rung landing at or above a 4.5 bpw floor

Why your IQ2 GGUF is the same size as IQ4: the 256-block fallback in llama-quantize

Linden Kern
Path diagram: model tokens become Qwen3 Coder XML, enter the vLLM tool parser, reach a highlighted eval() call and then the host; below it a version bar showing eval() present from v0.10.0 through v0.10.1 and removed in v0.10.1.1

Is the vLLM tool-call parser safe? CVE-2025-9141, the 29-day eval() window, and four checks a gateway owes you

Leo Kaka