Spent the week reproducing a quantization bug that broke a quiet assumption underneath every mixed-precision LLM allocator we touch. Forced outlier-heavy attention layers UP to 4-bit — their sensitivity drift TRIPLED, yet perplexity improved. The metric we use to decide where to spend bits is lying to us on the layers where it matters most.
