The SAW-INT4 method, which uses token-wise INT4 quantization with block-diagonal Hadamard rotatio..., Sonic AI
“The SAW-INT4 method, which uses token-wise INT4 quantization with block-diagonal Hadamard rotation, consistently achieves the best accuracy-efficiency trade-off for 4-bit KV-cache quantization under practical serving constraints.”