#bit-packing

VAR-Q: Tuning-Free KV Cache Quantization for VisualNEW⭐8

VAR-Q introduces tuning-free KV cache quantization for visual autoregressive image and video generation, cutting KV memory by up to 78.5% with negligible qualit...