RateQuant: Optimal Mixed-Precision KV Cache Quantization via Rate-Distortion Theory https://arxiv.org/abs/2605.06675 #math.IT #cs.LG #cs.CL #cs.IT
QOTO: Question Others to Teach Ourselves An inclusive, Academic Freedom, instance All cultures welcome. Hate speech and harassment strictly forbidden.
