1 story · sorted newest first · 📡 RSS
Recent advancements in key-value cache quantization, such as NVFP4 and FP8, have led to significant improvements in memory usage a
