Research collection
#kv-cache-compression
Research tagged kv-cache-compression: explanations, evidence, limitations and connections between papers.
1 results
A cache compressor rehearses likely answers before questions arrive
Attic-KV rehearses likely quoted answers and context anchors to improve cache compression before future questions are known.