By author · Zhiyun Shi
NLP & Language
Papers in NLP & Language published by Zhiyun Shi.
1 results
A cache compressor rehearses likely answers before questions arrive
Attic-KV rehearses likely quoted answers and context anchors to improve cache compression before future questions are known.