Research collection
#inference-memory
Research tagged inference-memory: explanations, evidence, limitations and connections between papers.
4 results
Evoke uses bounded scene memory for long-video sessions
Evoke combines bounded scene recall with long-horizon training; tests show a specific brightness-stability gain, not universal consistency.
A cache compressor rehearses likely answers before questions arrive
Attic-KV rehearses likely quoted answers and context anchors to improve cache compression before future questions are known.
TokenRouter helps models hand off requests without restarting work
TokenRouter coordinates model handoffs and raised output-token rates over existing systems in tested workloads.
SoftmaxLift reduces key retrieval for long-context attention
SoftmaxLift augments keys and queries to estimate attention with one exact search index and O(1/ฮตยฒ) retrieved keys.