Research collection
#token-selection
Research tagged token-selection: explanations, evidence, limitations and connections between papers.
3 results
Choosing fewer, better tokens improves distillation
DIAL-OPD ranks response tokens by disagreement and probability, improving mean accuracy over full-token distillation in math tests.
SoftmaxLift reduces key retrieval for long-context attention
SoftmaxLift augments keys and queries to estimate attention with one exact search index and O(1/ฮตยฒ) retrieved keys.
A rule for splitting images can preserve object-finding recall
A theory and overlapping-view rule explain when splitting large images can preserve object-finding recall under stated conditions.