Research collection
#activation-sparsity
Research tagged activation-sparsity: explanations, evidence, limitations and connections between papers.
1 results
BitSparse stores sparse feed-forward activations with less memory
BitSparse compresses exact-zero feed-forward activations, reducing measured memory in two language models.