Research collection
#optimizer-state
Research tagged optimizer-state: explanations, evidence, limitations and connections between papers.
1 results
Binary models can train with small update buffers
Error Diffusion trains binary language models with small update buffers, with results bounded to tested tasks and sizes.