Research collection
#communication-overlap
Research tagged communication-overlap: explanations, evidence, limitations and connections between papers.
1 results
FlashMask-3 speeds structured attention across GPUs
FlashMask-3 coordinates structured attention masks across Hopper GPUs and raised throughput in one large-model training setup.