Research collection
#joint-token-prediction
Research tagged joint-token-prediction: explanations, evidence, limitations and connections between papers.
1 results
Text-to-image models can learn without text-only pretraining
Halcyon learns from paired captions and images; tests found no benefit from text-only pretraining in the specific settings studied.