#depth-conditioned-normalization

Research tagged depth-conditioned-normalization: explanations, evidence, limitations and connections between papers.

1 results

1. PaperMachine Learning

   LayerRoPE turns layer depth into a signal for Transformer blocks

   LayerRoPE generates Transformer normalization gains from shared, depth-adjusted values and had the lowest C4 validation loss at tested scales.

   Added to Chiosa Oct 08, 2026