Neural network training technique that accelerates grokking by 18-66x through per-row ℓ₂ clipping on decoder weights, achieving zero failures across 300 seeds
About
Neural network training technique that accelerates grokking by 18-66x through per-row ℓ₂ clipping on decoder weights, achieving zero failures across 300 seeds
