#deep learning optimization
Deep Learning Optimization: 2 AI articles covering deep learning optimization news, analysis, and research
Articles
Designing High-Performance GPU Kernels with TileLang:⭐9
Learn to design high-performance GPU kernels with TileLang: tensor-core GEMM, fused softmax, FlashAttention, and autotuning. Includes benchmarks against PyTorch...
The Active Ingredient in Muon's Grokking⭐8
Ablation study reveals Muon's grokking speedup comes from orthogonalization, not spectral constraints. Newton-Schulz iteration reduces spectral norm by