Before Q, K, and V: Reconstructing the Transformer⭐9

Why Transformers need Q, K, V: Reconstructing the architecture from first principles reveals attention and MLPs as inevitable key-value stores.