Artificial Intelligence

After Transformer, What Exactly Is AI Improving?

Starting from Transformer's enduring dominance, this article examines where AI has actually advanced in recent years: scaling, data, training, MoE, FlashAttention, test-time compute, Mamba, and more.