Energy-Based Transformers: The 1982 Architecture Finally Got Compatible Training Tricks
An EBM finally crossed 800M parameters without collapsing. Nobody has independently reproduced the 35% scaling claim. Both halves matter.
Writing
Newest firstThe Post-Transformer Era: State Space Models, Mamba, and What Comes After Attention
A practitioner's guide to Mamba and State Space Models — how selective state spaces achieve linear scaling, when to use SSMs vs Transformers vs hybrids, and production-ready models.