All Topics
Topic
deep-learning
2 articles
Memory as Polynomial Projection: The Mathematics of Long-Context Predictive Modeling
HiPPO's polynomial-projection idea is the through-line from S4 to Mamba-3 to HiSS. And it argues that long-context LLMs and long-context prediction are not the same problem.
deep-learningmamba
May 19, 2026
·deep-learningmambaEnergy-Based Transformers: The 1982 Architecture Finally Got Compatible Training Tricks
An EBM finally crossed 800M parameters without collapsing. Nobody has independently reproduced the 35% scaling claim. Both halves matter.
deep-learningai-architecture
May 07, 2026
·deep-learningai-architecture