The Prompt & The Ponder

Writing

Newest first

May 19, 2026

Memory as Polynomial Projection: The Mathematics of Long-Context Predictive Modeling

HiPPO's polynomial-projection idea is the through-line from S4 to Mamba-3 to HiSS. And it argues that long-context LLMs and long-context prediction are not the same problem.

state space models machine learning

February 10, 2026

The Post-Transformer Era: State Space Models, Mamba, and What Comes After Attention

A practitioner's guide to Mamba and State Space Models: how selective state spaces achieve linear scaling, when to use SSMs vs Transformers vs hybrids, and production-ready models.

machine learning mamba