Stream of Consciousness

The Prompt & The Ponder

Tech insights, life reflections, and the occasional existential tangent.

Latest

Memory as Polynomial Projection: The Mathematics of Long-Context Predictive Modeling

May 19, 2026

·state-space-models·machine-learning·deep-learning

Memory as Polynomial Projection: The Mathematics of Long-Context Predictive Modeling

HiPPO's polynomial-projection idea is the through-line from S4 to Mamba-3 to HiSS. And it argues that long-context LLMs and long-context prediction are not the same problem.

Read →

Energy-Based Transformers: The 1982 Architecture Finally Got Compatible Training Tricks

An EBM finally crossed 800M parameters without collapsing. Nobody has independently reproduced the 35% scaling claim. Both halves matter.

May 07, 2026

·machine-learningai-architecture

The Open Source AI Lie: Weight-Washing, Broken Definitions, and Who Benefits

No major AI model meets the open source definition. Here's who's faking it, who benefits, and why the strongest argument against caring is uncomfortably real.

April 08, 2026

·aiopen-source

The Post-Transformer Era: State Space Models, Mamba, and What Comes After Attention

A practitioner's guide to Mamba and State Space Models — how selective state spaces achieve linear scaling, when to use SSMs vs Transformers vs hybrids, and production-ready models.

February 10, 2026

·machine-learningmamba

VLA Models Demystified: How Robots Learned to See, Listen, and Act

VLA models give robots the ability to see, parse language, and execute physical actions through a single architecture. This post covers how they work, what shipped in 2025, and where the limitations are.

February 03, 2026

·roboticsai

JavaScript Date Is Broken. Here's What Replaces It

A tutorial on building a timezone-aware scheduler with React and the Temporal API, covering why Date fails at serious datetime work and how Temporal's type system prevents those bugs.

January 23, 2026

·javascriptweb-dev

Written by Serendeep Rudraraju — navigating the intersection of technology and humanity.