Stream of Consciousness

The Prompt & The Ponder

Tech insights, life reflections, and the occasional existential tangent.

Latest

Energy-Based Transformers: The 1982 Architecture Finally Got Compatible Training Tricks

May 07, 2026

·machine-learning·ai-architecture·energy-based-models

Energy-Based Transformers: The 1982 Architecture Finally Got Compatible Training Tricks

An EBM finally crossed 800M parameters without collapsing. Nobody has independently reproduced the 35% scaling claim. Both halves matter.

Read →

Written by Serendeep Rudraraju — navigating the intersection of technology and humanity.