Will BDH replace Transformers? Post-Transformer AI Explained for Everyone
This AI thinks without words (no Chain of Thought!). Could it offer an alternative to today’s Transformer-based LLMs? In this video, we explore Pathway’s BDH ("Post-Transformer") architecture and BDH-CQ, the reasoning paper that topped Hugging Face’s August 2026 papers list. The makers of this model, Pathway, also shared separate pretraining experiments reaching 600 billion parameters, showing Transformer-like scaling. We start with the basics and explain latent reasoning, internal memory and