The Signal
The math just broke in favor of efficiency. @ylecun's amplification of the Platonic Representation Hypothesis (109M parameters beating 72B) signals a phase shift: architectural insight now compounds harder than raw parameter count. This inverts the last 18 months of frontier strategy. Concurrent with @bindureddy's observation that compute capital is starving other sectors—AI labs burning $340-400B in debt through 2027—the market is bifurcating. Frontier labs are doubling down on scale-as-moat while the practitioner layer (dev shops, integration firms, edge deployment) is discovering that JEPA-style world models and Energy-Based Models deliver parity or better at 1/100th the footprint. The winners going forward aren't the ones with the most GPUs; they're the ones with the best inductive bias.
What's Moving
- JEPA world models entering production parity — @ylecun flagging that separable training on any modality + provable convergence means you no longer need to pre-train on everything at once. Implication: smaller, specialized models outperform bloated foundationals on their domain. (via @ylecun, @askalphaxiv)
- Energy-Based Models (TEM) outscaling Diffusion — @ylecun: TEM now scales better than the reigning generation architecture. This is not incremental. This is a category shift in how you structure inference, especially for multi-step reasoning. (via @ylecun)
- Deterministic tests + agent feedback loops replacing instruction-tuning — @svpino: "Agents writing code faster than they can review it." The solution isn't better instructions; it's automated auditing loops (test → agent → rule → prevent recurrence). Small models with tight feedback beats large models with loose guardrails. (via @svpino)
- Compute financing crowding out Treasuries — AI capex now equals 30% of all Treasury issuance through 2027. This matters because it forces a reallocation: capital flowing to model labs is starving other sectors. Downstream: valuations compress for anyone betting on traditional SaaS ROI curves. (via All-In network)
Crosscurrents
- Frontier labs claiming physics breakthroughs while adoption stalls — @sama and @bindureddy signal OpenAI's Yang-Mills/ETH claims, but @bindureddy also flags the hard truth: most humans and companies restrict AI usage to "$20/month employee perk." The gap between research wins and operational adoption is widening, not closing.
- Pricing collapse hitting a floor that's still too high for most tasks — @bindureddy: "dozen models doing mundane work in six months," yet organizations aren't automating. This suggests the marginal task can be done by cheap models, but the organizational friction (workflows, liability, retraining) isn't solved by cheaper inference.
Tradecraft
Desk Notes
- @ylecun — Systematic dismantling of scale-only narratives; JEPA + EBM as post-LLM foundation
- @bindureddy — Tracking adoption friction + compute capital squeeze; skeptical of hype-to-value conversion
- @svpino — Operationalizing agent output via deterministic testing, not instruction tuning
- @emostaque — Scanning for open-weight model leaps (TEM, JEPA variants, 3D agents)