THE VIDEO SHELF · ai scaling laws
AI can't cross this line and we don't know why.
A Welch Labs explainer on neural scaling laws and the compute-efficient frontier, asking why model loss seems to hit a line it cannot cross. It draws an analogy to an ideal gas law for AI.
Why HN readers recommended it
Recommended as a well-made, digestible introduction to scaling laws and why models cluster along a similar efficiency frontier.
This is a summary from the source dataset, not an endorsement by Hacker News or the video creator.
Video & recommendation details
- Creator / channel
- Welch Labs
- Topic
- ai scaling laws
- Format
- explainer
- Level
- intermediate
- HN recommenders in dataset
- 2
- HN mentions in dataset
- 5
- Recommendation years in dataset
- 2024–2025
These counts and years describe the included Hacker News records; they are not YouTube views or the video’s publication date.
From the original HN conversations
Excerpts from the recorded comments. Follow each source for the full comment and surrounding discussion.
Please someone correct me if I’m wrong, but my understanding of ML/LLMs is that this kind of hand crafting has been tried, but it is easier to train/less finicky to let behavior like this emerge from more data, see [1] “Bitter Lesson” and [2] “Scaling …
kla-s on Hacker News · 2024-10
In Zamba2-7BI'm not deep enough in the ecosystem to ingest that paper but it's title reminded me of an interesting video I saw recently: "AI can't cross this line and we don't know why" [VIDEO]
mdaniel on Hacker News · 2025-08
In Break the quadratic wall of Transformer attention: WERSA, paper+code open source
Summaries, classifications and recommendation records are from the HackerTube source dataset. Read about this library and its limitations.