THE VIDEO SHELF · stream processing and event logs
"Turning the database inside out with Apache Samza" by Martin Kleppmann
Martin Kleppmann argues that databases are global shared mutable state and proposes treating them as an ever-growing log of immutable facts. Derived data such as caches, indexes and views is then built by stream processors like Apache Samza. The talk draws on Kafka and LinkedIn's experience with commit logs.
Why HN readers recommended it
Commenters repeatedly cite it as the talk that reframed how they think about caching, derived data and event sourcing.
This is a summary from the source dataset, not an endorsement by Hacker News or the video creator.
Video & recommendation details
- Creator / channel
- Strange Loop Conference
- Topic
- stream processing and event logs
- Format
- talk
- Level
- intermediate
- HN recommenders in dataset
- 9
- HN mentions in dataset
- 15
- Recommendation years in dataset
- 2015–2025
These counts and years describe the included Hacker News records; they are not YouTube views or the video’s publication date.
From the original HN conversations
Excerpts from the recorded comments. Follow each source for the full comment and surrounding discussion.
Since this is taking off a bit: Here's an excellent talk that provides some context to the Confluent article, and takes us through the thought process of simplifying convoluted database-cache-user interactions by thinking in terms of streams of derived data: [VIDEO] . Also highly recommended.
btown on Hacker News · 2015-04
In How Sift Science Rebuilt Its App on React and DropWizardYes, I like to think of it as as the transaction log without any of the logic. If you’re interested, I can highly recommend Martin Kleppmann’s talk “Turning the database inside out” [VIDEO]
lbradstreet on Hacker News · 2018-05
In GCP and Confluent partner to deliver a managed Apache Kafka serviceThe talk on "Turning the database inside-out" [0][1] by the author, Martin Kleppmann, is a fantastic intro to these dynamics, and it's something I'll always recommend to both experienced and inexperienced data modelers and backend developers. It goes pedagogically through the way things are typically …
btown on Hacker News · 2019-05
In Ask HN: What overlooked class of tools should a self-taught programmer look into
Summaries, classifications and recommendation records are from the HackerTube source dataset. Read about this library and its limitations.