FFmpeg: The Incredible Technology Behind Video on the Internet | Lex Fridman Podcast #496
In a Nutshell
FFmpeg and VLC power nearly all internet video (YouTube, Netflix, Chrome), built by volunteer open source communities excelling in handwritten assembly (e.g., dav1d's 240k lines, 80% assembly outperforming compilers 62x) for decoding on 3 billion devices, rejecting backdoors, millions in buyout offers, and corporate exploitation to stay ad-free and robust. Key takeaways: Handcrafted low-level C/assembly optimizes every CPU cycle amid stagnant hardware; maintainers (10-15 core) demand excellence via harsh reviews, enabling bit-exact support for obscure codecs through reverse engineering; intertwined projects like x264 democratize pro video tools, preserve archives eternally, and pioneer ultra-low-latency streaming (Kyber) for robots/drones. Future-proof ethos: Passion-driven contributors (including teens) prioritize maintainability, psychovisual quality over PSNR, and royalty-free codecs (AV1/AV2), ensuring multimedia survives 1000+ years as humanity's Rosetta Stone.
These notes were generated by AI and may contain inaccuracies.
Excellent code defines the community regardless of contributor background. Contributors come from diverse, often introverted backgrounds.
FFmpeg is one of the biggest CPU users worldwide. Every sentence about it represents someone's lifetime work, with books written on each aspect. Complexity is inordinate. FFmpeg has 100,000 lines of assembly for all codecs; one codec alone has 240,000 lines. Every cycle matters, running on 3 billion devices decoding video nonstop. 30% of Netflix video is AV1, 50% of YouTube.
Peak video codecs: 79.9% assembly, 19.6% C, 0.5% other.
Tweets showing these facts provoke outrage for two years: intrinsics, compiler auto-vectorization are claimed sufficient, but hundreds of handwritten assembly examples prove otherwise.
Intelligence agencies asked to backdoor VLC; response was firm no, would shut down software instead.
Regrets are attacks on your mind.
Conversation with Jean-Baptiste Kempf (president of VideoLAN, key figure in VLC and FFmpeg) and Kieran Kunhya (codec engineer, FFmpeg contributor, FFmpeg Twitter/X account).
FFmpeg: open source backbone for YouTube, Netflix, Chrome, VLC, Discord, every video/audio platform. Decodes, encodes, transcodes, streams, plays almost any format. Built by volunteers.
VLC: open source media player for any format/platform, no ads/tracking. Downloaded over 6 billion times. Iconic traffic cone logo.
Modern civilization rests on volunteer software obsessed with engineering craft, not fame/money. Open source infrastructure enables billions consuming video daily via invisible machinery.
Sign in to read the full notes
Get access to AI-generated notes, topic timestamps, and more.