How to Build the Future: Demis Hassabis
In a Nutshell
Demis Hassabis outlines unsolved AGI challenges like continual learning, long-term reasoning, and memory, predicting AGI around 2030 via scaling RL/search (e.g., AlphaGo ideas), agent systems, model distillation into efficient open models like Gemma, and multimodal Gemini for robotics/world models. DeepMind's breakthroughs like AlphaFold (now expanding to virtual cells and drug discovery at Isomorphic Labs) exemplify AI's potential to solve massive combinatorial problems in science, with similar transformations imminent in materials, math, and climate. Advice for builders: pursue deep tech intersections with AI, leverage 10-year journeys accounting for midway AGI, and target clear objectives with simulators for Alpha-style wins.
These notes were generated by AI and may contain inaccuracies.
Continual learning, long-term reasoning, some aspects of memory remain unsolved and are required for AGI. AGI timeline around 2030 means deep tech journeys must account for AGI appearing midway. Active systems that solve problems are needed to reach AGI; agents are the path and just getting started.
Demis Hassabis's career: chess prodigy, designed first hit video game Theme Park at 17, PhD in cognitive neuroscience, published foundational work on memory and imagination in the brain, co-founded DeepMind in 2010 to solve intelligence. Achievements: AlphaGo beat world champion at Go, AlphaFold cracked protein structure prediction (50-year grand challenge in biology, given away free to every scientist, won Nobel Prize in chemistry last year). Now leads Google DeepMind building Gemini toward AGI.
Components like large-scale pre-training, RLHF, chain of thought will be part of final AGI architecture; they've proven capabilities and won't be dead ends. Missing: continual learning, long-term reasoning, some memory aspects, system consistency. These may require scaling existing techniques with innovation or one or two big ideas (50/50 chance). Google DeepMind works on both.
Current continual learning uses duct tape like dream cycles. Brain integrates new knowledge via hippocampus during sleep, especially REM, replaying important episodes. DeepMind's first Atari program DQN (2013) used experience replay from neuroscience, replaying successful trajectories. Shoving everything into context window is unsatisfying; even with millions/tens of millions token context (perfect recall), lookup cost for relevant info is non-trivial.
Sign in to read the full notes
Get access to AI-generated notes, topic timestamps, and more.