20VC: DeepMind's Demis Hassabis on Why AGI is Bigger than the Industrial Revolution | Why LLMs Will Not Commoditise & We Have Not Hit Scaling Laws | Bottlenecks in AI & The Energy Crisis Caused By AI | Whether AI Will Do More to Harm or Help Inequality
Key Takeaways
- β’
AGI arrival is likely within five years
βI would say there's a very good chance of it being within the next five years.β
- β’
Compute remains the primary bottleneck for AI
βCompute is the big one... the cloud is our workbench basically.β
- β’
Scaling law returns remain substantial despite slowing
βI would say the returns are kind of still very substantial, although they're a bit less than they were obviously at the start of all of this scaling.β
- β’
AI currently lacks human-like continuous learning
βThese systems don't learn after you finish training them, after you put them out into the world. They're not very good at learning further things.β
- β’
AGI will dwarf the Industrial Revolution's impact
βI sometimes quantify like AGI, the coming of AGI is like 10 times the industrial revolution at 10 times the speed.β
Episode Description
Demis Hassabis is the Co-Founder & CEO of Google DeepMind - working on AGI, responsible for AI breakthroughs such as AlphaGo, the first program to beat the world champion at the game of Go; and AlphaFold, which cracked the 50-year grand challenge of protein structure prediction and was recognised with the 2024 Nobel Prize in Chemistry. Demis is revolutionising drug discovery at Isomorphic Labs. Ultimately, trying to understand the fundamental nature of reality. AGENDA: 00:04:00 β What Actually Counts as AGI; and Where Are We Today? 00:05:00 β What Are the Biggest Bottlenecks Holding AI Back Today? 00:06:00 β Have We Hit the Limits of Scaling Laws? 00:07:00 β Where Is AI Ahead of Expectations; and What's Still Missing? 00:07:30 β Why Can't AI Systems Learn Continuously Like Humans? 00:08:30 β How Did DeepMind Go from Behind to Leading the Pack? 00:11:00 β Are We Heading Toward Model Commoditization; or Winner-Takes-All? 00:12:00 β What Does the Future of Open Source Really Look Like? 00:13:00 β What Does a Post LLM World Look Like? 00:14:45 β Can AI Really Fix Drug Discoveryβand Cut the 10-Year Timeline? 00:17:00 β What Does "Good" AI Regulation Actually Look Like? 00:18:00 β Who Should Be the Ultimate Arbiter of Truth in an AI World? 00:19:30 β If Demis Had One Shot to Fix AI Safety, What Would He Do? 00:21:00 β Is This Time Different for Jobs; or Will History Repeat Itself? 00:22:00 β Is AGI Bigger Than the Industrial Revolution; and Faster? 00:23:00 β Are We Underestimating AI Despite All the Hype? 00:23:30 β Does AI Lead to Massive Inequality; or Universal Prosperity? 00:24:30 β How Do We Solve the Energy Crisis Created by AI? 00:26:00 β Why Stay in the UK Instead of Moving to Silicon Valley? 00:28:00 β Will Europe Ever Build a Trillion-Dollar Tech Giant? 00:29:30 β Meeting Elon Musk for the First Time? 00:31:00 β What Big Questions About AI Is No One Talking About? 00:31:30 β What Does Demis Want His Legacy to Be?
