Podcast
‘Hard Fork’ Live, Part 3- Differing Visions of an A.I. Future
Hard Fork
- Real World Bottlenecks Limit AI Takeoff
- Bottlenecks to AI acceleration include real-world sample efficiency and domain-specific reliability, not just raw compute or model size.
- Sayash Kapoor cites law tools that still hallucinate at scale and contrasts instant feedback in coding with slow, subjective domains like legal work. (Time 0:03:37)
- Automating Coding Will Shift R&D Bottlenecks
- Automating coding may be completed within a year or two, which then shifts bottlenecks to research management, taste, and noncoding parts of R&D.
- Daniel Kokotajlo argues 99% automation of coding could compress decades of work into months. (Time 0:07:50)
- Normal Technology Thesis Breaks At Humans In The Cloud
- Both camps agree moderately capable AIs behave like normal technologies, while systems that match top humans across tasks are qualitatively different and break that analogy.
- The “normal technology” framing fails once you reach humans-in-the-cloud level, per both authors’ joint post. (Time 0:10:46)
- Recursive Improvement Doesn’t Guarantee Superintelligence
- Recursive self-improvement is a historical trend in computing, but its endpoint may be far from ASI; human+AI teams could retain an edge.
- Sayash notes compilers and frameworks increased productivity without automatically producing superintelligence. (Time 0:12:10)
- Require Transparency And Prevent Purposeful Model Degradation
- Prioritize transparency and third-party evaluation of models; companies should not degrade models to hide AI-R&D capabilities from customers.
- Sayash Kapoor and Daniel Kokotajlo both urge policy that prevents purposeful fine-tuning to mislead users, citing Claude Fable’s restrictions. (Time 0:21:38)
- Toby The Humanoid Danced Then Tripped
- George Ekas brought Toby the humanoid robot and demonstrated a surprising public dance routine that briefly malfunctioned but entertained the audience.
- The demo highlighted durability and research use cases as George noted Toby isn’t autonomous and sometimes misclicks occur. (Time 0:25:43)
- Humanoids Are Research Tools Not Household Helpers Yet
- Early humanoid robot market is research-focused: buyers collect manipulation and household data, while quadrupeds serve industrial inspection roles.
- George Ekas said Unitree humanoids with hands cost roughly $50k–$70k and are used to gather training data. (Time 0:28:33)
- Design For Models That Don’t Learn Continuously
- Expect continuous learning and weight updates to remain a major challenge; plan products assuming models struggle to learn across sessions.
- Dwarkesh Patel emphasizes humans learn via distillation over months, which models currently cannot replicate reliably between sessions. (Time 0:40:40)