Podcast
#299 – Demis Hassabis- DeepMind
Lex Fridman Podcast
- Towards Generalization, I think it’s a Good Idea Language is our main generalization communication tool. But i don’t think it’s the only ar a modality that matters, so there’s going to be a lot of different ways to express capabilities other than just language. A gatto predicts potentially any action or any token. Really is our most general agent, one could call it, so far. That itself can be scaled up massively more than we’ve done so far. Transcript: Lex Fridman Yeah, maybe the better thing to test is the generalizability. So across multiple tasks, but I think it’s also possible as systems like Gado show that eventually that might map right back to language. So you might be able to demonstrate your ability to generalize across tasks by then communicating your ability to generalize across tasks, which is kind of what we do through conversation Anyway, when we jump around. Ultimately, what’s in there in that conversation is not just you moving around knowledge. It’s you moving around like these entirely different modalities of understanding that ultimately map to your ability to, to, uh, operate successfully in all of these domains, which You can think of as tasks. Demis Hassabis Yeah. I think certainly we as humans use language as our main generalization communication tool. So I think we end up thinking in language and expressing our solutions in language. So it’s going to be very powerful mode in which to explain, you know, the system to explain what it’s doing. But I don’t think it’s the only modality that matters. So I think there’s going to be a lot of, you know, there’s a lot of different ways to express capabilities other than just language. Lex Fridman Yeah, visual, robotics, body language. Yeah, actions, the interactive aspect of all that. Demis Hassabis That’s all part of it. But what’s interesting with Gato is that it’s sort of pushing prediction to the maximum in terms of mapping arbitrary sequences to other sequences and sort of just predicting what’s Going to happen next. So prediction seems to be fundamental to intelligence. And what you’re predicting doesn’t so much matter. Yeah, it seems like you can generalize that quite well. So obviously, language models predict the next word. Gato predicts potentially any action or any token. And it’s just the beginning, really. It’s our most general agent, one could call it so far. But, you know, that itself can be scaled up massively more than we’ve done so far. And obviously, we’re in the middle of doing that. But (Time 0:10:10)
- Is Language the Answer to the Problems of AI? The torring test will be the thing that truly impresses other humans. The big part of solving a g i is creating bench marks that help us get closer and closer. It feels like, in terms of the actual impact of general intelligence on the world, it feels like language will be the place where it truly shines. I think so, because it’s such an important kind of in output for us. Transcript: Lex Fridman The big part of solving AGI is creating benchmarks that help us get closer and closer, sort of creating benchmarks that test the generalizability. And it’s just still interesting that this fella, Alan Turing, was one of the first and probably still one of the only people that was trying, maybe philosophically, but was trying to Formulate a benchmark that could be followed. It is, even though it’s fuzzy, it’s still sufficiently rigorous to where you can run that test. And I still think something like the Turing test will, at the end of the day, be the thing that truly impresses other humans, so that you can have a close friend who’s an AI system. For that friend to be a good friend, they’re going to have to be able to play StarCraft and they’re going to have to do all of these tasks, get you a beer. So the robotics tasks, play games with you, use language, humor, all of those kinds of things. But that ultimately can boil down to language. It feels like not in terms of the AI community, but in terms of the actual impact of general intelligence on the world, it feels like language will be the place where it truly shines. Demis Hassabis I think so, because it’s such an important kind of input output for us. I think you’re right. I think the Turing test, the philosophy behind it, which is the idea of can a machine mimic the behaviors of a human? And I would say wider than just language and text. Then in terms of actions and everything else, creativity, all these things, then if it can match or exceed human cognitive capabilities, then I think we have a true intelligence. So from that perspective, you’re right. I think he did formulate the right kind of setup. I (Time 0:12:20)