BUILD AGI

“And we just kept scaling PPO and we exceeded the performance of the best humans. And that itself was the finding, right, that actually massive compute with simple algorithms, right, that that is something where we cannot just—it doesn't just work in theory, it works in practice. We can really make it happen and in this incredibly messy environment where you cannot program it, you just need this almost human like intuition.”

“What's actually required for AGI is the ability to keep learning after training and the move from pattern matching to understanding cause and effect.”

“In 2017, we started to think very hard about, first of all, how do we really achieve the mission? What will that look like? And we start to do the math on compute and you start to realize that it's gonna take a big computer. Elon, Sam, Ilya, and I all agreed that the only path forward for OpenAI, the only path to achieve the mission was to create a for profit entity associated with OpenAI of some form.”

“We had a mission, a vision of saying, we think that we can build human level AI, make it be something positive for the world, make the benefits be something that are distributed broadly, but how? And how do you get people to actually leave their jobs to come and join this thing? Initially, the set of people that I narrowed down to were actually Ilya, Dario, Amadai, Chrysola, and myself.”

“We came up with what I would really say is almost the technical plan that we have pursued for the past ten years. Number one, solve reinforcement learning. Number two, solve unsupervised learning. And number three, was gradually learn more complicated things. After that off-site, I sent offers to everyone and said, hey, we wanna get started in the next two to three weeks.”

“There are many moments along the way where you feel like it's real now, it's going to really happen. The economy is going to transform into this compute powered world. And I think that those moments are not yet at the end. I think that we have many more breakthrough moments where you realize that the next stage is possible.”

“What's actually required for AGI is the ability to keep learning after training and the move from pattern matching to understanding cause and effect.”