Keep pulling the thread on Jerry Twerk.
Jerry Twerk has changed his mind and now believes that a static model can never be considered AGI, and that continual learning is a necessary component.
Jerry Twerk predicts a "ChatGPT-like moment" for the robotics space will occur in approximately two to three years.
The biggest limitation of current AI models is their inability to update their internal knowledge or beliefs based on failure, which prevents them from recovering when they get stuck on a problem.
Jerry Twerk believes a major risk for OpenAI is its attempt to pursue many difficult product areas simultaneously, as companies are typically unsuccessful at executing multiple hard things at once.
Jerry Twerk predicts that large AI companies will evolve into hyperscalers running their own data centers, while successful AI application companies will eventually need to train their own models.
Jerry Twerk left his position as VP of Research at OpenAI to pursue research areas that he felt were more difficult to explore within a large lab environment.
Scaling up pre-training for AI models yields real and predictable benefits, resulting in models that have a better understanding of the world and language.
Reinforcement learning is a highly effective method for making an AI model excellent at any specific skill, with Jerry Twerk stating there are "basically no limits."
Current AI models struggle to generalize and perform well on tasks or with knowledge that falls outside of their pre-training corpus or specific reinforcement learning training.
The quarterly release of improved AI models by major labs is primarily driven by scaling compute and, more importantly, adding new data targeted at the weaknesses of the previous model version.
Jerry Twerk believes a major AI breakthrough in biology will take longer to achieve than one in robotics because biology is a harder problem requiring more fundamental investment.
Jerry Twerk is not highly concerned about AI existential risk because he believes human and capitalist incentives are aligned against allowing humanity to go extinct.