Keep pulling the thread on Kuang Wong.
The mission of Physical Intelligence is to build a single AI model capable of controlling any robot to perform any task it is physically capable of.
The Open X-Embodiment and Robotic Transformer X (RTX) projects were the first to show potential scaling laws in robotics by training models across multiple different hardware platforms.
The OpenX generalist model, trained on data from 10 different robot platforms, performed 50% better on a given platform than a specialist model trained exclusively on data from that same platform.
Kuang Wong estimates that solving general-purpose robotics could contribute 10% to the US GDP, justifying large-scale investment in data collection.
Physical Intelligence is observing emergent properties in its large-scale robotics foundation models, enabling them to perform certain tasks in a zero-shot manner that previously required hundreds of hours of data collection.
Physical Intelligence runs almost all of its robot evaluations with the AI model hosted in the cloud, not on the robot's local hardware.
Kuang Wong predicts a 'Cambrian explosion' of vertical robotics companies due to the significantly reduced cost and expertise required to start one.
An internal AI agent prototype at Physical Intelligence that monitors large training runs led to a 50% improvement in overall compute utilization.
The upfront cost for starting a robotics business has decreased and will continue to decrease at an accelerating pace.
Physical Intelligence's strategy for developing autonomous robots involves deploying a mixed-autonomy system in a real-world job, allowing it to improve incrementally by learning from edge cases.
The PaLM-E and Robotic Transformer 2 (RT2) projects showed that a powerful vision-language model can be adapted with robotics data to generate low-level robot actions.
Kuang Wong believes the ImageNet dataset was more impactful for computer vision than the OpenX dataset has been for robotics because ImageNet provided a standard for reproducible evaluation, which OpenX did not solve.