Chelsea Finn: This is the State of the Art in Robotics
In a Nutshell
Chelsea Finn's Physical Intelligence has developed general-purpose robotics models that achieve 90%+ reliability on real-world tasks like espresso-making and kitchen cleaning through a self-improving system combining foundation model pre-training, human intervention for dead-end avoidance, and reinforcement learning using a value function trained on diverse robot experience. The PIO7 model demonstrates out-of-the-box performance matching or exceeding task-specific fine-tuned specialists, with compositional generalization across robot platforms and objects never seen in training data. The approach enables long-term autonomous operation (13+ hours) without human supervision by implementing multi-time-scale memory systems that compress extended task histories into actionable text summaries.
These notes were generated by AI and may contain inaccuracies.
Chelsea Finn founded Physical Intelligence two years ago to develop robots capable of performing any task in the real world. One year prior, she presented progress on complex tasks including unloading and folding laundry, and demonstrated robots successfully completing useful tasks in previously unseen environments.
Since the previous presentation, robots have achieved additional tasks including washing a greasy pan, peeling a carrot, making a grilled cheese sandwich, and slicing a zucchini. The focus shifts from showcasing individual capabilities to understanding what enables robots to become useful in real-world applications.
Two critical aspects must be addressed: developing general-purpose models and bringing these models into the real world for actual impact. The discussion begins with the challenges of real-world deployment.
A timeline of major production launches leveraging machine learning reveals key milestones. Early applications included product recommendations and ad ranking. Five years later, deep learning emerged for similar applications, offering advantages because the algorithm could be applied out-of-the-box to complex input-output scenarios. The pivotal moment occurred in 2022 with ChatGPT, the first general-purpose model used by many people in the real world, reaching one million users within five days. More recently, coding agents like Cursor have demonstrated real-world utility.
Sign in to read the full notes
Get access to AI-generated notes, topic timestamps, and more.