Join host Craig Smith for episode #173 of Eye on AI, featuring a groundbreaking discussion with Vincent Vanhoucke, distinguished Scientist, and Senior Director for Robotics at Google DeepMind. In this episode, Vincent dives into the cutting-edge world of robotic control with RT2, DeepMind's innovative robotic transformer system. Learn how RT2's integration of visual perception, natural language understanding, and action planning is pushing the boundaries of robotics, enabling machines to reason and act with unprecedented flexibility and intelligence. Discover the challenges, technological marvels, and future prospects of robotics as we explore how DeepMind is shaping the future of AI-driven automation. Tune in to uncover the potential of RT2 in transforming robotic capabilities and the implications for diverse applications across industries. Don't forget to rate us on Apple Podcast and Spotify if you find the episode insightful! This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more. Download NetSuite’s popular KPI Checklist, designed to give you consistently excellent performance - absolutely free at https://netsuite.com/EYEONAI Stay Updated: Craig Smith Twitter: https://twitter.com/craigss Eye on A.I. Twitter: https://twitter.com/EyeOn_AI (00:00) Preview and Introduction (04:15) Vincent's Background and DeepMind's Robotics (06:04) RT2 Architecture Overview (09:06) Semantic Planning in Robotics (12:33) Reinforcement Learning and Mitigating Model Hallucinations (15:47) World Models and Planning (19:29) Integrating Sensory Data for Planning (24:08) The Future of Robotic Control and RT2 (27:35) RT2 Open Source and Hardware Integration