ast month, I took an extended break. In a bid to keep my robotics newsletter Actuator (subscribe here) up and running, however, I reached out to some of the biggest names in the industry. I asked people from CMU, UC Berkeley, Meta, Nvidis, Boston Dynamics and the Toyota Research Institute the same six questions, covering topics like generative AI,
the humanoid form factor, home robots and more. You’ll find all of the answers organized by question below. You would be hard-pressed to find a more comprehensive breakdown of robotics in 2023 and the path it’s blazing for future technologies.
What role(s) will generative AI play in the future of robotics?
Matthew Johnson-Roberson, CMU: Generative AI, through its ability to generate novel data and solutions, will significantly bolster the capabilities of robots. It could enable them to better generalize across a wide range of tasks, enhance their adaptability to new environments and improve their ability to autonomously learn and evolve.
Dhruv Batra, Meta: I see generative AI playing two distinct roles in embodied AI and robotics research:
- Data/experience generators
Generating 2D images, video, 3D scenes, or 4D (3D + time) simulated experiences (particularly action/language conditioned experiences) for training robots because real-world experience is so scarce in robotics. Basically, think of these as “learned simulators.” And I believe robotics research simply cannot scale without training and testing in simulation. - Architectures for self-supervised learning
Generating sensory observations that an agent will observe in the future, to be compared against actual observations, and used as an annotation-free signal for learning. See Yann’s paper on AMI for more details.
https://fundly.com/daman-games-download-predict-red-or-green-and-win-real-mone#welcome
https://techannouncer.com/earn-big-with-daman-games-predict-colors-and-enjoy-the-thrill/
https://theinscribermag.com/color-your-fortune-daman-games-brings-excitement-to-your-screen/
https://twinscityautoparts.com/predict-colors-win-cash-the-daman-games-advantage/
https://moontoon.co.uk/daman-games-app-predicting-colors-winning-hearts-and-cash/
https://readnewsblog.com/unleash-the-power-of-prediction-daman-games-for-cash-rewards/
https://medium.com/@seoprolevel786/dive-into-the-fun-how-daman-games-is-redefining-online-gaming-55180edc1591?postPublishedType=initial
https://scooparticle.com/unlock-your-luck-daman-games-app-offers-rewards-for-color-prediction/
https://soft2share.com/daman-games-a-colorful-journey-into-online-gaming-excitement/
https://siit.co/guestposts/predict-play-and-win-daman-games-unveils-a-world-of-colorful-opportunities/
https://specsialtydesign.com/experience-the-rush-daman-game-app-for-smart-color-predictions/
https://ovuracosmetic.com/daman-games-download-your-ticket-to-the-world-of-colorful-fortunes/
https://purplesweetshirt.com/play-predict-prosper-daman-games-paves-the-way-to-rewards/
https://specsialnutrients.com/daman-games-download-your-gateway-to-colorful-gaming-and-prizes/
https://bonjuk.bcz.com/2023/12/22/daman-games-where-color-prediction-meets-entertainment-and-earnings/
https://intersclean.com/unlock-the-secret-daman-games-app-your-path-to-predictive-riches/
https://korsteco.com/daman-game-thrilling-games-exciting-predictions-and-real-rewards/
https://thinksmakebuild.com/predict-play-and-prosper-daman-games-app-spells-entertainment-with-rewards/
https://beforeitsnews.com/alternative/2023/12/get-ready-to-predict-daman-games-app-promises-fun-and-rewards-3804822.html
https://fibastech.com/color-prediction-revolution-daman-games-app-takes-gaming-to-new-heights/
https://ramsbow.com/predict-wisely-win-big-the-daman-games-experience/
https://batessace.com/predicting-colors-winning-cash-daman-games-app-makes-it-possible/
https://deltsapure.com/daman-games-download-predict-smart-win-big-your-gaming-adventure-awaits/
https://habermansmachine.com/elevate-your-gaming-daman-games-where-colors-lead-to-riches.html
https://tritonsindustries.com/colorful-gaming-real-rewards-daman-game-app-unveils-the-magic/
https://aspensreno.com/daman-games-where-entertainment-and-earnings-collide-in-a-burst-of-colors/
https://businesssproductsdepot.com/colorful-ventures-daman-games-app-for-exciting-predictions-and-rewards/
https://dosshigroup.com/daman-games-redefining-fun-with-color-predictions-and-cash-wins/
https://techmesoft.com/predict-and-prosper-daman-games-app-your-path-to-colorful-riches.html
https://www.toursquirrel.com/predict-play-and-earn-daman-games-app-for-the-ultimate-gaming-experience.html
Aaron Saunders, Boston Dynamics: The current rate of change makes it hard to predict very far into the future. Foundation models represent a major shift in how the best machine learning models are created, and we are already seeing some impressive near-term accelerations in natural language interfaces. They offer opportunities to create conversational interfaces to our robots, improve the quality of existing computer vision functions and potentially enable new customer-facing capabilities such as visual question answering. Ultimately we feel these more scalable architectures and training strategies are likely to extend past language and vision into robotic planning and control. Being able to interpret the world around a robot will lead to a much richer understanding on how to interact with it. It’s a really exciting time to be a roboticist!
Russ Tedrake, TRI: Generative AI has the potential to bring revolutionary new capabilities to robotics. Not only are we able to communicate with robots in natural language, but connecting to internet-scale language and image data is giving robots a much more robust understanding and reasoning about the world. But we are still in the early days; more work is needed to understand how to ground image and language knowledge in the types of physical intelligence required to make robots truly useful.
Ken Goldberg, UC Berkeley: Although the rumblings started a bit earlier, 2023 will be remembered as the year when generative AI transformed robotics. Large language models like ChatGPT can allow robots and humans to communicate in natural language. Words evolved over time to represent useful concepts from “chair” to “chocolate” to “charisma.” Roboticists also discovered that large Vision-Language-Action models can be trained to facilitate robot perception and to control the motions of robot arms and legs. Training requires vast amounts of data so labs around the world are now collaborating to share data. Results are pouring in and although there are still open questions about generalization, the impact will be profound.