NVIDIA Introduces Advanced AI Tools to Accelerate Humanoid Robot Development

NVIDIA announced a comprehensive set of services, models, and computing platforms aimed at accelerating the development of humanoid robotics on a global scale. This initiative aims to help leading robot manufacturers, AI modelers, and software developers build the next generation of humanoid robots.

NVIDIA Humanoid Robot Developer Program

Are you building humanoid robots? If so, join the new NVIDIA Developer Program for exclusive early access to NVIDIA accelerated computing systems. From cloud to edge, robot foundation models and acceleration libraries, robot learning and simulation frameworks, and development pipeline tools.

NVIDIA NIM and OSMO

NVIDIA’s new NIM microservices and OSMO orchestration service are designed to streamline the development of humanoid robots. NIM microservices provide pre-built containers powered by NVIDIA inference software, significantly reducing deployment times from weeks to minutes. Two new AI microservices, MimicGen and Robocasa, improve simulation workflows for generative physical AI in NVIDIA Isaac Sim, the robotics simulation reference application built on the NVIDIA Omniverse platform.

Imitate generates synthetic motion data based on data captured remotely from spatial processing devices such as Apple Vision Pro. Robocasa generates robotic tasks and environments ready for simulation in OpenUSD, a universal environment for creating and collaborating on 3D worlds.

NVIDIA OSMO, a cloud-native managed service, enables users to orchestrate and scale complex robotics development workflows across distributed compute resources, both on-premises and in the cloud. OSMO simplifies robot training and simulation workflows, reducing deployment and development cycle times from months to less than a week.

Improving Data Capture Workflows for Humanoid Robot Developers

Humanoid robot training foundation models require an incredible amount of data. NVIDIA’s AI-enabled Omniverse teleoperation reference workflow, presented at the SIGGRAPH computer graphics conference, allows AI researchers and developers to generate massive amounts of synthetic motion and perception data from a minimal number of remotely captured human demonstrations.

Developers use Apple Vision Pro to capture a small number of teleoperated demonstrations. These recordings are then simulated in NVIDIA Isaac Sim, and the MimicGen NIM microservice generates synthetic datasets from the recordings. The Project GR00T humanoid foundation model is trained using both real and synthetic data, saving developers time and money. The Robocasa NIM microservice in Isaac Lab generates experiments to retrain the robot model, while NVIDIA OSMO seamlessly assigns computational tasks to different resources, saving developers weeks of administrative tasks.

Fourier, a general-purpose robot platform company, sees benefits from using simulation technology to synthetically generate training data. “Creating humanoid robots is incredibly complex—requiring an incredible amount of real-world data, painstakingly captured from the real world,” said Alex Gu, CEO of Fourier. “NVIDIA’s new simulation and generative AI programming tools will help us launch and accelerate our model development workflows.”

Expanding Access to NVIDIA Humanoid Development Technologies

NVIDIA provides three computing platforms to facilitate the development of humanoid robots:

• NVIDIA AI Supercomputers to train models.
• NVIDIA Isaac Sim built on the Omniverse platform, where robots can learn and improve their skills in simulated worlds.
• NVIDIA Jetson Thor humanoid robot computers for operating models.

Developers can access and use all—or any portion—of these platforms according to their specific needs. With the new NVIDIA Humanoid Robot Developer Program, developers can gain early access to new offerings, as well as the latest releases of NVIDIA Isaac Sim, NVIDIA Isaac Lab, Jetson Thor, and Project GR00T universal humanoid foundation models.

Several companies, including 1x, Boston Dynamics, ByteDance Research, Field AI, Figure, Fourier, Galbot, LimX Dynamics, Mentee, Neura Robotics, RobotEra and Skild AI, are among the first to join the early access program. “Boston Dynamics and NVIDIA have a long history of working closely together to push the boundaries of what’s possible in robotics,” said Aaron Saunders, CTO at Boston Dynamics. “We’re really excited to see this work accelerate the industry, and the early access program is a fantastic way to get access to best-in-class technology.”

Availability

Developers can join the NVIDIA Humanoid Robot Developer Program today to gain access to NVIDIA OSMO and Isaac Lab, and soon to NVIDIA NIM microservices.

For those interested in the broader implications of humanoid robotics, other areas worth exploring include advances in AI ethics, the impact of robotics on the job market, and the integration of humanoid robots into diverse industries such as healthcare, manufacturing, and customer service. These topics offer a deeper understanding of the potential and challenges of the rapid advancement of humanoid robotics. Here is a selection of other articles from our extensive library of content that you might find interesting on the subject of humanoid robotics:

Filed under: Technology News

Geeky Gadgets Latest Deals

Disclosure: Some of our articles contain affiliate links. If you purchase something through one of these links, Geeky Gadgets may earn an affiliate commission. Learn more about our Disclosure Policy.