Nvidia’s new platform will use generative AI to power humanoid robots

Nvidia on Monday announced a hardware and software platform for building humanoid robots that include generative artificial intelligence capabilities.

The new platform will include a computer system to power robotics and artificial intelligence, as well as a suite of software including genAI and other tools to build humanoid robots, the company said at its annual developer conference.

The addition of genAI will allow humanoid robots to act based on input from language, video, “human demonstrations” and past experiences. The genAI component, known as Project GR00T, will be added to the company’s existing robotics hardware and software platforms.

“These are smarter, faster, better robots that will be deployed in the world’s heavy industries,” Rev Lebaredian, vice president of Omniverse and simulation technologies, said in a briefing with reporters. “We are working with the entire robotics and simulation ecosystem in the world to to accelerate development and adoption.”

The powerful computer behind the genAI software is called “Jetson Thor,” and is based on one of the company’s artificial intelligence chips and other hardware. The company says the computer will provide robots with enough computing power to perform complex tasks and interact with people and machines.

The suite of software tools is called the “Isaac” platform, and the new GR00T genAI capabilities are designed to run on “any robotic embodiment in any environment.” These tools include training software to make better decisions over time, a process called reinforcement learning.

Nvidia also said it will release pre-trained robot models and other software to improve robotic arm functionality and multi-camera sensing capabilities.

© Thomson Reuters 2024