Nvidia’s Isaac Sim Robotics simulation software is now available in the free open beta version


When companies experiment with AI, machine learning, and robotics, one challenge is finding time to test the actual algorithms, code, and hardware in real-world situations like factory floors and fix bugs without the just-in-time To disrupt the production of goods and operations.

This is where the Isaac Sim robot simulation software from Nvidia comes into play as a virtual 3D environment in which the actual systems of a company can be modeled as digital twins in order to carry out tests and evaluations precisely outside of the production environment.

Introduced as an emerging platform at the Computex technology conference in mid-2018, Isaac Sim has undergone broad development since then and is now available in open beta, which gives companies the opportunity to use and test the application in-house free of charge.

Isaac Sim runs on Nvidias Omniverse Collaboration and simulation platform that provides companies with tools and functions that enable the construction of virtual robot worlds and experiments synthetic data Generation that can imitate real production systems and their use of AI, ML and robotics.

Gerard Andrews from Nvidia

“In the beginning, when you want to develop the robot yourself and prototype it, it’s a lot easier to try things out in a simulator and see how they work before committing to a physical design.” Gerard Andrews, Senior Product Marketing Manager for Nvidia’s robotics developer community said CompanyAI. “If you have AI it needs to be trained, you need data to train it. And if you install it on a factory floor, you can’t actually run your real factory and let the robot run around collecting its data to train its AI. “

Using Isaac Sim, companies can create simulated images through a photorealistic simulation environment that can then be used to train the models, Andrews said.

“This is a big deal for us,” he said. “You can boot and run the AI ​​training well before you have access to where it is physically used.”

In addition, using the simulator allows users to test the processes where live interactions on factory floors could be dangerous or expensive, he said. This can be used to test how robots react to vehicles moving along a production line or when they are exposed to people moving nearby while the robots are moving at the same time.

“You can prove them in a simulated world with a lot less effort and risk than in the real world,” said Andrews.

To date, thousands of developers at hundreds of companies have used Isaac Sim through an early adopter program. No company has yet used the system in production.

Named after science and science fiction writer Isaac Asimov“Isaac Sim is designed to allow users to place realistic robot models in compelling environments to visualize and simulate how they will perform in the real world,” Andrews said.

Using synthetic or simulated images for training also means lower costs compared to live recordings of tests by videographers, he said.

“We believe that 3D workflows are important to many industries,” said Andrews. “They know we have a strong history in games, and that’s probably part of the legacy built into the product, but it has expanded to these other real-world use cases.”

The Isaac simulation engine was designed to streamline synthetic data generation and domain randomization to create records that are created exactly where the work is done, or ground truth records, according to Nvidia. This data is needed to train robots in applications from logistics and warehousing to the factories of the future.

New features in the beta version of Nvidia Isaac Sim include multi-camera support, recording a fisheye camera with synthetic data, support for Robot Operating System 2 (ROS2), improved sensor support, an ultrasonic sensor, a force sensor and a custom LiDAR pattern .

Leave A Reply

Your email address will not be published.