Stereolabs Integrates Autonomous Robotics with NVIDIA Isaac Sim

Facebook X LinkedIn Email
Stereolabs, a provider of 3D depth and motion sensing solutions, has integrated its ZED SDK and ZED X stereo cameras with NVIDIA Isaac Sim and added support for NVIDIA Isaac ROS. The move, the camera maker said, aims to accelerate development of space-aware autonomous robots.
Stereolabs’ ZED X stereo camera. Courtesy of Stereolabs.

Stereolabs’ ZED X stereo camera. Courtesy of Stereolabs.

More specifically, the integration will allow developers to use Stereolabs’ stereo cameras virtually through the Isaac Sim platform, with the added functionality enabling users to create robotics applications entirely in simulation. Users gain access to the exact 3D model of the ZED X camera to test and validate the number of cameras required, positioning, resolution, frame rate, and field of view. Developers can also test ZED SDK-based tasks and applications, such as depth sensing, localization, and object detection, in a virtual environment and simulate real-world scenarios, such as navigating obstacles in a warehouse. 
The cameras are also now compatible and integrated with NVIDIA Jetson modules and have also been made compatible with NVIDIA Isaac ROS, a collection of hardware-accelerated, low-latency packages. Additional benefits of the integration, Stereolabs said, are the ability to safely test robots in real-world conditions, such as in a warehouse where there is need to navigate obstacles, and the ability to use synthetic data generation to train AI. As an alternative to physical cameras, the company said, developers can send synthetic streaming frames from Isaac Sim to the Stereolabs SDK to train machine learning models and improve the performance of AI vision-based robots.

Published: November 2023
machine vision
Machine vision, also known as computer vision or computer sight, refers to the technology that enables machines, typically computers, to interpret and understand visual information from the world, much like the human visual system. It involves the development and application of algorithms and systems that allow machines to acquire, process, analyze, and make decisions based on visual data. Key aspects of machine vision include: Image acquisition: Machine vision systems use various...
artificial intelligence
The ability of a machine to perform certain complex functions normally associated with human intelligence, such as judgment, pattern recognition, understanding, learning, planning, and problem solving.
Businessmachine visionintegrationpartnershipSoftwarecamerasAmericasStereolabsartificial intelligenceAIsimulationIsaac SimNvidiaROSspatial mappingdepthpoint cloudsSensors & Detectorsroboticsspatial awarenessspatially-awarerobotSDKZEDZED Xstereo vision3DThe News Wire

We use cookies to improve user experience and analyze our website traffic as stated in our Privacy Policy. By using this website, you agree to the use of cookies unless you have disabled them.