Orbbec launches out-of-the-box AMR solution with NVIDIA Isaac Perceptor at ROSCon 2024

Share

The Orbbec Perceptor Dev Kit (OPDK) is preloaded with multi-camera NVIDIA Isaac Perceptor software in a compact form factor for outdoor/indoor conditions, and four synchronized Gemini 335L Depth+RGB cameras for 360-degree vision integrated with the NVIDIA Jetson AGX Orin system-on-module. The in-camera depth processing enables AI applications to run at reduced power consumption and cost.

Odense, Denmark, Oct 22, 2024 – Orbbec, a leading 3D camera provider, today announced the Orbbec Perceptor Developer Kit (OPDK), an out-of-the-box autonomous mobile robot (AMR) solution preloaded with NVIDIA Isaac Perceptor. The OPDK is designed for AMR developers who seek a powerful, hardware-software integrated kit to develop AI applications for dynamic and unstructured environments in warehouses and factories.

The Orbbec Gemini 335L cameras, integrated with NVIDIA Jetson AGX Orin system-on-modules, combine active and passive stereo vision technologies for seamless operations in both indoor and outdoor conditions. The Gemini 335L cameras offer in-camera depth processing powered by Orbbec’s MX6800 ASIC, and a precise multi-camera sync system.

The NVIDIA Jetson AGX Orin offers up to 275 trillion operations per second (TOPS) of performance, pre-trained AI models, reference AI workflows, and vertical application frameworks in robotics, vision AI and sensor fusion.

The Gemini 335L’s in-camera depth processing frees up GPU, CPU and NPU resources on the Jetson AGX Orin to run visual simultaneous localization and mapping (SLAM) and odometry for improved mapping in rapidly changing environments. This efficient system now increases resources for AI applications for dynamic object detection and pose estimation.

The out-of-the-box OPDK system solution for AMR features:

  • Preloaded with NVIDIA Isaac Perceptor for robot development and control. Optimized for AMR development, enabling rapid prototyping and deployment.
  • 360-degree visual SLAM with four RGB-D cameras, with in-camera depth processing and capable of indoor and outdoor operations.
  • Option to use visual odometry from cuVSLAM or wheel odometry from robots.

AMR developers can leverage CUDA-accelerated libraries and AI models, streamlining the development process and accelerating time to market.

 

The OPDK system components include:

  • Four Orbbec Gemini 335L RGB-D Cameras: Depth resolution up to 1280×800 at 30 FPS, offering high-precision depth data with a wide field of view (4*90° horizontal, 65° vertical) and USB connectivity, and IP65 rating for dust and water protection.
  • Multi-Camera Synchronization: Orbbec Sync Hub enables precise camera synchronization, enabling seamless multi-angle data collection with minimal interference.
  • NVIDIA Jetson AGX Orin (64GB) Developer Kit: AI-powered compute engine with up to 275 TOPS of AI performance, support from the NVIDIA JetPack software development kit, NVIDIA Isaac ROS, AI models, and tools that make it ideal for complex robotics tasks such as vision processing from multi-camera data streams, AI model inference, visual SLAM and 3D scene reconstruction.

“The Orbbec Perceptor Dev Kit gives developers a truly out-of-the-box experience with a feature-rich, comprehensive system to begin AI application development immediately,” said Amit Banerjee, Head of Partnerships at Orbbec. “This collaboration with NVIDIA enables us to provide compelling advantages to AMR developers to navigate the complexities of 3D sensing and computer vision algorithms with OPDK.”

Orbbec also announced today the Gemini 335Lg Stereo Vision 3D Camera, the latest addition to the Gemini 330 Series. With GMSL2 and secure FAKRA connection, the Gemini 335Lg achieves stable and smooth data transmission over longer distances and overcomes challenges from vibrations caused by movement over uneven terrain or electromagnetic interference. A version of the OPDK with GMSL cameras will be available soon.

For further information about OPDK visit https://www.orbbec.com/opdk/ or contact Orbbec for scheduling meetings at ROSCon.

 

About Orbbec

Founded in 2013, Orbbec is on a mission to democratize robotics and AI vision technology, offering products that deliver performance and value spanning structured light, stereo vision and ToF technologies. Orbbec’s technology powers robotics, manufacturing, logistics, retail, 3D scanning, healthtech and fitness solutions. With in-house R&D, state-of-the-art factory, supply chain management and global support, Orbbec also offers ODM engagements for custom and embedded designs. Follow Orbbec on X, Facebook, and LinkedIn for the latest updates and innovations in 3D vision technology.

Related News

Orbbec Depth+RGB cameras are now available for AMD Kria KR260 Robotics Starter Kits

Orbbec announced the availability of the Orbbec 3D cameras with the AMD Kria™ KR260 Robotic Starter Kits, the development platform for production AMD Kria K26 SOMs.

ROSCon 2024: Orbbec Unveils GMSL2/FAKRA Stereo Vision 3D Camera Gemini 335Lg for AMRs and Robotic Arms

Featuring GMSL2 serializer and FAKRA connector, the Gemini 335Lg offers secure and reliable connectivity, designed to enhance the performance of autonomous mobile robots (AMRs) and robotic arms in challenging environments.

Orbbec Partners with Advantech to Bring Out-of-the-Box AI Vision Solutions to AMR Developers

This partnership offers innovative capabilities, including synchronized operation of up to four 3D cameras, enhancing AMR performance with improved efficiency, stability, and mobility.

Stay updated

Be the first to learn about our new
products and updates.