NVIDIA ups the ante on Edge AI with Jetson AGX Orin


NVIDIA continues to evolve the cutting-edge Jetson computing platform with new additions. At the recent GTC conference, the company announced the availability of Jetson AGX Orin, a powerful edge computing platform for running AI solutions.

The NVIDIA Orin system-on-chip (SoC) is based on the NVIDIA Ampere GPU architecture with 2048 CUDA cores, 64 Tensor cores, and 2 Deep Learning Accelerator (DLA) engines that deliver up to 275 trillion operations per second (TOPS) of AI Performance.

NVIDIA claims Jetson AGX Orin is 8x faster and 2x more efficient than Jetson AGX Xavier, an SoC launched in 2018 to run advanced AI solutions at the edge. With the same pinout configuration as AGX Xavier, customers can easily port their existing edge AI applications to AGX Orin.

With 8 times the performance of the 32 TOPS provided by Jetson AGX Xavier, AGX Orin also offers up to 9 times the performance of the Deep Learning Accelerator (DLA), 1.5 times better CPU performance, and bandwidth DRAM bandwidth up to 1.5 times higher.

The Jetson AGX Orin SoC dramatically accelerates computer vision and conversational AI model inference. The table below from NVIDIA compares the inference performance of Jetson AGX Xavier and Jetson AGX Orin.

Similar to other products in the Jetson family, the AGX Orin hardware platform comes in two versions: a development kit and a production module. The development kit is intended for prototyping AI solutions that can be easily moved to the production environment based on the production-ready SoC modules.

The Jetson AGX Orin development kit is available today for $1999, with production modules expected later this year. The development kit is based on a Jetson AGX Orin module with a heatsink and a reference support board supplied with an 802.11ac/abgn WiFi controller, an RJ45 port (up to 10 GbE), a MIPI CSI-2 connector with 16 lanes, an M.2 Key E and M.2 Key M that support multiple PCIe slots as well as 2 USB A and USB C ports for connecting peripherals.

Since the device is part of the Jetson family, it runs the same software stack powered by JetPack, Riva, DeepStream, Isaac, and TAO.

The Jetson AGX Orin SDK comes with the pre-release version of JetPack 5.0, which runs on Ubuntu 20.04 based on Linux Kernel 5.10. It also includes security features such as hardware root of trust, secure boot, disk encryption, and secure storage.

The NVIDIA Jetson family is the most comprehensive Edge AI platform. Manufacturers and developers can start with the most affordable Jetson Nano, a $99 board, while companies running advanced AI solutions can opt for the high-end Jetson AGX Orin. The Jetson family of devices targets a wide range of AI use cases and scenarios ranging from hobby projects to critical healthcare applications.

As organizations move AI workloads to the edge, they need higher processing power and hardware-based acceleration. With Jetson AGX Orin, NVIDIA promises server-grade AI performance at the edge, making it the best edge platform in its class.

NVIDIA innovates across both cloud/data center and edge environments to deliver accelerated compute platforms for AI workloads.


About Author

Comments are closed.