Benchmarking Edge AI Platforms: Performance Analysis of NVIDIA Jetson and Raspberry Pi 5 with Coral TPU

David Minott, Salman Siddiqui, Rami J. Haddad

Research output: Contribution to book or proceedingConference articlepeer-review

Abstract

The rapid development of edge AI applications has led to the demand for high-performance, power-efficient embedded computing platforms. This paper evaluates the computational efficiency, power consumption, and thermal characteristics of the NVIDIA Jetson Orin NX, Jetson Nano, and Raspberry Pi 5 with Coral TPU across various AI workloads. Performance metrics, including inference speed, CPU and GPU utilization, and thermal stability, were benchmarked using a YOLOv5 object detection model. The results indicate that the Jetson Orin NX achieves the highest frame rates, nearly doubling the performance of the Raspberry Pi 5 with Coral TPU (41.8 FPS vs. 21.5 FPS) and surpassing the Jetson Nano by more than 50 percent. Power efficiency was another critical factor, with the Jetson Nano consuming the least power at approximately 7W, while the Raspberry Pi 5 with Coral TPU consumed 8.3W and the Jetson Orin NX reached 10.6W under load. Thermal analysis revealed that the Raspberry Pi 5 operates at significantly higher temperatures, reaching up to 80°C without active cooling, whereas the Jetson Nano and Jetson Orin NX maintained stable temperatures at 42°C and 45°C, respectively. These findings underscore the importance of active cooling solutions and optimized workload distribution for edge AI devices. The comparative assessment provided in this study helps guide hardware selection for specific edge AI applications, balancing trade-offs between power efficiency, thermal performance, and computational speed.

Original languageEnglish
Title of host publicationConference Proceedings - IEEE SOUTHEASTCON
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1384-1389
Number of pages6
ISBN (Electronic)9798331504847
ISBN (Print)9798331504847
DOIs
StatePublished - Mar 22 2025
Event2025 IEEE SoutheastCon, SoutheastCon 2025 - Concord, United States
Duration: Mar 22 2025Mar 30 2025

Publication series

NameSoutheastCon 2025

Conference

Conference2025 IEEE SoutheastCon, SoutheastCon 2025
Country/TerritoryUnited States
CityConcord
Period03/22/2503/30/25

Scopus Subject Areas

  • Computer Networks and Communications
  • Software
  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Signal Processing

Keywords

  • AI
  • Benchmark
  • Embedded Systems
  • Jetson Nano
  • Jetson Orin
  • NVIDIA
  • Neural Network
  • Raspberry Pi

Fingerprint

Dive into the research topics of 'Benchmarking Edge AI Platforms: Performance Analysis of NVIDIA Jetson and Raspberry Pi 5 with Coral TPU'. Together they form a unique fingerprint.

Cite this