GPU Encoding Support on Nvidia Jetson Orin Nano Dev Board

Issue Overview

The discussion revolves around the capabilities of the Nvidia Jetson Orin Nano Developer Kit concerning GPU encoding, specifically for AV1 and H.265 formats. Users are experiencing issues with real-time streaming of video feeds, particularly from USB webcams, and are encountering significant latency when attempting to use software encoding methods.

Specific Symptoms:

• Users reported that AV1 encoding is not supported on the Orin Nano.
• While H.265 encoding is possible using software methods (e.g., through GStreamer), users noted that the performance is subpar, resulting in high latency rates (up to 30 seconds).
• The GStreamer pipeline provided by users technically works but fails to deliver acceptable streaming performance.

Context:

• The problem arises during the setup and execution of video streaming applications using GStreamer.
• Users have previously achieved better results with older models like the Jetson TX2 but find the Orin Nano lacking in performance.

Relevant Specifications:

• The Nvidia Jetson Orin Nano Developer Kit.
• Software used includes GStreamer with specific plugins for encoding.

Frequency of Issue:

• The issue appears to be consistent among users attempting similar tasks, indicating a potential limitation of the hardware.

Impact on User Experience:

• The significant latency renders video streams practically unusable for real-time applications, impacting overall functionality and user satisfaction.

Possible Causes

• Hardware Limitations: The Orin Nano lacks dedicated hardware support for AV1 encoding and struggles with software-based H.265 encoding.

• Software Bugs or Conflicts: There may be inefficiencies in the GStreamer plugins or configurations leading to performance issues.

• Configuration Errors: Incorrect parameters in the GStreamer pipeline could contribute to poor performance and high latency.

• Driver Issues: Outdated or incompatible drivers might affect the functionality of the encoding processes.

• User Errors: Misconfigurations in setting up the GStreamer pipeline could lead to suboptimal performance.

Troubleshooting Steps, Solutions & Fixes

1. Diagnosing the Problem:

   • Verify that you are using the latest version of GStreamer and its plugins.
   • Check for any available firmware updates for the Jetson Orin Nano.

2. Gathering System Information:

   • Use terminal commands to check for installed GStreamer plugins:

     gst-inspect-1.0 --version
     gst-inspect-1.0 | grep x265
     

3. Isolating the Issue:

   • Test different video resolutions and frame rates in your GStreamer pipeline:

     gst-launch-1.0 v4l2src device=/dev/video0 ! "video/x-raw,width=640,height=480,framerate=15/1" ! nvvidconv ! "video/x-raw,format=I420" ! x265enc bitrate=100 ! "video/x-h265,stream-format=byte-stream" ! h265parse ! rtph265pay ! udpsink host=127.0.0.1 port=5000
     

4. Recommended Fixes:

   • If using H.265 encoding via software proves ineffective, consider switching to H.264 encoding as a workaround:

     gst-launch-1.0 v4l2src device=/dev/video0 ! "video/x-raw,width=640,height=480,framerate=15/1" ! nvvidconv ! "video/x-raw,format=I420" ! x264enc bitrate=200 tune=zerolatency speed-preset=ultrafast ! "video/x-h264,stream-format=byte-stream" ! h264parse ! rtph264pay ! udpsink host=127.0.0.1 port=5000
     

5. Best Practices:

   • Always ensure that your hardware is compatible with your desired encoding methods.
   • Regularly update your software and drivers to benefit from performance improvements and bug fixes.
   • Test different configurations to find optimal settings for your specific use case.

6. Further Investigation:

   • If latency issues persist despite following these steps, consider exploring alternative hardware options like the Orin NX for better support of hardware encoding features.

This document aims to provide a structured approach to addressing GPU encoding issues on the Nvidia Jetson Orin Nano Developer Kit based on user experiences shared in the forum discussion.