OpenCV and GStreamer Error on Jetson Orion Nano but Works on Jetson Xavier AGX

Issue Overview

Users are experiencing an error when attempting to run OpenCV with GStreamer on the Jetson Orion Nano. The specific error message is:

/home/stuart/opencv/modules/videoio/src/cap_gstreamer.cpp:1611: error: (-215:Assertion failed) frameSize.width > 0 && frameSize.height > 0 in function ‘open’

This issue arises when executing code to open a video stream from a camera, specifically using the cv::VideoWriter function. The user reports that the same setup works flawlessly on a Jetson Xavier AGX, indicating a potential platform-specific issue. The camera used is a FLIR Blackfly S BFS-U3-16S2C, and the user is utilizing the v4l2src source type. The OpenCV installation and configuration settings are reportedly consistent across both devices. This problem occurs during the setup phase, particularly when initializing the camera stream, leading to significant frustration as the camera is recognized by other utilities.

Possible Causes

1. Hardware Incompatibilities or Defects: The Jetson Orion Nano may have compatibility issues with certain camera models or configurations that work on the Xavier AGX.

2. Software Bugs or Conflicts: There may be bugs in the OpenCV or GStreamer versions installed on the Orion Nano that do not exist in the Xavier AGX environment.

3. Configuration Errors: Incorrect parameters passed to cv::VideoWriter or other related functions could lead to this assertion failure.

4. Driver Issues: Outdated or incorrect drivers for the camera may prevent proper initialization.

5. Environmental Factors: Power supply inconsistencies or thermal issues could affect performance and functionality.

6. User Errors or Misconfigurations: Users may inadvertently misconfigure their OpenCV or GStreamer setups, leading to errors.

Troubleshooting Steps, Solutions & Fixes

1. Verify Camera Recognition:

   • Use the command:

     v4l2-ctl --list-devices
     

   • Ensure that the camera is listed correctly.

2. Check Camera Formats:

   • Run:

     v4l2-ctl -d /dev/video0 --list-formats-ext
     

   • This will help confirm if the expected formats are supported by your camera.

3. Test Camera with GStreamer:

   • Execute a simple GStreamer pipeline to ensure the camera can stream video:

     gst-launch-1.0 v4l2src device=/dev/video0 ! videoconvert ! autovideosink
     

   • If this works, it indicates that GStreamer can access the camera properly.

4. Update JetPack and Libraries:

   • Ensure you are using the latest JetPack version (5.1.3) as older versions may contain bugs affecting camera functionality.

5. Modify OpenCV Code:

   • Adjust your code to explicitly set width and height before opening:

     cv::Size desiredSize(imageWidth_, imageHeight_);
     videos[i].open(videoName, cv::VideoWriter::fourcc('a','v','c','1'), pCamera_Array[i]->AcquisitionResultingFrameRate.GetValue(), desiredSize, true);
     

   • Ensure that imageWidth_ and imageHeight_ are set correctly before this call.

6. Rebuild OpenCV with GStreamer Support:

   • If issues persist, consider rebuilding OpenCV ensuring that GStreamer support is enabled during compilation.
   • Follow instructions from reliable sources like NVIDIA’s GitHub.

7. Check for Environmental Issues:

   • Ensure that your power supply is stable and that there are no overheating issues with the Jetson Orion Nano.

8. Seek Community Support:

   • Engage with forums such as NVIDIA Developer Forums for additional insights and solutions from other users who may have faced similar issues.

9. Document Unresolved Issues:

   • Note any unresolved aspects of this issue for further investigation, such as specific configurations that lead to success or failure in different environments.

By following these troubleshooting steps, users should be able to diagnose and potentially resolve the issues they are experiencing with OpenCV and GStreamer on their Jetson Orion Nano boards.