CSI camera IMX219-160 IR doesn’t work on Jetson Orin Nano dev kit

Issue Overview

Users are experiencing difficulties getting the IMX219-160 IR camera to function properly with the Nvidia Jetson Orin Nano Dev Kit. The primary symptoms include:

• Error Messages: When attempting to capture footage using OpenCV, users encounter a timeout warning: [ WARN:[email protected]] global cap_v4l.cpp:1119 tryIoctl VIDEOIO(V4L2:/dev/video0): select() timeout.

• GStreamer Failures: Users report failures when trying to launch the camera using GStreamer commands, including deprecated elements and errors related to memory allocation.

• Device Recognition: The camera is recognized in the device list when using v4l2-ctl --list-devices, indicating that the hardware is detected but not functioning correctly.

The issue occurs while attempting to set up the camera for an object detection model using JetPack 5.1.2. Users have confirmed that the camera works on older Jetson models, suggesting a compatibility issue or configuration error with the Orin Nano.

The problem appears to be consistent across multiple attempts and has a significant impact on user experience, particularly for those new to Jetson hardware.

Possible Causes

Several potential causes for this issue have been identified:

• Hardware Incompatibility: The IMX219-160 IR camera may have compatibility issues with the Orin Nano’s hardware or software environment.

• Driver Issues: There may be bugs or conflicts in the drivers associated with either the camera or the Jetson platform, particularly with JetPack 5.1.2.

• Configuration Errors: Incorrect settings in the jetsonI/O configuration or GStreamer pipeline may prevent proper operation of the camera.

• I2C Communication Failures: Error messages from dmesg indicate potential I2C communication problems, specifically related to sensor initialization.

• Environmental Factors: Power supply issues or thermal conditions could also affect performance, although this is less likely given the symptoms reported.

Troubleshooting Steps, Solutions & Fixes

To address the issue, users can follow these troubleshooting steps and solutions:

1. Check I2C Communication:

   • Run sudo dmesg to check for I2C-related error messages.
   • Look for messages such as error during i2c read probe (-121) which indicate communication failures.
   • If errors are present, consider reconnecting the camera or testing another cable.

2. Verify Camera Configuration:

   • Ensure that jetsonI/O settings are correctly configured for "IMX-219 Dual mode" by executing:

     sudo /opt/nvidia/jetson-io/jetson-io.py
     

3. Test Video Capture with OpenCV:

   • Use a simple Python script to test video capture:

     import cv2
     camera = cv2.VideoCapture(0)
     success, image = camera.read()
     if success:
         print("Capture successful")
         cv2.imshow("image", image)
     else:
         print("Capture failed")
     camera.release()
     cv2.destroyAllWindows()
     

   • If you see a timeout warning, proceed to check GStreamer configurations.

4. Use GStreamer with Correct Pipeline:

   • Update your GStreamer command to use a valid pipeline:

     gst-launch-1.0 nvarguscamerasrc sensor_id=0 ! 'video/x-raw(memory:NVMM), width=1280,height=720, format=(string)NV12' ! nvvidconv ! nvegltransform ! nveglglessink
     

   • This pipeline has been reported as successful by other users.

5. Directly Test with v4l2:

   • Attempt to capture video directly using v4l2:

     v4l2-ctl -d /dev/video0 --set-fmt-video=width=3080,height=2464,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=1 --stream-to=test.raw
     

   • If the terminal freezes, it may indicate a deeper issue with device communication.

6. Update Software and Drivers:

   • Ensure that all software packages and drivers are up-to-date. This includes checking for updates to JetPack and OpenCV libraries.

7. Power Cycle and Reconnect Hardware:

   • Power cycle the Jetson Orin Nano and reconnect all hardware components to rule out temporary connection issues.

8. Consult Documentation and Community Forums:

   • Refer to Nvidia’s official documentation for any specific notes on compatibility with the IMX219 camera.
   • Engage with community forums for additional insights or similar experiences from other users.

By following these steps, users should be able to diagnose and potentially resolve issues related to using the IMX219-160 IR camera with the Nvidia Jetson Orin Nano Dev Kit.