Support for 16-bit Bayer Raw Format on Nvidia Jetson Orin Nano Dev Board

Issue Overview

Users of the Nvidia Jetson Orin Nano Dev Board have raised concerns regarding the support for 16-bit Bayer Raw format data captured via MIPI (Mobile Industry Processor Interface). The main symptoms include:

• Inability to use 16-bit Bayer Raw format: Multiple users reported that the current ISP (Image Signal Processor) driver does not support this format.

• Context of the issue: The problem arises during attempts to capture and process images using MIPI CSI-2 interfaces, particularly when users expect to utilize 16-bit Bayer Raw data for image processing tasks.

• Hardware and Software Specifications: The Orin Nano supports up to four cameras with 8 lanes of MIPI CSI-2 D-PHY 2.1, capable of speeds up to 20 Gbps. However, no specific software or firmware versions were mentioned in the discussion.

• Frequency of the Issue: This issue appears to be consistent across various users attempting to use the same functionality.

• Impact on User Experience: The inability to process 16-bit Bayer Raw format restricts users from leveraging advanced imaging capabilities, which could hinder applications requiring high dynamic range or detailed image analysis.

Possible Causes

The following potential causes have been identified for the inability to support 16-bit Bayer Raw format:

• Hardware Limitations: The current ISP driver does not accommodate 16-bit Bayer Raw formats, limiting the hardware’s capability to process such data.

• Software Bugs or Conflicts: There may be unresolved bugs in the ISP driver that prevent compatibility with specific data types like RAW16.

• Configuration Errors: Incorrect settings or configurations in the MIPI interface or ISP may lead to unsupported data types being used.

• Driver Issues: The existing ISP drivers do not support DataType = 0x2e (RAW16), and there are no plans for future updates to address this.

Troubleshooting Steps, Solutions & Fixes

To address the issue of unsupported 16-bit Bayer Raw format on the Nvidia Jetson Orin Nano Dev Board, users can follow these troubleshooting steps:

1. Verify Current Driver Version:

   • Check your current ISP driver version. Use the following command in the terminal:

     cat /proc/version
     

2. Check Supported Formats:

   • Confirm which data formats are currently supported by your Jetson device. This can typically be found in the documentation or by querying the device capabilities.

3. Test with Alternative Formats:

   • If you are attempting to use 16-bit Bayer Raw, consider testing with supported formats like PWL HDR (Pixel Width Length High Dynamic Range) which is confirmed to be supported by all Jetson platforms.

4. Configuration Adjustments:

   • Ensure that your MIPI configuration is set correctly. Check your camera settings and ensure they align with supported formats:

     # Example configuration command (modify based on your setup)
     sudo ./configure_mipi.sh --data-type=0x2e
     

5. Consult Documentation for Updates:

   • Regularly check Nvidia’s official documentation and forums for any updates regarding driver support or new releases that may include enhancements for handling 16-bit formats.

6. Engage with Community Support:

   • If further assistance is needed, consider posting detailed queries on forums or Nvidia’s developer community pages where other users may share their experiences and solutions.

7. Monitor Future Releases:

   • Keep an eye on updates from Nvidia regarding future support for RAW16 formats as indicated by discussions in the forum; currently, there are no plans for this feature in the near future.

8. Testing Different Hardware Configurations:

   • If possible, test with different camera hardware that may offer better compatibility with supported formats.

By following these steps, users can better diagnose and potentially mitigate issues related to unsupported image formats on their Jetson Orin Nano Dev Board.