Failed to read rcm_state – SDK Manager flash error on Jetson Orin Nano

Issue Overview

Users are experiencing difficulties flashing Jetpack 6.1 on a Jetson Orin Nano 8GB developer kit, specifically a custom board from Advantech. The issue occurs when using SDK Manager on Ubuntu 20.04 to flash the device. The installation process consistently stalls at around 32% completion, displaying an error related to "Flash Jetson Linux." The error message in the SDK Manager terminal begins with:

ERROR: [0.0134] ERROR: failed to read rcm_state

This is followed by additional error messages. The problem persists despite multiple attempts to flash the device. The user is attempting to upgrade from Ubuntu 20.04 (pre-installed by Advantech) to Ubuntu 22.04 using a 128GB SD card, after removing the original SSD.

Possible Causes

1. Custom board compatibility: The use of a custom Advantech board may introduce compatibility issues with the standard Jetpack flashing process.

2. SDK Manager version mismatch: The version of SDK Manager being used might not be fully compatible with Jetpack 6.1 or the custom board.

3. Recovery mode issues: The device may not be properly entering recovery mode, which is necessary for flashing.

4. Hardware configuration: Removing the original SSD and using an SD card instead could potentially affect the flashing process.

5. Ubuntu host version: Using Ubuntu 20.04 as the host OS for SDK Manager might cause conflicts when trying to flash Ubuntu 22.04.

6. Corrupted or incompatible SD card: The 128GB SD card being used might be faulty or incompatible with the Jetson Orin Nano.

7. Insufficient power supply: Inadequate power delivery to the Jetson board during the flashing process could cause errors.

Troubleshooting Steps, Solutions & Fixes

1. Verify board compatibility:

   • Contact Advantech support to confirm if their custom board is fully compatible with Jetpack 6.1 and the standard flashing process.
   • Request any specific flashing instructions or custom images required for the Advantech board.

2. Update SDK Manager:

   • Ensure you’re using the latest version of SDK Manager compatible with Jetpack 6.1.
   • Download the latest version from the NVIDIA developer website.

3. Proper recovery mode entry:

   • Disconnect all cables from the Jetson board.
   • Connect the micro-USB cable to the Jetson’s recovery port and your host computer.
   • Press and hold the recovery button while connecting the power cable.
   • Release the recovery button after 2 seconds.
   • Verify that the device is in recovery mode by running lsusb in the terminal. Look for an entry like "NVidia Corp. APX".

4. Try alternative flashing methods:

   • Use the command-line flashing method instead of SDK Manager:

     sudo ./flash.sh jetson-orin-nano-devkit mmcblk0p1
     

   • Ensure you’re in the correct directory containing the flash tools.

5. Check and prepare the SD card:

   • Use a tool like GParted to completely wipe and reformat the SD card to FAT32.
   • Try a different, known-good SD card if possible.

6. Update host system:

   • Consider upgrading your host Ubuntu system to 22.04 to match the target OS version.
   • Alternatively, use a live USB with Ubuntu 22.04 to run SDK Manager.

7. Power supply check:

   • Ensure you’re using the official power supply for the Jetson Orin Nano.
   • Try a different power outlet or cable to rule out power-related issues.

8. Clean flash attempt:

   • Remove the SD card and attempt to flash the eMMC directly.
   • If successful, you can then try flashing to the SD card afterward.

9. Check for hardware issues:

   • Inspect the board for any visible damage or loose connections.
   • Try a different USB cable for the recovery mode connection.

10. Collect and analyze logs:

    • Run SDK Manager with verbose logging:

      sdkmanager --verbose
      

    • Collect all log files and share them with NVIDIA support or on the developer forums for further analysis.

11. Consider reverting to the original configuration:

    • If possible, temporarily reinstall the original SSD with Ubuntu 20.04 to verify if the board is functioning correctly.

12. QSPI bootloader update:

    • If the board hasn’t been updated recently, try updating the QSPI bootloader:

      sudo ./flash.sh -r jetson-orin-nano-devkit mmcblk0p1
      

If none of these steps resolve the issue, it’s recommended to open a support ticket with both Advantech (for the custom board) and NVIDIA, providing detailed information about the setup, all steps taken, and complete log files from the flashing attempts.