Orin Nano 8G JetPack 6.0 Backup NVMe Failed

Issue Overview

Users have reported experiencing issues when attempting to back up the NVMe storage on the Nvidia Jetson Orin Nano Dev board using the JetPack 6.0 (rev.2). The primary symptoms include:

• Error Messages: Users encounter a message stating "tar: Write checkpoint 7620000" during the backup process, which indicates that the operation is taking an unusually long time and the size of the backup is increasing significantly.

• Context of the Problem: The issue arises specifically when executing the backup script located at sudo ./tools/backup_restore/l4t_backup_restore.sh -e nvme0n1 -b jetson-orin-nano-devkit. Users have noted that while using a similar setup on the Orin NX, the backup process completes in a reasonable timeframe, contrasting with the prolonged duration observed on the Orin Nano.

• Hardware and Software Specifications: Users are utilizing custom boards for their Orin Nano setups, and they are running JetPack 6.0 (not a development version).

• Frequency of Occurrence: The problem appears to be consistent among users who have attempted similar backup operations on the Orin Nano.

• Impact on User Experience: The prolonged backup times may hinder productivity and lead to frustration, especially for users expecting similar performance to that of the Orin NX.

Possible Causes

Several potential causes could explain the observed issues during the backup process:

• Hardware Incompatibilities or Defects: Differences in hardware configurations between custom boards and devkits may lead to performance discrepancies.

• Software Bugs or Conflicts: There may be bugs in the backup script or conflicts with other running processes that affect performance.

• Configuration Errors: Incorrect settings or parameters passed to the backup script could lead to inefficient execution.

• Driver Issues: Outdated or incompatible drivers may affect storage performance during backup operations.

• Environmental Factors: Variations in power supply or temperature conditions could impact hardware performance.

• User Errors or Misconfigurations: Improper use of commands or misunderstanding of expected outcomes could lead to perceived issues.

Troubleshooting Steps, Solutions & Fixes

To address the backup issues on the Nvidia Jetson Orin Nano, users can follow these troubleshooting steps and solutions:

1. Verify Backup Command Syntax:
   Ensure that you are using the correct command syntax for backing up NVMe. The command should be:

   sudo ./tools/backup_restore/l4t_backup_restore.sh -e nvme0n1 -b jetson-orin-nano-devkit
   

2. Check for Ext4 Filesystem:
   Use the provided function to check if your storage device is formatted as ext4:

   isext4() {
       if [ "$#" -ne 1 ]; then
           print_message "isext4 function needs 1 parameter that is the name of the storage device"
           return 1;
       fi
       local result
       result="$(blkid "/dev/${1}" | awk '{ print $3 }' | sed -n 's|TYPE="\(.*\)"|\1|p')"
       result="$(blkid -o value -s TYPE "/dev/${1}")"
       if [ "${result}" = "ext4" ]; then
           echo "true"
       else
           echo "false"
       fi
   }
   

3. Compare Backup Times:
   Document and compare the backup times between different setups (Orin NX vs. Orin Nano) to identify discrepancies. This information can help diagnose if specific configurations are causing slowdowns.

4. Alternative Backup Methods:
   Consider using alternative commands like dd for backing up NVMe storage:

   sudo dd if=/dev/nvme0n1 of=/path/to/backup.img bs=64K conv=noerror,sync status=progress
   

   Note that this method may take longer but can serve as a workaround.

5. Update Drivers and Firmware:
   Ensure that all drivers and firmware are up-to-date to avoid any compatibility issues that might affect performance.

6. Check System Logs:
   Review system logs for any errors or warnings that occur during the backup process. Use:

   dmesg | grep nvme
   

7. Isolate Hardware Issues:
   If possible, test with different hardware configurations (e.g., different NVMe drives) to determine if specific hardware is causing slow backups.

8. Consult Documentation:
   Refer to Nvidia’s official documentation for any updates or patches related to JetPack 6.0 that might address known issues with backup processes.

9. Community Support:
   If problems persist, consider reaching out to community forums with detailed logs and descriptions of your setup for further assistance.

By following these steps, users should be able to diagnose and potentially resolve their issues with backing up NVMe on the Nvidia Jetson Orin Nano Dev board.