Newly added images to the dataset are added with string IDs causing Training fails because some images have string instead of integer IDs causing training errors

XMLWordPrintable

    • Type: Bug
    • Resolution: Unresolved
    • Priority: High
    • Edge AI Studio
    • EDGEST-501
    • MC_1.0_Beta2
    • MC_1.0_GA
    • None
    • Hide
      There is a temporary workaround that id useful to fix datasets like these until the root cause is addressed.
      1. Export a dataset - download locally
      2. Change the string IDs to integers in the local dataset
      3. Delete the images in the project
      4. Upload the modified dataset

      # Run in the 'annotations' directory
      ID_COUNT="$(grep "image_id" instances.json | uniq | wc -l)"
      for file in $(grep 'image_id": "' instances.json | awk -F'"' '{print $4}'); do
          GEN_ID=0
          while (("$GEN_ID" < "$ID_COUNT")); do
              GEN_ID=$RANDOM
          done
          sed -i "s/id\": \"$file\"/id\": $GEN_ID/g" instances.json
      done
      Show
      There is a temporary workaround that id useful to fix datasets like these until the root cause is addressed. 1. Export a dataset - download locally 2. Change the string IDs to integers in the local dataset 3. Delete the images in the project 4. Upload the modified dataset # Run in the 'annotations' directory ID_COUNT="$(grep "image_id" instances.json | uniq | wc -l)" for file in $(grep 'image_id": "' instances.json | awk -F'"' '{print $4}'); do     GEN_ID=0     while (("$GEN_ID" < "$ID_COUNT")); do         GEN_ID=$RANDOM     done     sed -i "s/id\": \"$file\"/id\": $GEN_ID/g" instances.json done

      When the user captures/uploads new images to an example dataset, the new images are added with string IDs instead of integer type. This causes errors in training attempts. The error does not clearly identify the root cause of the problem.

            Assignee:
            TI User
            Reporter:
            TI User
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:

                Connection: Intermediate to External PROD System
                EXTSYNC-4203 - Newly added images to the dataset a...
                SYNCHRONIZED
                • Last Sync Date: