Model Maker: Image format not JPEG

Francois_Gervais · August 25, 2021, 1:57am

I’m in the process of fine-tuning EfficientDetLite0 with information from this tutorial:

I’m using object_detector.DataLoader.from_csv() to load my data which uses PNG image files.

The from_csv api points to this documentation for the csv format which mention that PNG files are allowed:

References to non-image files (such as PDF or PSD files). Likewise, files that are not image files (JPEG, PNG, GIF, BMP, or ICO) but that have been renamed with an image extension will cause an error.

Even the example is using PNG files.

However on my side I get an error:

Traceback (most recent call last):
  File "rgb_finetune.py", line 125, in <module>
    csv_file_path, images_dir=args.images)
  File "/azureml-envs/tensorflow/lib/python3.7/site-packages/tensorflow_examples/lite/model_maker/core/data_util/object_detector_dataloader.py", line 292, in from_csv
    cache_writer.write_files(cache_files, csv_lines=csv_lines)
  File "/azureml-envs/tensorflow/lib/python3.7/site-packages/tensorflow_examples/lite/model_maker/core/data_util/object_detector_dataloader_util.py", line 258, in write_files
    ann_json_dict=ann_json_dict)
  File "/azureml-envs/tensorflow/lib/python3.7/site-packages/tensorflow_examples/lite/model_maker/third_party/efficientdet/dataset/create_pascal_tfrecord.py", line 134, in dict_to_tf_example
    raise ValueError('Image format not JPEG')
ValueError: Image format not JPEG

Any idea why I get this error?

lgusm · August 25, 2021, 12:01pm

@Yuqi_Li might be able to help here

Francois_Gervais · August 31, 2021, 4:32pm

Any news on this? I’d like to get rid of the extra png to jpg conversion step short to medium term.

Bhack · August 31, 2021, 5:32pm

Is that the specific TFrecord utility for Pascal dataset support only jpeg:

github.com

tensorflow/models/blob/master/research/object_detection/dataset_tools/create_pascal_tf_record.py#L83-L92

      
        
              ValueError: if the image pointed to by data['filename'] is not a valid JPEG
            """
            img_path = os.path.join(data['folder'], image_subdirectory, data['filename'])
            full_path = os.path.join(dataset_directory, img_path)
            with tf.gfile.GFile(full_path, 'rb') as fid:
              encoded_jpg = fid.read()
            encoded_jpg_io = io.BytesIO(encoded_jpg)
            image = PIL.Image.open(encoded_jpg_io)
            if image.format != 'JPEG':
              raise ValueError('Image format not JPEG')