Checkpoint Save and Load when using pretrained model

Hello everyone,

I am trying to fine-tune an existing pre-trained model for using ssd_object detection. I am taking inspiration from this notebook: https://github.com/tensorflow/models/blob/master/research/object_detection/colab_tutorials/eager_few_shot_od_training_tf2_colab.ipynb

I am capable of saving my model after training, I get three files: checkpoint, ckpt-1.data-00000-of-00001 and ckpt-1.index

The model creation function procedure is:

Then I fine-tune the model and save it:
image

Assuming that I am doing things correctly when I want to re-initiate the model and load weights for inference, I am getting very bad results. Just like it’s not trained.

Restore weights function:

Can someone please help me find the problem?