How can i run TFLite model using GPU support on Jetson Nano?

General Discussion
, ,
#1

Hi, I would like to run a .tflite model on my Jetson Nano using GPU support. I tried to follow these instructions Python quickstart  |  TensorFlow Lite but seems that there’s no matching distribution for tflite-runtime. I also tried to follow Build TensorFlow Lite for ARM boards but when i do import tensorflow in the code seems there’s no module named tensorflow. How can i do to run these models?

Thanks.

#3

You can run TF/TFLite with this docker container: strong textNVIDIA L4T TensorFlow | NVIDIA NGC

There is also this small package that includes the TFLITE Interpreter without having to install the entire TF library (pip3 install --extra-index-url Coral PEP-503 Repository tflite_runtime)