Using the benchmark tool to analyze tflite model run time and memory, found that when setting use_gpu=true, "initialized session" time is very long,while setting false the time is short. so i want to know how to reduce Initialized session time when to use_gpu? thanks
Do you have any code snippet of what you tried?
are you using the cmd line tool?
I don’t know if it could be related to:
yes，i uesd the cmd line tool like this “/benchmark_model --graph=fp16.tflite --num_threads=4 --use_gpu=true” the Initialized session in 940.822ms. however when i use the line “/benchmark_model --graph=car_fp16.tflite --num_threads=4 --use_gpu=false” the Initialized session in 91.076ms.
i want to know how to reduce Initialized session time when to use_gpu?
@Bhack 's comment has a very good discussion on the topic, I guess it can help you