How do i setup tensorboard profiler for training , as currently is not working and not showing profiling tab?

General Discussion
,
#1

Hi all, I have wanted to add profiling to my train code, but it’s not showing up in tensorboard

    %load_ext tensorboard
    experiment_log_dir = '/dbfs/prajwal.rao/logs/'
    tboard_callback = tf.keras.callbacks.TensorBoard(log_dir = "/dbfs/prajwal.rao/logs/mle_lstm_combined_profile",
                                                     histogram_freq = 1,
                                                     profile_batch = '500,540')
    
    model.fit(train_dataset_val, 
                         steps_per_epoch=steps_per_epoch,
                         epochs=NUM_EPOCHS,
                         validation_data=val_dataset_val,
                         validation_steps=validation_steps,
                         verbose=2,callbacks = [tboard_callback])

I have installed tensorboard-plugin-profile on my system but can’t see the profile section:

but in the logs the data is there eg:
/dbfs/prajwal.rao/logs/mle_lstm_combined_profile/train/plugins/profile/2022_01_19_01_55_20/1221-040809-hr2wu5va-10-173-52-147.input_pipeline.pb0

1 Like
#3

Have you tried hitting refresh on TensorBoard?
It happened to me where “Profile” was not showing but after clicking TB refresh it showed.

#4

I refreshed multiple times , still no change , tensorboard-plugin-profile is installed on system ,
but data is there on system :
/xxx/logs/20220119-102606/train/plugins/profile/2022_01_19_10_26_32

#6

I have the same problem. I do not see the profiling tab. Refreshing does not help.

#8

I’m having the same problem, How did you manage to correct the issue