TF1 each operator timing

Eyal_Hirsch · October 26, 2021, 5:35pm

I would like to see (preferably in the log/on screen) how much time each OP in my model takes. Alternativaly, or better, that each OP in the model/graph will log the time when it starts its execution.
Is that possible with TF1?

Bhack · October 26, 2021, 6:43pm

TF1 is ETA, you could use our profiler with TF2:

Eyal_Hirsch · October 26, 2021, 7:34pm

What do you mean ETA? end of life?
I’m still planned to use TF1 for quite some time. Is there a valid option to do this in TF1 nevertheless?

Bhack · October 26, 2021, 7:59pm

Yes It is EOL…

These are the last info available on the TF 1.x tag

github.com

tensorflow/tensorflow/blob/v1.15.5/tensorflow/core/profiler/g3doc/python_api.md

## Python API Tutorials

* [Parameters and Shapes](#parameters-and-shapes)
* [Float Operations](#float-operations)
* [Time and Memory](#time-and-memory)
* [Visualize](#visualize)
* [Multi-step Profiling](#multi-step-profiling)

```import tensorflow as tf```.

### Parameters and Shapes.
```python
# Print trainable variable parameter statistics to stdout.
ProfileOptionBuilder = tf.profiler.ProfileOptionBuilder

param_stats = tf.profiler.profile(
    tf.get_default_graph(),
    options=ProfileOptionBuilder.trainable_variables_parameter())

# Use code view to associate statistics with Python codes.

This file has been truncated. show original

lgusm · October 28, 2021, 10:06am

Any specific reason why you don’t want to update to TF2?