Neural Network Benchmarking

How can I calculate number of MACs and flops for a particular NN architecture ?

1 Like

We already have a thread at:

https://tensorflow-prod.ospodiscourse.com/t/calculate-flops-in-tensorflow-and-pytorch-are-not-equal/941

/cc @markdaoust @thea

1 Like

I specifically looking for MACs. There seems to be nothing about this.

1 Like

https://tensorflow-prod.ospodiscourse.com/t/calculate-flops-in-tensorflow-and-pytorch-are-not-equal/941/8?u=bhack

1 Like

Hi Bhack,

Yes, that’s the basic idea, but if you look at softmax activation function. It contains the calculations for e to the power x.
So, that will be counted as FLOPS not MACs.
My understanding is one cannot divide FLOPS/2 to get MACs.
Please correct me if I am wrong.

1 Like