How can I calculate number of MACs and flops for a particular NN architecture ?
We already have a thread at:
/cc @markdaoust @thea
I specifically looking for MACs. There seems to be nothing about this.
Yes, that’s the basic idea, but if you look at softmax activation function. It contains the calculations for e to the power x.
So, that will be counted as FLOPS not MACs.
My understanding is one cannot divide FLOPS/2 to get MACs.
Please correct me if I am wrong.