Gelu (activation function) return of array

General Discussion
,
#1

Hi, i am facing difficulties in try to understand what is the meaning of the array given back by the function tf.nn.gelu.

Can I use these values to do classification? I’m giving in input to the net (Visual transformer “ViT”) an image that can be classified in 4 classes [0,50,80,100].
The function gives back an array that is like:
[-0.0040, -0.150, 0, 0.840, 2.99]
can I classify my image with the index of the highest value in the array given by the GELU function?
So I this case would be 2.99 (index 4) so the class “100” (index 4).

Are these values in the range of values between [-3,3]?

#3

Please refer