TensorFlow GPU accuracy is much lower than CPU accuracy

I am performing the image classification using ANN. But the CPU accuracy is much higher than my gpu accuracy
i tried training the models with both the CPU and GPU.

Using the GPU

Using the CPU

The accuracy increases to almost 90% using the CPU and 50 epochs but with the gpu the accuracy keeps on decreasing.
Please help me with this. What is the way out ?

Hi @DC1809 . Welcome to the Tensorflow forum.
Can you please tell what machine you are using? I remember I read quite a few such issues with people using Macbooks.
Maybe you can try to run your code in Colab, once with GPU and once with CPU and see whether you get same significantly different accuracy?
Maybe you can also provide on Tensorflow version you are using?