Image Classification with the ability to verify Fonts and image abnormalities or errors in the image

Hi I am working on a project to classify football (Soccer) team crests, I have a working model that accomplishes the initial classifications. I need to develop not only the ability to verify that the image is indeed a particular team crest I need to be able to find errors or possible errors (imperfections) in the image design itself and or font issues that deviate from the correct font for the Team Crest.

Would this kind of verification or sub-classification have to be done post the initial team classification with another model that classifies errors in rendering or font errors?

Thoughts or direction on this is appreciated.