Training and Validation Accuracy Graph

On fine tuning BERT, is it fine to get higher validation accuracy than training accuracy?

Hi @Rhythm_Arora, If Validation accuracy > training accuracy, this may be due to

  • The Validation data may be less complex than the training data
  • The number of samples in the validation data set may be less

It’s subjective to model performance and use case. Thank You!