On fine tuning BERT, is it fine to get higher validation accuracy than training accuracy?
Hi @Rhythm_Arora, If Validation accuracy > training accuracy, this may be due to
- The Validation data may be less complex than the training data
- The number of samples in the validation data set may be less
It’s subjective to model performance and use case. Thank You!