Ideas for scoring coding assignments

Hey guys, I am searching for ways to use NLP to score coding/programming assignments like what a teacher will do in an exam/test. what ideas come to mind?
any papers or similar problem solutions will be much appreciated!

There is a quite large literature about automatic essay scoring (AES) also with deep learning models like:

https://arxiv.org/abs/2205.03835

But as you are talking about coding/programming I think that in your case you need to look also at the evaluation metrics for the competitive code-gen models like:
https://arxiv.org/abs/2203.07814

1 Like

very helpful thanks!

Check also:

https://arxiv.org/abs/2203.05132v1

1 Like