ESSENTIAL READING · PAPER 59

Evaluating LLMs for Answering Student Questions in Introductory Programming Courses

Van Mullem, T., Mesuere, B., & Dawyndt, P. (2026). Evaluating LLMs for Answering Student Questions in Introductory Programming Courses. arXiv preprint arXiv:2603.28295.

FOUND

Built an evaluation benchmark from 170 real student questions; argues for verify-before-deploy.

MEANS

Educational AI should move from ship-then-test to verify-then-deploy.

SI DATA

No direct SI dataset counterpart yet — flagged for future audit expansion.