ESSENTIAL READING · PAPER 51
EDU-CIRCUIT-HW: Evaluating Multimodal Large Language Models on Real-World University-Level STEM Student Handwritten Solutions
Sun, W., Chen, L., Cai, Y., Xie, H., et al. (2026). EDU-CIRCUIT-HW: Evaluating Multimodal Large Language Models on Real-World University-Level STEM Student Handwritten Solutions. arXiv preprint arXiv:2602.00095.
FOUND
Released 1,300+ handwritten STEM solutions as a dataset; multimodal models' error rates far exceeded expectations.
MEANS
AI grading is nowhere near reliable yet â human spot-checking is not optional.
SI DATA
No direct SI dataset counterpart yet — flagged for future audit expansion.