ESSENTIAL READING · PAPER 58

Prompt-Based Cost-Effective Evaluation and Operation of ChatGPT as a Computer Programming Teaching Assistant

Ballestero-Ribó, M., & Ortiz-Martínez, D. (2025). Prompt-Based Cost-Effective Evaluation and Operation of ChatGPT as a Computer Programming Teaching Assistant. arXiv preprint arXiv:2501.17176.

FOUND

Designed low-cost prompting schemes to auto-evaluate GPT feedback quality and estimate error-rate floors.

MEANS

Before deploying an AI TA, build an affordable evaluation pipeline — measurement is part of the deployment.

SI DATA

No direct SI dataset counterpart yet — flagged for future audit expansion.