The Correct Answer Trap: Pedagogically-Grounded Detection and Feedback for Hidden Misconceptions

June 22, 2026 ยท Grace Period ยท ๐Ÿ› the AIED PEAF 2026: Workshop on Pedagogical Evaluation of Automated Feedback

โณ Grace Period
This paper is less than 90 days old. We give authors time to release their code before passing judgment.
Authors Moiz Imran, Sahan Bulathwela arXiv ID 2606.23205 Category cs.CY: Computers & Society Cross-listed cs.AI, cs.IR Citations 0 Venue the AIED PEAF 2026: Workshop on Pedagogical Evaluation of Automated Feedback
Abstract
Automated feedback systems that rely on answer correctness will reinforce, rather than address, misconceptions when students reach the correct answer through flawed reasoning. We investigate automatic detection of these hidden misconceptions using 20,964 real student responses from the Eedi mathematics platform. Fine-tuned classifiers detect only 57% of these hidden misconceptions, and standard ML interventions do not improve on this. An open-weight reasoning model detects 84%, but at realistic prevalence, false alarms outnumber genuine detections roughly 8 to 1. We present a graduated assessment rubric that separates answer correctness from method validity, and propose a detect-verify-escalate pipeline that routes uncertain cases to diagnostic follow-up questions rather than directly to teachers. Two deployment modes adapt the pipeline: a teacher dashboard where the system filters a review queue, and an autonomous tutor where flags trigger low-cost formative follow-up.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

๐Ÿ“œ Similar Papers

In the same crypt โ€” Computers & Society

R.I.P. ๐Ÿ‘ป Ghosted

Green AI

Roy Schwartz, Jesse Dodge, ... (+2 more)

cs.CY ๐Ÿ› arXiv ๐Ÿ“š 1.5K cites 7 years ago