The paper asks how instructors can tell whether a student understands the reasoning behind a correct assignment when large language models can produce the solution for them. It answers by describing ProofPaths, an AI agent framework that pairs rubric-based grading with individualized, interactive interviews. It reports no results from use with students.
- Several grading agents assess each submission against the instructor's guidance. They then exchange critiques and revise their judgments.
- The agents' scores decide which review supplies the grade and the feedback the student receives.
- An interview agent asks the student to justify steps in the submission and uses the answers to shape follow-up questions.
- Each interview question is tied to a retrieved excerpt from the submission, so instructors can set the student's explanation beside the passage it cites.
- The system tracks assessment progress and stores grading reviews and interview transcripts for every submission. Instructors can inspect them and override grades inside the assignment workflow.
The authors present the design as a way to probe understanding without the recurring staff effort that one-on-one interviews demand. The checks they describe are deterministic tests of the assessment controllers, which examine source handling and score aggregation. Other tests confirm limits on how many correction attempts the system will make.




