Reviewer reference
Pilot Readiness Template
A lightweight template for advisor review, redacted student testing, metrics, and failure tracking.
Advisor review
Record reviewer, date, redacted scenario, whether the output clearly says it is not an official audit, whether the advisor summary supports appointments, wording that could create false confidence, and requirements needing clearer advisor-review labels.
Student usability test
Record participant group, device/browser, task completion for Current Progress, the generated path, Advisor Summary, and optional own-plan comparison; note confusing steps, advisor-verification comprehension, and whether a Plan PDF or manual courses were used.
Metrics and failure log
Track Current Progress completion, generated-path usefulness, own-plan comparison completion, parse failures, rate-limit events, accessibility issues, advisor-review counts, scenario, symptom, severity, owner, and status. Use synthetic or redacted materials only.