Instructional Design

The learner passed the AI workshop. Can they fix a different mistake on Monday?

Design an assessment that distinguishes remembering the demonstration from using the skill.

By Ashley Kays Rabbitt · November 18, 2026

A course demonstrates how to check an AI-generated meeting summary. The final quiz asks students which fields belong in a summary. People score well, yet supervisors still receive action lists with missing owners. The test asked learners to recognize the lesson’s vocabulary. The job requires them to make a decision with imperfect evidence.

Start with a fictional transcript. One person volunteers to update a draft. Another says the deadline might be Friday. A third asks whether finance has approved the expense. The expected action list should assign the draft, mark the date as uncertain, and keep the expense as an unanswered question.

Three grading decisions in one handoff
VolunteerAssign the draft to its owner
Tentative dateKeep Friday unconfirmed
Open questionLeave finance approval unresolved

Change the surface while preserving the reasoning

During instruction, show a worked example with the evidence highlighted. For the assessment, change the setting to a vendor handoff and remove the highlighting. Include a confident but incorrect machine-generated summary. Ask the learner to submit the corrected summary and mark the passage supporting each edit.

Score the work along three dimensions: commitments attributed to the right person, uncertain facts kept uncertain, and decisions traceable to source language. Agree in advance that turning an unanswered question into an approval requires another attempt. A polished paragraph should earn no extra credit for that error.

The Institute of Education Sciences recommends alternating worked examples with problems and revisiting knowledge through retrieval. Those principles support the design. Your organization still has to check transfer on its own work. Institute of Education Sciences • Organizing instruction and study A week later, ask supervisors to review one appropriately de-identified artifact using the same three criteria. If the same error persists, change the practice case before adding another slide to the lesson.