The notebook
Tool2026-06-25#evals

Use Socratic eval prompts in class

Socratic eval prompts teach students to inspect systems instead of merely reacting to outputs. The question shapes the habit.

Good classroom eval prompts are short, reusable, and attached to visible artifacts. They work on a model answer, a tool plan, a note, a definition, or a citation list.

The strongest prompt is often: what would you need to see before you let this action run?

Aha moment

The question teaches the habit. Ask about failure, missing receipts, and next evidence instead of asking if it is good.

Try this

Give students four prompts: what fails first, what receipt is missing, what term is undefined, and what evidence changes this.

Watch for

  • Eval questions that invite taste instead of inspection
  • Students scoring outputs without citing artifacts
  • Questions that do not transfer to another workflow