StudyBrixFree worksheets, study guides and courses

Reading & writing · Grades 9–12

A score without a guarantee

An original passage with comprehension questions and a teacher key.

Make a worksheet

A score without a guarantee

A school trial used software to flag possible missing steps in worked solutions. The tool correctly flagged several incomplete examples but also flagged a concise valid method it had not been designed to recognize. The teacher kept the software as a prompt for review rather than an automatic marking authority. Pupils could explain their reasoning, and final decisions considered the actual mathematics. In the report, the team separated the number of flags from the number of confirmed errors. A warning was useful evidence to inspect, not proof of a mistake.

Try it yourself

  1. Which case showed a false positive?

    1. It flagged an incomplete example.
    2. The tool flagged a concise but valid method.
    3. The teacher reviewed a solution.
    4. Pupils explained their work.

  2. Why were flags and confirmed errors counted separately?

  3. What role did the teacher retain?

    1. only counting software messages
    2. final judgement based on the actual reasoning
    3. accepting every flag unchanged
    4. hiding valid alternatives

  4. How did allowing pupils to explain their method improve the process?

  5. Which statement best matches the report?

    1. Every flag proves wrongdoing.
    2. No automated tool can ever help.
    3. A warning identifies something to inspect, not a guaranteed error.
    4. Concise methods are always invalid.

  1. Suggest a useful performance measure beyond the total number of flags.

Answers and marking notes

Answers and marking notes
  1. The tool flagged a concise but valid method.

    A valid answer was incorrectly treated as suspicious.

  2. A flag is a prediction or prompt; review can show that some flagged work is valid.

    Credit the difference between model output and verified outcome.

  3. final judgement based on the actual reasoning

    The software did not replace mathematical review.

  4. It provided context and evidence that the tool might not recognize.

    Credit review of alternative valid reasoning.

  5. A warning identifies something to inspect, not a guaranteed error.

    The report treats the tool as a limited aid.

  6. The proportion of flags confirmed as errors, missed errors, or performance across different valid solution methods.

    Credit a measure that distinguishes useful detection from mere activity.

Preview material · independent educational review required. Grade bands are approximate, not official curriculum alignment.