Guides

Write a skill assessment rubric your instructors apply the same way

8 min readProgresslyAI Team

A skill assessment rubric for a training school lists each skill as an observable action under a stated condition, says what evidence the assessor needs, and defines each status so two instructors watching the same student reach the same answer. The test of a rubric is not how detailed it looks but whether instructors agree when they use it.

In short:

  • Every skill has three parts: a condition, an observable action and the evidence needed.
  • Define each status in writing. "Mastered" should mean the same thing in every class.
  • Run a two-instructor check on a few students before relying on the rubric.
  • When instructors disagree, fix the wording, not just the one result.
  • Keep the rubric small enough to assess in a normal class.

This guide goes deeper than our how to track student progress guide, which covers the whole tracking process. Here the focus is the wording of each skill and the meaning of each status.

The three parts of an assessable skill

PartQuestion it answersWeak versionAssessable version
ConditionUnder what circumstances?"Swims""In the deep end, without a float or wall contact"
Observable actionWhat exactly does the student do?"Swims well""Swims 10 m front crawl with face in the water, breathing to the side at least every 4 strokes"
EvidenceWhat must the assessor see, and how often?"Instructor's judgement""Seen on 2 separate lengths in one session"

If an instructor cannot tell from the wording what to watch for, the skill is not ready. A useful check: could a substitute instructor assess it tomorrow from the rubric alone?

Define what each status means

Most schools need three statuses. Write the definitions where every instructor can see them:

StatusDefinitionWhat it is not
Not startedNot yet taught or not yet assessedA judgement that the student cannot do it
In progressAttempted under the condition, but not yet done independently to the evidence standardA participation award for attending
MasteredDone independently, under the condition, to the evidence standard, in front of an assessorA permanent guarantee; a skill can be reassessed

Two choices need a written rule because instructors otherwise decide differently. First, does one successful demonstration count, or do you need two on separate days? Second, does help such as a verbal cue still count as independent? Pick one answer for each and apply it everywhere.

A filled rubric: Stage 2 swimming

This is an illustrative rubric a swim school might write for its own Stage 2. It is not an official national or awarding-body standard.

#SkillConditionObservable actionEvidence needed
1Submerge and exhaleShallow end, standingFully submerges and blows bubbles for 3 seconds3 times in a row
2Push and glideFrom the wall, no floatGlides 3 m on the front, face in, arms extended2 separate attempts
3Back floatShallow end, no floatFloats on the back for 5 seconds, then stands unaided2 separate attempts
4Front crawl legsWith a kickboardKicks 10 m from the hip, legs mostly straightOnce, without stopping
5Front crawlNo floatSwims 5 m with face in the water and arms alternatingOnce, without standing
6Treading waterDeep water, instructor within reachStays upright, head clear, for 15 secondsOnce
7Safe entryPool sideSits, turns and lowers into the water holding the edgeEvery entry in one session

Seven skills is deliberate. An instructor with eight students in a 30-minute class can realistically assess two or three skills per student per session, so a long rubric goes stale.

Example: two instructors disagree

Two instructors watched the same invented student, Ben, swim during a joint session and recorded skill 5, front crawl:

Instructor AInstructor B
Status recordedMasteredIn progress
What they sawSwam 5 m with face in and alternating armsSwam 5 m with face in and alternating arms, but lifted his head to breathe twice
Their reasoningThe rubric says face in the water and arms alternating; both were trueLifting the head to breathe means the face was not in the water

Both instructors applied the rubric honestly. The disagreement comes from the wording: "face in the water" does not say whether breathing breaks count. The fix is to change the rubric, not to overrule one instructor:

Revised skill 5: Swims 5 m with face in the water between breaths and arms alternating. Lifting the head forward to breathe is allowed at this stage; side breathing is assessed in Stage 3.

With the revised wording, Ben is mastered. Record the change and the date, and reassess anyone whose result depended on the old wording.

Run a short agreement check before you rely on the rubric

  1. Choose 4 to 6 students and 2 or 3 skills.
  2. Have two instructors assess the same attempts independently, without discussing.
  3. Compare the results. Count how many of the paired results match.
  4. For every mismatch, ask each instructor what they saw and which words they relied on.
  5. Rewrite any skill or definition that caused a mismatch, then repeat with new students.

In an illustrative check of 6 students on 3 skills, 18 paired results with 15 matches is 83% agreement. There is no universal pass mark; what matters is that each mismatch led to a clearer rubric. Repeat the check when you add new instructors.

Common rubric problems and fixes

ProblemSymptomFix
Skill too broadInstructors argue about partial successSplit it into two or three skills
Hidden conditionResults differ between shallow and deep waterState the condition explicitly
Status driftNew instructors mark "mastered" soonerRetrain on the written definitions; rerun the agreement check
Rubric too longMany skills never assessedCut to what can be assessed in normal classes
Mixing attendance with skillRegular attenders marked in progress automaticallyRecord attendance separately; assess only what was seen

Using a rubric in ProgresslyAI

In ProgresslyAI, staff build their own curriculum as levels with ordered skills, and assign one current curriculum to each student. Write the condition and observable action into each skill's name and description. Owners and instructors then set each skill to not started, in progress or mastered; the three statuses match the definitions above, but the definitions themselves live in your staff guidance, not in the app.

The app stores the current status of each skill and replaces it when the skill is reassessed. It does not keep per-skill assessment notes, a dated assessment history or two instructors' separate ratings, so run agreement checks on paper or in a spreadsheet such as our free progress tracking template. It does not enforce prerequisites or award levels. See student progress tracking software.

Starter is free for up to 25 active students and 1 instructor seat. Pro costs USD $49/month for up to 200 active students and 5 instructor seats. Business costs USD $99/month with no cap on active students or instructor seats. AI report drafts need Pro or Business; readiness, retention and schedule suggestions need Business. Review the plans and included features before choosing.

When this approach is not enough

A checklist rubric suits practical skills with a clear observable result. It is a poor fit for work judged on quality across several dimensions, such as an essay or a choreography, where an analytic rubric with scored levels per criterion works better. If you teach to an external syllabus or safety standard, the awarding body's criteria come first; your rubric should restate them, not replace them.

How this guide was prepared

ProgresslyAI staff wrote this guide. The swim rubric, student and agreement figures are invented to show the method and are not an official standard. Product statements were checked against the current application.

Want to streamline your training business?

Create your school and start tracking progress. No credit card required.

Start free