Write a skill assessment rubric your instructors apply the same way
A skill assessment rubric for a training school lists each skill as an observable action under a stated condition, says what evidence the assessor needs, and defines each status so two instructors watching the same student reach the same answer. The test of a rubric is not how detailed it looks but whether instructors agree when they use it.
In short:
- Every skill has three parts: a condition, an observable action and the evidence needed.
- Define each status in writing. "Mastered" should mean the same thing in every class.
- Run a two-instructor check on a few students before relying on the rubric.
- When instructors disagree, fix the wording, not just the one result.
- Keep the rubric small enough to assess in a normal class.
This guide goes deeper than our how to track student progress guide, which covers the whole tracking process. Here the focus is the wording of each skill and the meaning of each status.
The three parts of an assessable skill
| Part | Question it answers | Weak version | Assessable version |
|---|---|---|---|
| Condition | Under what circumstances? | "Swims" | "In the deep end, without a float or wall contact" |
| Observable action | What exactly does the student do? | "Swims well" | "Swims 10 m front crawl with face in the water, breathing to the side at least every 4 strokes" |
| Evidence | What must the assessor see, and how often? | "Instructor's judgement" | "Seen on 2 separate lengths in one session" |
If an instructor cannot tell from the wording what to watch for, the skill is not ready. A useful check: could a substitute instructor assess it tomorrow from the rubric alone?
Define what each status means
Most schools need three statuses. Write the definitions where every instructor can see them:
| Status | Definition | What it is not |
|---|---|---|
| Not started | Not yet taught or not yet assessed | A judgement that the student cannot do it |
| In progress | Attempted under the condition, but not yet done independently to the evidence standard | A participation award for attending |
| Mastered | Done independently, under the condition, to the evidence standard, in front of an assessor | A permanent guarantee; a skill can be reassessed |
Two choices need a written rule because instructors otherwise decide differently. First, does one successful demonstration count, or do you need two on separate days? Second, does help such as a verbal cue still count as independent? Pick one answer for each and apply it everywhere.
A filled rubric: Stage 2 swimming
This is an illustrative rubric a swim school might write for its own Stage 2. It is not an official national or awarding-body standard.
| # | Skill | Condition | Observable action | Evidence needed |
|---|---|---|---|---|
| 1 | Submerge and exhale | Shallow end, standing | Fully submerges and blows bubbles for 3 seconds | 3 times in a row |
| 2 | Push and glide | From the wall, no float | Glides 3 m on the front, face in, arms extended | 2 separate attempts |
| 3 | Back float | Shallow end, no float | Floats on the back for 5 seconds, then stands unaided | 2 separate attempts |
| 4 | Front crawl legs | With a kickboard | Kicks 10 m from the hip, legs mostly straight | Once, without stopping |
| 5 | Front crawl | No float | Swims 5 m with face in the water and arms alternating | Once, without standing |
| 6 | Treading water | Deep water, instructor within reach | Stays upright, head clear, for 15 seconds | Once |
| 7 | Safe entry | Pool side | Sits, turns and lowers into the water holding the edge | Every entry in one session |
Seven skills is deliberate. An instructor with eight students in a 30-minute class can realistically assess two or three skills per student per session, so a long rubric goes stale.
Example: two instructors disagree
Two instructors watched the same invented student, Ben, swim during a joint session and recorded skill 5, front crawl:
| Instructor A | Instructor B | |
|---|---|---|
| Status recorded | Mastered | In progress |
| What they saw | Swam 5 m with face in and alternating arms | Swam 5 m with face in and alternating arms, but lifted his head to breathe twice |
| Their reasoning | The rubric says face in the water and arms alternating; both were true | Lifting the head to breathe means the face was not in the water |
Both instructors applied the rubric honestly. The disagreement comes from the wording: "face in the water" does not say whether breathing breaks count. The fix is to change the rubric, not to overrule one instructor:
Revised skill 5: Swims 5 m with face in the water between breaths and arms alternating. Lifting the head forward to breathe is allowed at this stage; side breathing is assessed in Stage 3.
With the revised wording, Ben is mastered. Record the change and the date, and reassess anyone whose result depended on the old wording.
Run a short agreement check before you rely on the rubric
- Choose 4 to 6 students and 2 or 3 skills.
- Have two instructors assess the same attempts independently, without discussing.
- Compare the results. Count how many of the paired results match.
- For every mismatch, ask each instructor what they saw and which words they relied on.
- Rewrite any skill or definition that caused a mismatch, then repeat with new students.
In an illustrative check of 6 students on 3 skills, 18 paired results with 15 matches is 83% agreement. There is no universal pass mark; what matters is that each mismatch led to a clearer rubric. Repeat the check when you add new instructors.
Common rubric problems and fixes
| Problem | Symptom | Fix |
|---|---|---|
| Skill too broad | Instructors argue about partial success | Split it into two or three skills |
| Hidden condition | Results differ between shallow and deep water | State the condition explicitly |
| Status drift | New instructors mark "mastered" sooner | Retrain on the written definitions; rerun the agreement check |
| Rubric too long | Many skills never assessed | Cut to what can be assessed in normal classes |
| Mixing attendance with skill | Regular attenders marked in progress automatically | Record attendance separately; assess only what was seen |
Using a rubric in ProgresslyAI
In ProgresslyAI, staff build their own curriculum as levels with ordered skills, and assign one current curriculum to each student. Write the condition and observable action into each skill's name and description. Owners and instructors then set each skill to not started, in progress or mastered; the three statuses match the definitions above, but the definitions themselves live in your staff guidance, not in the app.
The app stores the current status of each skill and replaces it when the skill is reassessed. It does not keep per-skill assessment notes, a dated assessment history or two instructors' separate ratings, so run agreement checks on paper or in a spreadsheet such as our free progress tracking template. It does not enforce prerequisites or award levels. See student progress tracking software.
Starter is free for up to 25 active students and 1 instructor seat. Pro costs USD $49/month for up to 200 active students and 5 instructor seats. Business costs USD $99/month with no cap on active students or instructor seats. AI report drafts need Pro or Business; readiness, retention and schedule suggestions need Business. Review the plans and included features before choosing.
When this approach is not enough
A checklist rubric suits practical skills with a clear observable result. It is a poor fit for work judged on quality across several dimensions, such as an essay or a choreography, where an analytic rubric with scored levels per criterion works better. If you teach to an external syllabus or safety standard, the awarding body's criteria come first; your rubric should restate them, not replace them.
How this guide was prepared
ProgresslyAI staff wrote this guide. The swim rubric, student and agreement figures are invented to show the method and are not an official standard. Product statements were checked against the current application.
Related guides
Want to streamline your training business?
Create your school and start tracking progress. No credit card required.
Start free