COMPANION VIDEO
Watch this concept unfold
The captioned companion video is available to accounts with video access. Read and practice the lesson below for free.
START HERE
The essential idea
A norm-referenced interpretation compares performance with a specified reference group. A criterion-referenced interpretation compares performance with an established standard or set of objectives. The same score can be unhelpful without knowing the comparison.
Ask whether the reference group and administration conditions support the intended use. Language, accommodations, development, and cultural context can affect interpretation. Do not confuse a percentile rank with percent correct.
A screening result indicates a need for further consideration under the relevant protocol; it is not automatically a diagnosis. Good assessment integrates sources, limitations, and the purpose of the decision.
BUILD THE REASONING · 01
Two questions a score can answer
A norm-referenced interpretation compares performance with a defined group. A criterion-referenced interpretation compares performance with a specified domain or performance standard. Neither is inherently superior; they serve different questions. A learner could rank high in a weakly prepared cohort while failing an essential skill criterion, or meet a criterion while ranking near the middle of a strong cohort.
A percentile rank of 70 means the score’s standing is around that point in the specified reference distribution according to the instrument’s convention for ties. It does not mean 70% correct, 70% of symptoms, or 70% mastery. A criterion such as “includes all three elements of a support request” needs a defined task, scoring anchors, and a defensible decision process rather than being inferred from rank.
Swipe or scroll horizontally to compare all columns. With a keyboard, focus this table and use the arrow keys.
| Fictional result | What it can answer | What it cannot establish alone |
|---|---|---|
| 80th percentile on a skills quiz | Relative standing in the named norm group | That every essential counseling skill is present |
| 8/10 items correct | Percentage correct on these items | Standing in a population or transfer to untested tasks |
| Meets all four rubric requirements in two new cases | Performance on the specified sampled criteria | Professional competence across settings |
| Above a screening cutoff | Whether follow-up is indicated under the tool’s supported use | A diagnosis or individual treatment plan |
BUILD THE REASONING · 02
Inspect who supplies the comparison
Read the norm sample’s recruitment, age/development, language, education, setting, date, and subgroup representation. A large norm sample can still be inappropriate for the intended comparison. If a measure is administered with a changed format or accommodation, consult its evidence and instructions about what interpretations remain supported. An accommodation can improve access without automatically preserving every original comparison.
Explain the reference in the feedback: “Compared with adults in the manual’s community sample…” Then explain uncertainty and what additional information matters. Avoid labels such as normal/abnormal when the measure only supplies relative standing. A percentile can shift when the norm group changes even though the person’s raw performance is identical.
BUILD THE REASONING · 03
Make a criterion defensible
For a fictional support-request task, define three observable elements: relevant context, a specific requested action, and room for the other person to respond. Score each with examples and repeat the task in a new situation. A criterion decision should explain why those elements matter, how raters apply them, and what happens when evidence is borderline. Arbitrarily calling 80% a mastery threshold does not validate it.
Feedback should lead to a next step. A learner who omits the requested action needs a model, a focused practice opportunity, and a different case for reassessment. Distinguish performance on this learning activity from clinical readiness, graduation, or licensure. Those consequential decisions require their own standards, evidence, and authorized evaluators.
FROM CONCEPT TO DECISION
High rank, missing skill
A fictional trainee scores at the 85th percentile on a knowledge quiz but omits checking the client’s understanding in two consent role-plays. The course requires an accurate explanation, an invitation for questions, and teach-back.
Separate the interpretations
The quiz rank describes relative standing in the quiz’s reference group. The role-play criterion concerns an observable behavior that the rank does not replace.
Locate the actual gap
The trainee explains terms and invites questions but does not ask the client to explain their understanding. The feedback can therefore target teach-back.
Practice and reassess
Model a non-shaming teach-back question, rehearse it, then use a different consent scenario with the same clear criterion.
Report both results accurately
Describe strong relative quiz performance and an unmet role-play criterion rather than averaging them into an unsupported readiness claim.
A useful assessment system can report rank and criterion performance together while preserving the different decisions they support.
MAKE THE REASONING YOURS
Work through a new situation
Put the lesson to work.
4 case-based questions. Plausible choices. Feedback that explains the distinction.
READ WITH A PURPOSE
Best references
These readings deepen the specific models, evidence, and decisions in this lesson.
- AERA/APA/NCME: Standards for Educational and Psychological Testing (2014)
Read Chapters 1–3 on intended interpretations, precision, and fairness. Use the standards to evaluate evidence for a particular use, not to label an instrument universally valid.
- COSMIN Manual, Version 2: Outcome Measurement Instruments
Use the distinctions among content validity, structural validity, reliability, measurement error, and responsiveness to evaluate the fictional instrument dossier.
- NIST: Normal Distribution
Use the distribution explanation to understand why the same raw distance can map differently to percentile standing under different reference distributions.
KEEP THE TAKEAWAY
A score’s meaning depends on its reference and purpose.
Save this lesson to your study log. Your case-practice result is shown separately in the quiz.
Sign in to save progressIndependent educational material for study alongside course readings and supervision. Examples are fictional. Completion and quiz scores do not establish clinical competence, university credit, or exam readiness. AI-assisted content review is separate from qualified human educational approval.