speaking-rubric-builder

A speaking rubric works when its criteria match the task, each band describes observable features that change from one band to the next, and trained raters agree. scripts/rubric_check.py checks the rubric; scripts/rater_agreement.py checks the raters.

#Trigger Conditions

Activate this skill when the user:

• Needs a rubric or band descriptors for a speaking test or classroom speaking task
• Wants a speaking task that elicits a level (interview, long turn, discussion, role play)
• Is training or standardising raters
• Has two teachers' scores and wants to know if they agree

Writing rubrics: writing-rubric-for-l2-builder. Placement interviews: language-placement-test-builder.

#Workflow

1. PURPOSE   -> placement, progress, achievement, certification; level(s); stakes
2. TASKS     -> at least two task types that elicit the level (references/speaking-criteria.md)
3. TYPE      -> holistic / analytic / checklist
4. CRITERIA  -> 3-5 that match the construct
5. BANDS     -> 4-6 bands; write the middle band first; observable features; consistent frequency words
6. CHECK     -> python scripts/rubric_check.py rubric.csv
7. STANDARD  -> benchmarks, practice, qualification (references/rater-standardisation.md)
8. AGREEMENT -> python scripts/rater_agreement.py double_ratings.csv

#Review Codes

#Output Format

The task(s) with instructions and timing, the rubric as a criteria x bands table, scoring and level conversion rules, and the rubric_check.py result. For rater checks, the agreement summary with actions (re-standardise, third ratings, feedback on severity).

#Scripts

python scripts/rubric_check.py rubric.csv

Columns: criterion, band, descriptor. Exit codes: 0 no high findings, 1 high findings, 2 read error.

python scripts/rater_agreement.py scores.csv

Columns: student, rater_a, rater_b (optional criterion). Exit codes: 0 no high findings, 1 high findings, 2 read error or fewer than two rows.

#Additional Resources