A useful programme review links each judgement to evidence and ends in specific, owned recommendations.
scripts/program_metrics.py turns learner records into the outcome indicators most reviews need.
Trigger Conditions
Activate this skill when the user:
- Reviews a language programme, department or course for quality or accreditation
- Writes an annual report or self-evaluation for a language school
- Has learner data (enrolments, results, attendance, surveys) to interpret
- Needs recommendations and an action plan after a review
Curriculum checks: cefr-aligned-syllabus-builder, actfl-proficiency-curriculum-mapper. Observation evidence: language-teacher-observation-form-builder.
Workflow
1. SCOPE -> purpose, courses, period, audience (management, accreditor, funder)
2. EVIDENCE -> learner data, surveys, observations, documents, interviews (references/review-framework.md)
3. DATA -> python scripts/program_metrics.py students.csv
4. FINDINGS -> strengths and areas for development per area, each with two sources
5. RECOMMEND-> specific, prioritised, owned, dated, measurable
6. WRITE -> references/report-template.md; executive summary last
7. CHECK -> every recommendation traces to a finding; small groups flagged; data anonymisedAsk for missing evidence rather than inventing it; where evidence is thin, say so in the limitations section.
Indicators (program_metrics.py)
| Code | Severity | Finding |
|---|---|---|
| PM001 | high | Retention below threshold (default 75%) |
| PM002 | medium | Pass rate below threshold (default 75%) |
| PM003 | medium | Median level gain of completers is zero |
| PM004 | low | Mean attendance below threshold (default 80%) |
| PM005 | low | Mean satisfaction below 3.5/5 |
| PM006 | info | Fewer than 10 students |
Output Format
A report following report-template.md: executive summary, context, method and limitations, findings by area with evidence, outcomes data table, recommendations table (priority, owner, deadline, success measure), action plan.
Scripts
python scripts/program_metrics.py students.csv [--retention 75] [--pass 75] [--attendance 80]Columns: student, course, status (completed/withdrawn/continuing), start_level, end_level, passed, attendance, satisfaction (only the first three are required). Exit codes: 0 no high findings, 1 high findings, 2 read error or bad CSV.
Additional Resources
| File | Content |
|---|---|
| review-framework.md | Review areas and questions, evidence sources, key indicators, findings to recommendations, ethics and data |
| report-template.md | Section-by-section report template and writing style |
academic-english-eap-course-planner
Plan English for Academic Purposes (EAP) courses: pre-sessional, in-sessional, foundation, IELTS preparation and discipline-specific EAP, with syllabus strands (academic reading, lecture listening and note-taking, essay and report writing, paraphrase, summary and synthesis, referencing and plagiarism, seminars and presentations, academic vocabulary, critical thinking), a 10-week pre-sessional outline, exit assessment, IELTS-CEFR alignment and academic style (formality, hedging, cohesion, reporting verbs). Estimates study hours and weeks to close an IELTS gap from overall or per-skill scores (IELTS rounding, minimum per skill, priority skills, feasibility before a deadline), and checks learner texts for contractions, informal words with academic alternatives, unhedged claims, 'you', And/But/So starts, rhetorical questions and missing citations.
actfl-proficiency-curriculum-mapper
Map world language curricula to the ACTFL framework: proficiency levels (Novice, Intermediate, Advanced, Superior, Distinguished with sublevels), functions, contexts, text types and accuracy, proficiency vs performance, the three modes of communication (interpretive, interpersonal, presentational), the 5 Cs World-Readiness Standards, backward-designed thematic units with Integrated Performance Assessments, typical programme targets and FSI time estimates. Looks up approximate ACTFL-CEFR-ILR equivalences with what each level can do, and checks a unit map for missing modes, rehearsed skits mislabelled as interpersonal, translation or word lists as interpretive tasks, and units without an integrated performance assessment.
adult-literacy-esl-lesson-builder
Build lessons for adult ESL learners who are developing literacy (LESLLA learners: pre-literate, non-literate, semi-literate, literate in a non-Roman script): learner profiles and sensitive initial assessment, principles (oral language first, known to new, systematic phonics with adult-relevant text, repetition, classroom skills, respect for experience), a lesson routine (oral warm-up, review, new grapheme, blending, segmenting, decodable text, writing, functional literacy, Language Experience Approach), a phonics sequence for adults, sight words, functional literacy targets (forms, signs, medicine labels) and portfolio assessment. Checks whether a reading text is decodable with the letter-sound patterns and sight words taught so far, catching untaught digraphs, listing non-decodable words with the untaught part, and suggesting the most useful next patterns.
authentic-material-lesson-adapter
Turn authentic material (news articles, podcasts, videos, songs, menus, timetables, adverts, social media posts, forms, infographics) into language lessons by grading the task rather than the text. Selects texts for interest, relevance, exploitability, coverage, cultural load and rights; finds the 4-6 words to pre-teach, words to gloss on the page and words learners can ignore, plus names and cultural references to explain, with reading time by level; and builds a lesson shape (lead-in, pre-teach, gist or scanning, graded detail task, language focus on chunks and register, response) with task ideas per material type and level from A1 to C1. Covers copyright, fair dealing and fair use, Creative Commons and attribution.
can-do-statement-writer
Write and review can-do statements for language courses, units, lessons and learner self-assessment, CEFR or NCSSFL-ACTFL style: action (observable verb) + text or situation + level-specific conditions, learner ('I can') and descriptor ('Can') versions, progressions of one activity from A1 to C1, and coverage of reception, production, interaction and mediation. Includes a verb bank by mode and level and condition and text-type banks. Lints statements for teacher-centred phrasing, knowledge instead of use (learn, know, understand the passive), missing context, two skills in one statement, vague quality words, grammar items as outcomes, overlong statements and missing modes in a set.
cefr-aligned-syllabus-builder
Build language course syllabuses aligned to the CEFR (A1-C2, plus levels, Companion Volume 2020): entry and exit levels, guided learning hours and course length (with an L1-distance adjustment), syllabus type (topic, functional-notional, task-based, skills-based, multi-strand), unit-by-unit can-do outcomes, grammar from a core inventory by level, vocabulary, functions, pronunciation, balance of reception, production, interaction and mediation, recycling and assessment points. Checks a syllabus for units without can-do statements, core grammar for the level not covered, items above the course level, skills missing from most units and units with no vocabulary or functions.