Golden Example — Scorecard Design (Consultant Process)
The Benchmark
Status: AWAITING FIRST DEPLOYMENT
The golden example for a consultant-designed scorecard will be drawn from the first completed client deployment that passes full QC and is used in a live search. This file will be updated with the specific file location, structural analysis, and values to extract once that deployment exists.
What the Golden Example Will Demonstrate
When the first qualifying deployment is complete, this file will document:
Structural Benchmark
- How focus areas are organized and described at production quality
- The depth and specificity of evaluation criteria descriptions
- How behavior-based questions are structured within each focus area
- The scoring scale implementation — definitions per level, written justification prompts
- The recommendation framework — how Strong Yes / Yes / No / Strong No (or equivalent) is presented
- How the presentation evaluation section integrates with the competency sections
Design Quality Benchmark
- Focus area traceability — every focus area maps to a role requirement
- Question quality — every question elicits specific behavioral evidence, not hypothetical intent
- Criteria specificity — "what good looks like" is defined in observable, measurable terms
- Interviewer preparation materials — what interviewers receive alongside the scorecard
What to Study
- How focus areas are described from the perspective of the specific role, not generic competency language
- How questions are tailored to the organization's context, not pulled from a generic bank
- How the scoring scale is calibrated to the complexity of the evaluation
- How the scorecard feeds the debrief — what information the facilitator has access to after collection
Interim Design Specifications
Until the golden example exists, use these specifications for scorecard structure:
Scorecard Sections (in order)
- Header — Role title, organization name, version, date, confidentiality notice
- Interviewer Information — Interviewer name, interview date, candidate name, interview format (virtual/in-person), paired partner name
- Presentation Evaluation (if applicable) — Criteria for resume walkthrough, topic presentation, time management, Q&A handling. Scoring per criterion with justification field.
- Mission / Values / Must-Haves Alignment — Organization-specific criteria. How the candidate aligns with the organization's core requirements as observed across all interactions. Scoring with justification.
- Focus Area Evaluation — The interviewer's assigned competency domain. 3-5 behavior-based questions, pre-populated. Space for candidate response notes, individual question scoring (optional), and overall focus area score with justification.
- Overall Recommendation — Strong Yes / Yes / No / Strong No (or practitioner's equivalent scale). Required written justification explaining the recommendation. Prompt for: key strengths observed, areas of risk or concern, areas needing further exploration.
- Additional Notes — Open field for anything the interviewer observed that doesn't fit the structured sections.
Focus Area Description Format
Each focus area should include:
- Focus area name — Clear, specific to the role (not generic competency language)
- Why this matters for this role — 1-2 sentences connecting the focus area to the organization's specific needs
- What good looks like — Observable behaviors and evidence that would indicate strength in this area
- What risk looks like — Observable behaviors and evidence that would indicate concern
- Questions — 3-5 behavior-based questions with follow-up prompts
Scoring Scale Design Principles
Whatever scale the practitioner uses, each level must:
- Be defined in behavioral terms, not just adjectives
- Be distinguishable from the adjacent level without ambiguity
- Include an anchor example or description that helps the interviewer calibrate
- Apply consistently across all focus areas
What the Golden Example Does NOT Provide
Even after the golden example is established:
Focus areas for your scorecard. The golden example's focus areas are specific to the role and organization it was built for. Your scorecard's focus areas come from the extraction interview and the position profile for the current search.
Questions for your scorecard. The golden example's questions are specific to the competency domains it evaluates. Your questions come from the current role's requirements and the practitioner's methodology.
Scoring scale for your scorecard. The golden example uses whatever scale the practitioner chose for that engagement. Your scorecard uses the scale confirmed during extraction for the current search.
Interviewer assignments for your scorecard. The golden example's assignments reflect a specific interview team. Your assignments come from the kickoff and alignment meeting for the current search.