Structured interview kit: questions, rating anchors and a scorecard
Build a structured interview kit: pick the competencies the role needs, ask everyone the same questions, define rating anchors and use one scorecard.
Free app. Runs on your Mac with the Claude or Codex plan you already have.
What a structured interview kit is
A structured interview kit is the material that makes every interview for a role the same: the competencies the role needs, the questions each candidate is asked in the same order, a description of weak to strong answers, and an interview scorecard each interviewer fills in. Done well, candidates are compared on evidence about the job. Done badly, each interviewer asks whatever comes to mind and the decision goes to whoever argues best in the debrief.
The method below is how an experienced recruiter or hiring manager builds a kit. Each step says what to do and why, then how 10folds does it. Points about employment law here are general; check the rules in your country. Structured interviews take more preparation than informal ones, and the kit is that preparation, done once per role.
What it does for the business
- Better hiring decisionsWhen each candidate answers the same job-related questions, differences in scores reflect differences in candidates. Decisions rest on evidence instead of impressions. It also makes a hiring decision easier to explain later.
- Fairer to candidatesThe same questions, anchors and rules for everyone leave less room for bias and keep protected topics out of the room.
- Shorter, calmer debriefsIndependent ratings with written evidence give the debrief a starting point, and the conversation goes straight to where the ratings differ. Debriefs end with a decision tied to evidence.
- Interviewers who are readyA one-page brief tells each interviewer which competencies they own and what to ask, so occasional interviewers do it well too. New interviewers can start with confidence after reading one page.
Structured interview kit, step by step
Decide what the role needs
If you cannot say why the job needs it, do not assess it.
What to do
- From the job description, choose four to six competencies: the skills, knowledge and behaviors the person must show in the first year.
- Define each one in a single line, in the role's own terms.
- Mark each as must-have or nice-to-have.
- Leave out proxies such as years of experience, degrees the work does not need, and culture fit meaning similarity to the team.
Why
Every later question and anchor depends on this list. Competencies tied to real work predict performance and are easier to defend, while proxies screen out good candidates. Recording the sentence of the job description each competency comes from makes the link visible to anyone who checks. Must-have and nice-to-have marks tell interviewers where a gap should end a process and where it should only lower a rating.
Plan the interview stages
Each stage should check something the others cannot.
What to do
- Assign each competency to the stage that can best observe it: a screening call for basics and motivation, a structured interview for past behavior, a work sample for the actual skill.
- Check every must-have at least once and no competency more than twice.
- Name the interviewer role for each stage, such as hiring manager or peer.
- Budget about ten minutes per competency and five at the end for the candidate's questions.
- Check that the total time per stage fits the slot you have.
Why
Spreading competencies across stages avoids asking the same thing three times while missing something else. The time budget keeps interviews from running out before the last question. Naming roles instead of people means the plan survives when interviewers change.
Write the questions
What someone did last year tells you more than what they say they would do.
What to do
- Write two behavioral interview questions per competency (tell me about a time you...) and one of the situational questions (what would you do if...).
- Set each question in the role's real work and add two or three follow-up probes: what did you do, why, and what happened.
- For a work sample, set the task, the material, the time allowed and what a complete answer contains, and keep it under an hour.
- Remove trick questions, brain-teasers and anything about personal life.
Why
Behavioral questions ask for evidence, and probes stop a rehearsed answer from passing for evidence. A short work sample shows the actual skill and respects the candidate's time. Asking the same questions in the same order is what makes answers comparable. Leave free conversation for the end.
Write rating anchors and the scorecard
Decide what a strong answer sounds like before you hear one.
What to do
- For each competency, describe in observable terms what a 1, 2, 3 and 4 answer sounds like.
- Build the interview scorecard: per competency, the rating and the evidence heard, in the candidate's words or actions.
- Keep the overall recommendation separate from the ratings.
- Tell interviewers to rate right after the interview, alone, before any discussion.
- Add a short note on what to do when evidence for a competency is missing.
Why
A rating scale without anchors means different things to different people. Anchors written in advance stop the bar from moving toward the candidate an interviewer liked, and rating alone stops the first opinion in the debrief from setting everyone else's. Evidence fields matter as much as numbers, because a rating with no recorded evidence cannot be defended or discussed.
Brief the interviewers and check the kit
A good kit used badly is still a bad interview.
What to do
- Write one page for interviewers: the purpose of their stage, the competencies they own, how to open and close, how to take notes, and adjustments a candidate may ask for.
- List the topics never raised: age, family plans or children, marital status, pregnancy, religion, ethnicity or national origin, health or disability, sexual orientation, union membership, and salary history where the law bans asking.
- Have someone else check that every question traces to the role and is open and job-related.
- Plan the debrief: read the ratings first, then discuss the differences from the evidence.
Why
Interviewers who know the rules stay consistent and avoid questions that are unfair and often unlawful. An independent check catches a leading question or an anchor that describes a feeling instead of a behavior. Offering adjustments, such as extra time or a different format, is fair, and in many countries a legal duty.
Common mistakes
- Different questions for each candidateAnswers to different questions cannot be compared fairly.
- Hypothetical questions onlyAnyone can describe what they would do. Ask what they did.
- Anchors written after the interviewsThe bar drifts toward the candidate the interviewer preferred.
- Debriefing before ratingThe first strong opinion sets everyone else's score.
- Assessing culture fit as likenessIt rewards similarity to the team, which the job does not require.
What a good result looks like
- Four to six competencies, each traced to the role description.
- The same questions and probes for every candidate, timed per stage.
- Observable anchors from 1 to 4 for each competency.
- A scorecard with evidence fields and a separate recommendation.
- Interviewer instructions that list the topics never raised.
And then what? Using the result
- Confirm the assumptions in the kit with the hiring manager.
- Brief every interviewer on their stage before the first interview.
- Use the same scorecard for every candidate, without changes partway through.
- Run each debrief from the ratings and the evidence.
- Adjust the kit after the hire, based on what the ratings missed.
When to run it
- When opening a new roleBuilding the kit alongside the job ad makes the competencies explicit from the start. The same competencies can guide the job ad and the onboarding plan later.
- When several people interviewShared questions and anchors keep their ratings comparable. It also makes it easier to add an interviewer late in the process.
- After a hire that did not work outReviewing the kit shows which competency was never really tested.
- When a hiring manager is new to interviewingThe kit and the instructions give them a structure to follow.
Questions people ask
What is a structured interview?
It is an interview in which every candidate gets the same job-related questions in the same order and is rated on a predefined scale. It is fairer and more consistent than a free conversation. Each answer is scored against written anchors.
What should a structured interview kit include?
A structured interview kit includes the competencies the role needs, the questions and probes for each stage, rating anchors, a scorecard and short instructions for interviewers. A work sample is often part of it.
How do you create an interview scorecard?
List the competencies, give each a rating scale with observable anchors, add a field for the evidence heard, and keep the overall recommendation separate. Write the anchors before the first interview.
What questions should you not ask in an interview?
Questions about age, family plans, marital status, pregnancy, religion, ethnicity or national origin, health or disability, sexual orientation or union membership, and salary history where the law bans it. Local law decides, so check yours.
Does the job score candidates?
No. It prepares the material. It never reads candidate files, never scores, ranks or rejects a candidate, and sends nothing to interviewers or candidates. The kit is material for people, who make every hiring decision.
Can it reuse my existing questions?
Yes. It keeps what is job-related from an existing question bank or scorecard, keeps your rating scale if interviews already use it, and says what changed.
More jobs in Hiring
Build a structured interview kit, on your own Mac.Free app. Runs on your Mac with the Claude or Codex plan you already have. Your files stay on your computer.
Download for Mac