Almost every hiring team says they run structured interviews with scorecards. Almost none of them do, in practice. Here's why - and the specific changes that fix it.
Ask any recruiting team whether they use structured interviews and they will say yes. Show them their ATS data and they will go quiet.
Structured interviews require scorecards. Scorecards require submission. In most teams, fewer than half of all interviews have a scorecard submitted within 48 hours. A significant portion have no scorecard at all. The structured process exists in policy. The unstructured process is what actually happens.
This is not a motivation problem. It is a cost problem.
Writing a thoughtful scorecard after a 60-minute interview takes 30-45 minutes. It requires recall of specific evidence. It competes with everything else in a busy calendar. At 5pm on a Friday, after a full day of back-to-back meetings, writing a structured evaluation for an interview that happened Tuesday is the task that does not get done.
The solution that most teams try: reminders. Automated emails. Slack messages from the recruiter. Policy reminders in team meetings. These work for the most conscientious interviewers and have zero effect on everyone else.
The solution that actually works: reduce the task to something that takes 8 minutes instead of 45.
When Pickr transcribes an interview and drafts the scorecard — each criterion pre-filled with a suggested score and the specific evidence from the transcript that supports it — the interviewer is reviewing a draft rather than writing from memory. The task goes from 45 minutes of recall and composition to 8 minutes of review and adjustment. Submission rates go from under 50% to over 85%. Not through discipline. Through effort reduction.
Most scorecard entries fall into one of two patterns, both useless:
Numbers without reasoning: "Leadership: 4/5"
Vague prose: "Strong leader, good presence"
Neither is defensible if the hiring decision is challenged. Neither is useful for the next interviewer who will see this candidate. Neither contributes to the calibration data that could improve future hiring.
A useful entry: "Leadership: 4/5. When asked about managing through a team conflict, described a specific situation where two direct reports had a breakdown in working relationship. Took a structured approach: individual conversations first, joint session second, outcome documented and followed up. Did not resolve the underlying technical disagreement but preserved the working relationship and team output. Did not escalate — handled at their level."
That entry is legally defensible. It is useful for the hiring manager in the debrief. It is the kind of data that, accumulated across 50 hires, can actually tell you which evaluation criteria predict success in the role.
The other structural failure in most scorecard processes: interviewers submit after discussing the candidate with each other.
Group debrief before independent submission produces anchoring bias. The first person to speak — usually the most senior person in the room — sets the evaluation frame. Everyone else adjusts toward that frame rather than contributing an independent view. The "consensus" is actually a cascade from one opinion.
Fix: scorecards submitted independently before any group discussion. The debrief then examines divergence — why did the technical interviewer give a 3 while the culture interviewer gave a 5? — rather than discovering opinions for the first time.
In Pickr, interviewers cannot see each other's scorecards until they have submitted their own.
Role-specific behavioral criteria (4-6 maximum), behavioral anchors for each rating level, an evidence field requiring specific examples from the interview, a clear hire/no-hire recommendation, and a concerns section for reservations even when recommending hire.
Within 24 hours of the interview, before seeing any other interviewer's evaluation. Independent submission before group discussion is critical for preventing anchoring bias.
Reduce the effort first. AI pre-fill from interview transcripts reduces submission time from 45 minutes to 8 minutes. Compliance follows effort reduction. For remaining resistance, systemic enforcement (scorecards required before stage advancement) is more effective than individual persuasion.
Run your free hiring process audit
Connect your ATS in 3 minutes. Get a full breakdown of where your process loses time and candidates — with three prioritised fixes.
Start free audit →Andreas Gruber
Founder of Pickr and ScalingPPL. Former recruiter who placed engineers and operators into European startups and scale-ups for four years before building the tool he wished had existed.