Shortlisting Candidates: Meaning, Process, and a Scorecard

Shortlisting candidates means narrowing a pool of applicants to the small group you will interview, by checking each one against the same job-related criteria. Done well, it takes a few hours instead of days: you set must-have and nice-to-have criteria before reading any resume, score every applicant on a simple weighted scorecard, and invite the top scorers to interview.

What does shortlisted mean?

If you are a job seeker and an employer or recruiter says you have been shortlisted, it means your application made it through the first screening round. You are now in a small group, often three to eight people, that the employer wants to interview, test or speak with further. It is a strong signal, but it is not an offer.

What usually happens next: a phone screen or first interview invitation, sometimes a skills test, and a request for your availability. Reply quickly, re-read the job posting and prepare examples that match its requirements. If you are still searching, browse current openings on our job board.

For employers, the shortlist is the bridge between resume screening and interviews. The rest of this guide shows how to build one that is fast, fair and defensible.

How to shortlist applicants: start with preparation

Most shortlisting problems start before anyone reads a resume. If reviewers open the applicant pool without written criteria, each person applies a different mental checklist, and the shortlist ends up reflecting who reviewed the files rather than what the job needs.

Spend 30 minutes with the hiring manager before the posting closes and agree on four things:

1. The outcomes of the role. What must this person deliver in the first 6 to 12 months? Criteria should come from that, not from the last person who held the job.
2. Must-haves. Requirements a person cannot do the job without: a required license, a minimum level of a specific skill, the ability to work the posted schedule. Keep this list short, usually two to four items.
3. Weighted nice-to-haves. Skills and experience that make someone stronger but that a capable person could learn. These become your scorecard rows.
4. Your target shortlist size and timeline. For example, “five candidates to first interview by Friday.”

Setting shortlisting criteria: essential vs. desirable

Good shortlisting criteria are job-related, observable in an application, and phrased the same way for every applicant. Here is an example for an accounts payable specialist role.

Avoid criteria that act as proxies for age, race, sex or other protected traits, such as graduation years, “digital native” or “recent graduate.” Degree requirements deserve a second look too: if the job can be done well without one, say so. Our guide to skills-based hiring shows how to rewrite requirements around what people can do.

Building and applying a candidate scorecard

A shortlisting scorecard turns your desirable criteria into numbers. Give each criterion a weight that adds up to 100, define what a 1, 3 and 5 look like, and score every applicant who passed the must-haves.

Scorecard template

Copy this structure into a spreadsheet or your applicant tracking system.

Weighted score = (weight × score) for each row, added up, then divided by 100. The result is a score out of 5.

Worked example: comparing four applicants

Applicant B’s math: (30 × 5) + (25 × 4) + (20 × 3) + (15 × 3) + (10 × 4) = 395, and 395 ÷ 100 = 3.95. With a cut line of 3.5, A, B and C go to interview and D does not.

Three rules keep the scorecard honest:

• Score each applicant before you discuss them, so the first opinion in the room doesn’t set everyone else’s.
• Write one line of evidence next to any 1 or 5 (“led AP for 3 entities, no audit findings in 2 years”).
• If two reviewers differ by 2 points or more on a row, talk it through against the anchors and re-score.

The same criteria should carry into your interview scorecards, so the interview tests what the shortlist assumed.

How many candidates to shortlist for interview

There is no legal or standard number. Work backward from the result you need. If your first interviews typically lead to one strong finalist out of every three or four people, a shortlist of five or six for one opening is about right. For hard-to-fill roles you might interview everyone above the cut line; for high-volume roles you might set a higher cut line.

Whatever number you choose, set the cut line on the score, not on a headcount you hit by lowering the bar. If too few applicants pass, the problem is usually the posting or the sourcing, not the scorecard.

Using technology responsibly in screening

Applicant tracking systems, knockout questions and AI ranking tools can cut screening time sharply. They also make mistakes at scale, and the employer remains responsible for the outcome. As of October 2026, keep these points in mind:

• Federal anti-discrimination law still applies. On January 27, 2025, the EEOC removed its 2023 technical assistance on AI in employment selection from its website, following a January 2025 executive order on AI (K&L Gates summary). Removing guidance did not change Title VII itself, and the Uniform Guidelines on Employee Selection Procedures still apply to any selection procedure, automated or not.
• Test for adverse impact with the four-fifths rule. Under 29 CFR 1607.4(D), a selection rate for any race, sex or ethnic group that is less than four-fifths (80%) of the rate for the group with the highest rate is generally regarded as evidence of adverse impact.
• Check local AI hiring laws. New York City’s Local Law 144 bars employers from using an automated employment decision tool unless it had a bias audit within the past year, a summary of results is public, and candidates get notice; enforcement began July 5, 2023 (NYC DCWP). In Illinois, an amendment to the Human Rights Act that took effect January 1, 2026 bars employers from using AI that has the effect of discriminating based on protected classes (Illinois State Bar Association). California’s FEHA automated-decision regulations took effect October 1, 2025, and Colorado’s SB 26-189 takes effect January 1, 2027.

Here is the four-fifths test with real numbers. If 50 of 100 applicants from one group pass your screen (50%) and 15 of 50 from another group pass (30%), the ratio is 30 ÷ 50 = 0.60. That is below 0.80, so look closely at which criterion or tool is screening people out and whether it is truly job-related. Small applicant pools can swing these ratios, so treat the result as a prompt to investigate, not a verdict.

For a fuller look at what AI does well in hiring and where it fails, see our guide to AI in recruitment.

Common pitfalls in the shortlisting process

Our playbook on reducing hiring bias covers structured review in more depth.

Finalizing the shortlist and preparing for interviews

Hold a short calibration meeting, 20 to 30 minutes, with everyone who scored. Review the ranked list, discuss only the people near the cut line, and confirm the final shortlist. Then move quickly:

1. Record the decision. Save each scorecard, the cut line and a one-line reason for anyone moved above or below it. Under 29 CFR 1602.14, employers covered by Title VII and the ADA must keep application forms and other hiring records for one year from the date the record was made or the personnel action taken, whichever is later. Keep them longer if a charge is filed, and check state rules.
2. Invite shortlisted candidates within a day or two. Give the format, length, interviewers’ names and two or three time options.
3. Brief interviewers. Share the scorecard and the open questions for each candidate (for example, “confirm depth of ERP experience”).
4. Tell everyone else. A short, respectful note protects your reputation with people who may fit a future role. Our candidate rejection email templates include one for this stage.

Shortlist invitation script

“Hi [Name], thank you for applying for the Accounts Payable Specialist role. We’d like to invite you to a 30-minute video interview with [Manager], our AP lead. Are any of these times good for you: [option 1], [option 2], [option 3]? We’ll talk about your AP experience and the systems you use. Reply to this email or call me at [number] with any questions.”

How Careerscape can help

Careerscape is a U.S. staffing and recruiting firm. If your team doesn’t have the time to screen a large applicant pool, we can source, screen and deliver a shortlist for you through our hiring services, or run your full hiring process through recruitment process outsourcing.

Frequently asked questions