Stubborn Reliance on Intuition and Subjectivity in Employee Selection

Paper · 2008

Highhouse's focal article on why practitioners persist in preferring intuitive, unstructured judgment in employee selection despite decades of evidence favoring structured methods, including the null benefit of interviewing experience for gut judgment.

Author
Scott Highhouse
Published
2008

The question

Why do employers keep using unstructured interviews and gut judgment to hire, when decades of evidence say structured tests and mechanical scoring predict job performance better?

The method

A focal review article synthesizing I-O psychology’s selection literature, plus a survey of HR professionals run by one of Highhouse’s students [1] and Highhouse’s own policy-capturing study of retail managers’ hiring decisions [2].

The findings

HR professionals, asked directly, agreed by more than 3 to 1 that tests are an effective way to evaluate candidates [2] — and, in the same survey, agreed by more than 3 to 1 that an informal conversation lets them “read between the lines” [2]. Two implicit beliefs drive the gap. First, that near-perfect prediction of job success is achievable at all, when a large share of the variance in who succeeds is simply not knowable at the time of hire — “irreducible unpredictability” [3]. Second, a “myth of expertise” — that experience makes someone a better intuitive judge of candidates. On that second point the paper cites the finding that interviewing experience does not improve accuracy: differences between interviewers’ validity are attributable to sampling error, not skill [3] (citing Pulakos, Schmitt, Whitney, & Smith, 1996), and even a well-run unstructured interview explains no more than about 10% of the variance in job performance [3] (citing Conway, Jako, & Goodman, 1995).

The limits

This is a review aggregating other researchers’ meta-analyses rather than new data of its own; the strongest original contributions are Highhouse’s retail-manager policy-capturing study [2] and his student’s unpublished HR survey [1] — both single-sample and not independently peer-reviewed as reported here.

  • When a hiring manager insists their gut read from the interview outweighs a candidate’s test or work-sample score (see Knowing what great looks like): the paper’s evidence is that interviewing experience doesn’t improve accuracy [3] — years of interviewing doesn’t make someone better at predicting who’ll succeed, it just makes them more confident.
  • When you’re proposing a structured test or work sample and expect it to feel impersonal or bureaucratic to the team: the resistance you’re anticipating is the exact pattern Highhouse documents — people rate tests as effective in the abstract and still reach for the informal conversation instead [2].
  • When a hire fails and everyone, including you, wants to find the process mistake: some of that miss may be the “irreducible unpredictability” the paper describes [3] — a share of any hire’s outcome genuinely isn’t knowable in advance, and treating every miss as a fixable process error sends you chasing a precision that doesn’t exist.

1
Scott Highhouse, "Stubborn Reliance on Intuition and Subjectivity in Employee Selection," Industrial and Organizational Psychology 1, no. 3 (2008), § "FOCAL ARTICLE SCOTT HIGHHOUSE."
https://doi.org/10.1111/j.1754-9434.2008.00058.x
2
Highhouse, "Stubborn Reliance on Intuition and Subjectivity," § "FOCAL ARTICLE SCOTT HIGHHOUSE."
3
Highhouse, "Stubborn Reliance on Intuition and Subjectivity."