0
0
Psychometric assessments have become a familiar part of the employee lifecycle. Employers use them to help select candidates, identify leadership potential, support development, inform internal mobility and, increasingly, assess skills.
But familiarity shouldn’t automatically equal trust.
As HR teams gain access to an ever-growing number of assessment platforms, and as artificial intelligence makes it easier to create, administer and interpret assessments, there’s an important question for employers to consider: how much do we really know about the tools we’re using to make decisions about people?
It’s a question I explored with Paula Baetu, Psychometric Specialist, Business Psychologist and Executive Coach at Awemetrics / Pawsometrics, in episode 904 of the HRchat Podcast.
Psychometrics Are About More Than Personality
Mention psychometric testing and many people immediately think of personality assessments. In reality, the field is considerably broader.
Assessments can be designed to measure cognitive abilities, behavioural tendencies, skills, motivations, preferences and other characteristics relevant to performance and development. Used appropriately, they can add useful evidence to decisions that might otherwise depend heavily on CVs, interviews and the instincts of individual hiring managers.
That’s particularly important when organizations are trying to make recruitment more consistent and objective.
The danger comes when an assessment acquires an authority it hasn’t necessarily earned.
A polished interface, sophisticated-looking report or familiar brand name doesn’t automatically mean an assessment is scientifically robust, appropriate for a particular population or capable of predicting the outcome an employer cares about.
HR professionals therefore need to understand not only what a tool claims to measure but the evidence behind those claims.
Ask for the Technical Manual
One of the most practical recommendations from my conversation with Paula was also one of the simplest: ask your assessment provider for its technical manual.
For HR and Talent teams purchasing assessment technology, this should be a standard part of due diligence.
The documentation should help buyers understand how an assessment was developed, how its reliability and validity have been established, which populations it has been tested against and the norm groups being used to interpret results.
That last point is particularly important.
Workforces and candidate populations change. An assessment benchmarked against a population many years ago, or against a group substantially different from the people taking it today, may not provide the insight an employer assumes it does.
Independent validation and transparency should therefore matter when selecting a provider. HR leaders shouldn’t be afraid to challenge vendors on the evidence supporting their products.
If a tool is influencing who gets hired, promoted or identified as a future leader, “we’ve always used it” isn’t a particularly convincing reason to keep using it.
Assessments Should Inform Decisions, Not Make Them
Perhaps one of the biggest mistakes employers can make is treating a psychometric score as a decision rather than a piece of information.
Hiring someone because they achieved a particular score, or rejecting someone because they fell below a predetermined number, can create a false sense of scientific certainty.
Human beings and workplaces are more complicated than that.
Assessment results can be valuable when combined with interviews, experience, skills evidence, work samples, references and other relevant information. Their role should generally be to improve the quality of the evidence available to decision-makers rather than replace human judgement altogether.
This distinction becomes particularly important when assessments are used beyond recruitment.
The consequences of labelling someone as having, or lacking, “leadership potential”, for example, can follow an employee through an organization. Employers should be confident that the tools informing those conclusions are appropriate for the purpose and that managers understand their limitations.
Skills-Based Hiring Changes the Conversation
The continued shift towards skills-based hiring also raises interesting questions for the assessment industry.
More employers are questioning whether degrees, previous job titles and years of experience are the best indicators of whether someone can succeed in a role. If organizations genuinely move towards assessing what candidates can do, assessments could become an increasingly important part of recruitment.
That creates an opportunity, but it also raises the stakes.
A skills assessment needs to measure something meaningfully connected to the work. Employers need to consider whether the test reflects the abilities required on the job, whether candidates have a fair opportunity to demonstrate those abilities and whether the results actually predict relevant outcomes.
The goal shouldn’t be to add another test to the recruitment funnel. It should be to collect better evidence.
Then There’s AI
Artificial intelligence adds another layer of complexity.
Candidates now have access to generative AI tools capable of helping them answer questions, prepare for assessments and, depending on how a test is designed and administered, potentially complete parts of the process itself.
Employers are responding in different ways, including redesigning assessments, changing how and when they’re administered and placing greater emphasis on tasks where candidates need to demonstrate their reasoning or abilities in a more controlled environment.
At the same time, AI is increasingly appearing on the other side of the equation, helping organizations create assessments, analyse responses and generate recommendations about candidates.
That shouldn’t remove the need for validation. If anything, it makes scrutiny more important.
An AI-generated assessment still needs to demonstrate that it measures what it claims to measure. An algorithmic recommendation still needs to be understood in the context of fairness, validity and the consequences of getting the decision wrong.
AI can change how assessments are produced and delivered. It doesn’t remove the need for good assessment science.
HR Needs to Be a More Demanding Buyer
My biggest takeaway from the conversation with Paula is that HR professionals don’t necessarily need to become psychometricians, but they do need to become informed consumers.
Ask vendors for evidence. Ask about validation. Ask which norm groups are being used. Ask whether the tool has been independently evaluated. Ask whether an assessment designed for one purpose is genuinely suitable for another.
And perhaps most importantly, ask what role the result will actually play in the decision.
Psychometric assessments can provide valuable information and potentially improve the consistency and quality of talent decisions. But they’re tools, not oracles.
As AI, skills-based hiring and assessment technology continue to develop, the organizations that benefit most won’t necessarily be those using the most assessments. They’ll be the ones asking the best questions about the assessments they choose to trust.
Related Content
