After greater than a yr of the Covid-19 pandemic, hundreds of thousands of individuals in the USA are on the lookout for work. AI-powered software software program is designed to assist employers display screen purposes to search out the very best folks for the job. Firms specializing on this know-how reported a rise in enterprise through the pandemic.
However because the demand for these applied sciences will increase, so do the questions on their accuracy and reliability. Within the newest episode of MIT Know-how Overview’s In Machines We Belief podcast, we examined software program from two firms focusing on AI interviews, MyInterview and Curious Factor. And we discovered variations within the predictions and job matching scores that increase considerations about what precisely these algorithms rating.
Get to know you
MyInterview measures traits which might be thought of within the Massive 5 character check, a psychometric evaluation typically used within the hiring course of. These traits embody openness, conscientiousness, extroversion, compatibility and emotional stability. Curious Factor additionally measures character traits, however as a substitute of the Massive 5, candidates are rated on different metrics equivalent to humility and resilience.
The algorithms analyze the candidates’ solutions to find out character traits. MyInterview additionally creates scores that point out how properly a candidate meets the traits recognized by hiring managers as supreme for the place.
To finish our exams, let’s first arrange the software program. We uploaded a pretend job posting for an workplace administrator / researcher on each MyInterview and Curious Factor. Then we constructed our supreme candidate by choosing character traits when prompted by the system.
On MyInterview, we now have chosen options equivalent to consideration to element and ranked them in line with significance. We additionally chosen interview questions that shall be displayed on the display screen whereas the candidate is recording video responses. At Curious Factor we now have chosen traits equivalent to humility, adaptability and resilience.
One in every of us, Hilke, then utilized for the place and performed interviews for the function on each MyInterview and Curious Factor.
Our candidate accomplished a telephone interview with Curious Factor. She initially performed a daily job interview and obtained 8.5 out of 9 for English proficiency. In a second try, the automated interviewer requested the identical questions, and he or she answered every by studying the Wikipedia entry for psychometrics in German.
However Curious Factor gave 6 out of 9 factors for his or her English abilities. She completed the interview once more and bought the identical rating.
Our candidate turned to MyInterview and repeated the experiment. She learn the identical Wikipedia entry aloud in German. Not solely did the algorithm present a character rating, nevertheless it additionally predicted that our candidate can be 73% in settlement with the pretend job, which positioned her within the prime half of all candidates we requested.