Pablo Haya Coll
Researcher at the Computer Linguistics Laboratory of the Autonomous University of Madrid (UAM) and director of Business & Language Analytics (BLA) of the Institute of Knowledge Engineering (IIC)
The article contributes through a series of experiments that identify gender biases both in the generation of CVs (generation biases) and in the assessment of candidates and salary recommendations (assessment bias) carried out by language models (LLMs). The results show that the LLMs evaluated reproduce existing gender stereotypes in the labour market.
These findings are relevant for candidates using AI, who need to refine their prompts so that LLMs do not reproduce gender-influenced labour market stereotypes. Companies must bear in mind that AI systems designed to assess candidates in recruitment processes are generally classified as high-risk systems under the RIA, which means they must be particularly careful when assessing biases in their candidate evaluation systems.
Finally, in my view, these audit studies should be implemented as evaluation testing platforms that enable the regular monitoring of AI systems. One-off assessments are insufficient given the constant changes in technology. The adoption of reproducible and comparable benchmarks would help to improve transparency, detect potential discriminatory effects and facilitate compliance with regulatory obligations.