FaiRLLM: a benchmark showing ChatGPT gives uneven recommendations across user attributes

Overview

Why It Matters For Business

If you use LLMs to generate recommendations, they can favor or disfavor user groups; auditing with a generative-aware fairness test prevents reputational and regulatory risk.

Summary TLDR

The paper builds FaiRLLM, a benchmark and dataset to test user-side fairness of LLM-based recommendation (RecLLM). It defines fairness as whether recommendations without sensitive info match those when specific sensitive attributes are specified. The authors propose three list-similarity scores (Jaccard, SERP*, PRAG*), two fairness metrics (SNSR range, SNSV variance), and datasets for music and movies covering eight sensitive attributes. They run ChatGPT (greedy decoding) and find measurable unfairness that persists across list lengths, typos, and Chinese/English prompts. Code and data are released.

Problem Statement

Large language models can be used to generate recommendations, but existing fairness benchmarks assume fixed candidate sets or numeric scores. Those assumptions break for generative RecLLM. We need a new, practical way to measure whether an LLM favors or disfavors user groups when sensitive attributes are hidden.

Main Contribution

Key Findings

Results

Who Should Care

What To Try In 7 Days

Reproducibility

Risks & Boundaries

Core Entities

Related Papers

• Large Llama models beat smaller ones on iCliniq medical QA; LLM judges help measure clinical quality
• PanCanBench: 282 real patient questions + 3,130 expert rubrics to test LLM clinical completeness and factuality
• A judge-free, n-gram benchmark that approximates GPT-4 judging for Japanese Q&A
• Professional multilingual TruthfulQA shows truth gaps across languages but smaller than expected
• MEMERAG: a native multilingual benchmark to evaluate RAG outputs and LLM-based evaluators