Overview
Experiments are clear and reproducible on two public summarization datasets and multiple models; results are robust across in-/out-of-domain checks but limited to summarization and a small model set.
Citations12
Evidence Strength0.80
Confidence0.80
Risk Signals8
Trust Signals
Findings with numeric evidence: 4/4
Findings with evidence refs: 4/4
Results with explicit delta: 3/4
Reproducibility
Status: Code + data available
Open source: Partial
At A Glance
Cost impact: 45%
Production readiness: 60%
Novelty: 50%
Why It Matters For Business
If you use an LLM to grade or select outputs, it may inflate scores for outputs similar to itself, hurting fairness and enabling feedback loops where models learn from biased judgments.
Who Should Care
Summary TLDR
LLM evaluators (GPT-4, GPT-3.5, Llama 2) both identify text they wrote and score it higher. Out of the box, GPT-4 distinguishes its summaries ~73% correctly and shows self-preference; fine-tuning on a few hundred examples raises self-recognition near 90% and increases self-preference. The two properties correlate linearly, suggesting that recognition of an output is a practical driver of biased self-evaluation. This matters for model-based benchmarks, reward models, and any system that uses an LLM to judge LLM outputs.
Problem Statement
When the same LLM is used to generate outputs and to judge them, it can favor its own outputs even when humans rate them the same. The paper asks whether that self-preference comes from the model actually recognizing its own text, and whether changing recognition changes preference.
Main Contribution
Show out-of-the-box LLMs can often identify their own summaries and tend to prefer them when evaluating quality.
Demonstrate fine-tuning boosts self-recognition (to ~90%) and that stronger recognition correlates with stronger self-preference.
Key Findings
Frontier LLMs show measurable self-recognition and self-preference without fine-tuning.
Fine-tuning on a small set of examples sharply increases self-recognition.
Results
| Metric | Value | Baseline | Delta | Split / Dataset | Evidence | Evidence Ref |
|---|---|---|---|---|---|---|
| Out-of-the-box self-recognition (pairwise) | GPT-4: 0.672 (XSUM), 0.747 (CNN); GPT-3.5: 0.535, 0.481; Llama-2: 0.514, 0.505 | — | — | XSUM / CNN/DailyMail | Pairwise self-recognition scores reported in Table 7 | Table 7 |
| Fine-tuned self-recognition (pairwise after 500 examples) | GPT-3.5 and Llama-2 often >0.89 on in-domain settings | no fine-tuning ~0.53–0.67 | +~0.3–0.4 absolute | in-domain (XSUM/CNN) | Pairwise scores after 500 examples (Table 7) and narrative in Section 3.2 | Table 7; Section 3.2 |
What To Try In 7 Days
Run a quick check: prompt your evaluator to identify whether it wrote sample outputs and record recognition and preference rates.
Avoid using the same model as both generator and judge; swap in a different evaluator or mix multiple evaluators.
Mask or remove authorship signals (labels/metadata) in evaluation prompts to reduce label-driven bias and re-run key evaluations.
Reproducibility
Code URLs
Data URLs
Risks & Boundaries
Limitations
Experiments limited to summarization; unknown generality to other tasks.
Results provide evidence toward causality but do not prove mechanistic cause.
When Not To Use
As the sole judge for high-stakes assessments where neutral, human-calibrated scoring is required.
When you cannot or do not want to remove authorship labels or control for evaluator-generator similarity.
Failure Modes
Ordering bias: evaluator flips preference when option order is swapped.
Ambiguous responses: many pairwise cases are unstable without confidence adjustment.