A low-cost, practical method that finds whether LLMs memorized evaluation datasets

Overview

Why It Matters For Business

If an LLM already saw your test data, reported performance is not a real measure of capability; this cheap detection method helps teams vet benchmarks and avoid overclaiming model quality.

Summary TLDR

The paper introduces a simple, low-cost procedure to detect whether a large language model (LLM) has ingested a given dataset split. It prompts the model with a short initial fragment plus the dataset and split name ('guided instruction') and checks if the model completes the fragment exactly or nearly so. Two partition-level rules are proposed: (1) guided completions have significantly higher BLEURT/ROUGE-L overlap than unguided completions, or (2) a GPT-4 few-shot classifier flags at least one exact or two near-exact matches in a 10-instance sample. Tested on GPT-4 and GPT-3.5 across seven datasets, the best method (guided instruction + GPT-4 few-shot classifier) matched human labels in 14

Problem Statement

Benchmark scores for LLMs can be artificially high if test data or dataset instances leaked into model pretraining. Most prior leakage checks need access to pretraining data or heavy compute. The paper asks: can we detect dataset contamination automatically, cheaply, and without access to the model's pretraining corpus?

Main Contribution

Key Findings

Results

Who Should Care

What To Try In 7 Days

Reproducibility

Risks & Boundaries

Core Entities

Related Papers

• A weekly-updated, contamination-free medical benchmark plus automated rubrics that align better with physicians than LLM-as-a-judge
• When synthetic training data and LLM evaluators are related, evaluators unfairly favor the student models
• Auto-update benchmarks with two LLM-driven strategies to reduce leakage and tune difficulty
• Ko-H5 and an open Korean LLM leaderboard: private tests, new Korean tasks, and when benchmarks stop helping
• TreeEval: benchmark-free LLM evaluation via LLM examiner and tree planning