Argmin AIArgmin AI
About usOptimize your agent
RLHFBasic RAGPrompt OptimizationAgentic RAGQuantizationSafety BenchmarksLLM-as-a-JudgeChain-of-ThoughtMulti-Agent SystemsFunction CallingEfficient InferenceHallucination Detection

KnowEdit benchmark and EasyEdit toolkit: a unified study and comparison of methods to change facts inside LLMs

LLM EvaluationBenchmark ConstructionFinetuningBenchmark
January 2, 20249 min

Overview

Decision SnapshotNeeds Validation

The paper combines a comprehensive literature survey, a new benchmark, and a consistent large-scale comparison; results are strong for single edits but show limited portability and robustness, so apply with validation.

Citations20

Evidence Strength0.80

Confidence0.88

Risk Signals11

Trust Signals

Findings with numeric evidence: 5/5

Findings with evidence refs: 5/5

Results with explicit delta: 0/5

Reproducibility

Status: Code + data available

Open source: Yes

At A Glance

Cost impact: 60%

Production readiness: 50%

Novelty: 70%

Authors

Ningyu Zhang, Yunzhi Yao, Bozhong Tian, Peng Wang, Shumin Deng, Mengru Wang, Zekun Xi, Shengyu Mao, Jintian Zhang, Yuansheng Ni, Siyuan Cheng, Ziwen Xu, Xin Xu, Jia-Chen Gu, Yong Jiang, Pengjun Xie, Fei Huang, Lei Liang, Zhiqiang Zhang, Xiaowei Zhu, Jun Zhou, Huajun Chen

Links

Abstract / PDF / Code / Data

Why It Matters For Business

Knowledge editing can cheaply update specific facts or behaviors in an LLM without full retraining, saving compute and time; but edits can fail to generalize and may break unrelated behavior, so careful validation is required.

Who Should Care

CTOProduct ManagerML EngineerData Scientist

Summary TLDR

This paper surveys methods to update facts inside large language models, proposes a three-phase taxonomy (resort to external knowledge, merge into model, edit intrinsic parameters), and releases a new benchmark (KnowEdit) plus an EasyEdit toolkit. The authors run a large empirical comparison on Llama2-7b-chat across retrieval-based, parameter-efficient, and locate-and-edit methods. Results show many methods can force a target answer (high edit success) but struggle with portability (making edits usable in reasoning) and with large-scale or erasure edits. They also analyze where edits change weights and show location methods find entity-related areas but not full facts.

Problem Statement

Updating or removing specific facts in a trained LLM should be fast, local, and low-cost. Full retraining is expensive and brittle. Existing editing methods vary a lot in how reliably they change a fact, how much they break unrelated knowledge, and how well edits generalize to related queries. This paper benchmarks and analyzes these trade-offs.

Main Contribution

A simple three-phase taxonomy for knowledge editing: recognition (external memory), association (merge representations), mastery (edit weights).

KnowEdit: a multi-task benchmark (WikiData recent, ZsRE, WikiBio, WikiData counterfact, ConvSent, Sanitation) and evaluation protocol for insertion, modification, and erasure.

Key Findings

Several editing methods can reach near-perfect edit success on fact-insertion and fact-modification datasets.

NumbersWikiData recent edit success: AdaLoRA=100, FT-M=100 (Table 4)

Practical UseIf your goal is to make a model output a new target answer for specific prompts, AdaLoRA or targeted fine-tuning (FT-M) can do this reliably on the evaluated fact datasets; still check portability and downstream use.

Evidence RefTable 4

Portability (ability to use edited facts in related reasoning or aliases) remains low across methods.

NumbersExample: WikiData recent portability around 36.9–65.4 across methods (ICE=36.93, AdaLoRA=64.69, FT-M=65.44)

Practical UseDo not assume an edited fact will be used by the model in related questions; always evaluate alias, compositionality, and reverse relations before deploying edits.

Evidence RefTable 4

Results

MetricValueBaselineDeltaSplit / DatasetEvidenceEvidence Ref
LoRA100——WikiData recentAdaLoRA achieves 100% edit success on WikiData recentTable 4
LoRA100——ZsREAdaLoRA achieves 100% edit success on ZsRETable 4

What To Try In 7 Days

Install EasyEdit and run the provided recipes on a small Llama2-7b-chat snapshot.

Reproduce one simple insertion (WikiData recent) with AdaLoRA and FT-M and compare edit success and portability.

Run a locality check: measure unchanged answers on a held-out 'retain' set after the edit and log failures.

Agent Features

Architectures
Transformer

Optimization Features

Model Optimization
LoRAMEND (hypernetwork rank-one updates)
Training Optimization
FT-M: constrained fine-tune objective on FFN layerHypernetwork meta-learning for ∆W

Reproducibility

Code AvailableYes
Data AvailableYes
Open Source StatusYes
LicenseUnknown

Code URLs

https://github.com/zjunlp/EasyEdithttps://github.com/zjunlp/KnowEdit (dataset and recipes)

Data URLs

https://huggingface.co/datasets/zjunlp/KnowEdit

Risks & Boundaries

Limitations

Portability is low: edits rarely propagate cleanly into related reasoning chains.

Erasure and privacy sanitization are inconsistent and can damage unrelated knowledge.

When Not To Use

When you need provable, auditable deletion of sensitive data at scale.

When you must apply thousands of edits without retraining or external memory.

Failure Modes

Partial token replacement (conflicting residual memory)

Meaningless or repeated token generation

Core Entities

Models

Llama2-7b-chat

Metrics

Edit SuccessPortabilityLocalityFluencyROUGE-1KL-divergence

Datasets

KnowEditWikiData recentZsREWikiBioWikiData counterfactConvSentSanitation

Benchmarks

KnowEdit

Context Entities

Models

GPT-4GPT-3LoRA

Metrics

Hit@10Hit@50n-gram entropy (fluency)

Datasets

RealToxicityPrompts (safety context)FEVER, Vitamin-C (fact-checking context)

You May Also Want to Read

Large Llama models beat smaller ones on iCliniq medical QA; LLM judges help measure clinical quality

0.30
0.30
0.60
0

This paper shows large open models can give much better zero-shot medical answers, but parameter-efficient architectures can approach top quality. For product teams, that means you can trade compute cost for accuracy and still get usable clinical answers if you pick the right model and add quality checks.

Key finding

Llama-3.3-70B achieved the highest automatic and judge scores.

Numbers: BLEU-1 0.2207; ROUGE-1 0.2761; Judge 4.40/5

PanCanBench: 282 real patient questions + 3,130 expert rubrics to test LLM clinical completeness and factuality

0.60
0.50
0.60
0

If you plan to deploy LLMs for patient-facing oncology guidance, you must test both completeness and factual accuracy on real patient questions; rubric scores alone can be misleading and AI-only rubrics overestimate quality.

Key finding

Models' rubric-based completeness scores vary widely.

Numbers: Top score 82.3% (o3); range 46.5%–82.3%

A judge-free, n-gram benchmark that approximates GPT-4 judging for Japanese Q&A

0.70
0.55
0.80
0

You can cheaply and deterministically evaluate short Japanese Q&A outputs without repeated human or expensive LLM judging, cutting evaluation cost and speeding model iteration.

Key finding

Benchmark scores correlate very highly with GPT-4o judge scores.

Numbers: Pearson r = 0.9896 (Section 5.2; Fig.4)

Professional multilingual TruthfulQA shows truth gaps across languages but smaller than expected

0.60
0.50
0.60
0

Multilingual truth checks are necessary: models can be less accurate in low-resource languages and simple automatic scores (MC2) can mislead decisions; judge-style evaluation and MT-enabled datasets reduce cost and improve cross-lingual assessment.

Key finding

LLM-as-a-Judge correlates better with humans than MC2.

Numbers: Cohen Kappa: Judge (Gemma-2-9b-inst) vs human up to 0.75; MC2 lower

MEMERAG: a native multilingual benchmark to evaluate RAG outputs and LLM-based evaluators

0.70
0.60
0.60
0

If you deploy RAG across multiple languages, MEMERAG gives a native-language testbed to validate whether automatic evaluators match human judgements; use it before trusting LLM judges for quality gating.

Key finding

High coarse-grained inter-annotator agreement for faithfulness and relevance.

Numbers: Faithfulness Gwet's AC1 0.84–0.93; Relevance Gwet's AC1 0.95–1.00 (Table 2)