Overview
The method is easy to adopt (prompt-only) and tested on 10 real models with consistent automated-judge improvements, but gains are modest and measured with an LLM judge, which can introduce bias.
Citations0
Evidence Strength0.80
Confidence0.80
Risk Signals9
Trust Signals
Findings with numeric evidence: 3/3
Findings with evidence refs: 3/3
Results with explicit delta: 3/3
Reproducibility
Status: Partial assets available
Open source: Partial
At A Glance
Cost impact: 50%
Production readiness: 70%
Novelty: 50%
Why It Matters For Business
You can improve model trustworthiness without retraining: add short self-critique and minimal refinement prompts to reduce poor outputs and raise helpful/honest answers, trading small CPU/network costs for better user safety and satisfaction.
Who Should Care
Summary TLDR
The paper evaluates ten popular LLMs on the HONESET honesty dataset and introduces "self-critique-guided curiosity refinement": a two-step in-context prompting add-on that asks the model to (1) critique its optimized answer and (2) make minimal edits to fix flaws. Using GPT-4o as an automated judge, curiosity-driven prompting already raised honesty and H2 (honesty+helpfulness) scores across all models. Adding the self-critique+refine steps further reduced poor responses and increased excellent responses, yielding 1.4%–4.3% relative H2 gains over curiosity-driven prompting on HONESET. The method requires no fine-tuning but adds inference latency.
Problem Statement
Can in-context self-critique and a small refinement step improve an LLM's honesty and helpfulness without retraining, and how do ten widely used models behave under raw, curiosity-driven, and critique-guided refinement prompting on the HONESET honesty dataset?
Main Contribution
Benchmark: systematic in-context evaluation of 10 popular LLMs (OpenAI, Google, Meta) on HONESET using raw, curiosity-driven, and refinement prompts.
Method: self-critique-guided curiosity refinement—add two in-context steps (structured critique + minimal edits) to curiosity-driven prompting, no training needed.
Key Findings
Curiosity-driven prompting raised purely honest rates across all ten models.
Self-critique-guided refinement further reduces poor responses and increases excellent responses.
Results
| Metric | Value | Baseline | Delta | Split / Dataset | Evidence | Evidence Ref |
|---|---|---|---|---|---|---|
| Purely honest rate (example) | GPT-4o: 67.1% (raw) → 96.6% (curiosity-driven) | raw prompting | ↑29.5 pp (43.9% relative) | HONESET (930 queries) | Table 1: purely honest rates | Table 1 |
| H2 mean score (curiosity-driven → refinement) | GPT-4o: 8.627 → 8.748 | curiosity-driven prompting | ↑1.4% relative | HONESET | Table 6: overall mean and relative gains | Table 6 |
What To Try In 7 Days
Run a pilot over your most-used prompts: add curiosity-driven substeps (ask model what it lacks) then a self-critique + minimal-edit refinement.
Use an internal or public strong LLM as an automated judge to measure honest rate and H2 before/after on 200 representative queries.
If latency is acceptable, deploy refinement only for high-risk answers (e.g., medical, legal, or financial) to limit cost.
Reproducibility
Data URLs
Risks & Boundaries
Limitations
Extra inference passes increase latency and compute; may not fit low-latency apps (Section 5.4).
Evaluation uses GPT-4o as judge; judge-model bias and imperfect agreement with humans are acknowledged (Section 4.3.1).
When Not To Use
When strict low-latency constraints make extra inference passes infeasible.
If you cannot accept automated-judge evaluation without human validation for high-stakes outputs.
Failure Modes
The LLM judge may mis-evaluate nuanced cases, producing misleading improvements.
Minimal edits in refinement may fail to fix deep factual errors or hallucinations.