Overview
The method demonstrates consistent gains in originality and elaboration on multiple benchmarks and human studies, but it requires more API calls (cost) and careful prompt/role design; LLM‑based evaluators align with human averages for originality.
Citations6
Evidence Strength0.80
Confidence0.86
Risk Signals11
Trust Signals
Findings with numeric evidence: 5/5
Findings with evidence refs: 5/5
Results with explicit delta: 3/5
Reproducibility
Status: Code + data available
Open source: Partial
At A Glance
Cost impact: 35%
Production readiness: 60%
Novelty: 65%
Why It Matters For Business
A structured multi‑agent, role‑played discussion can produce noticeably more original and detailed ideas than single prompts, useful for ideation, product concepts, and creative marketing at modest engineering cost.
Who Should Care
Summary TLDR
Authors introduce LLM Discussion: a three‑phase multi‑agent framework (initiation, discussion, convergence) that assigns distinct roles to LLMs. Evaluated on four creativity tests (AUT, Instances, Similarities, Scientific) with both LLM and human scoring, the method raises originality and elaboration scores versus single‑agent and debate baselines. Best settings: four agents, five rounds, role prompts + 3‑phase flow. Code released on GitHub.
Problem Statement
Large LLMs often give safe, homogeneous answers on open‑ended creative tasks. Can structured multi‑agent discussion plus role‑play push models to generate more novel, detailed ideas?
Main Contribution
LLM Discussion: a 3‑phase (initiation, discussion, convergence) multi‑LLM procedure that forces agents to build on each other's ideas.
Role‑play mechanism: automatically generated role prompts (e.g., Futurist, Environmentalist) to diversify agent viewpoints.
Key Findings
LLM Discussion increases originality on AUT compared to single‑agent baseline
LLM Discussion increases elaboration on AUT compared to single‑agent baseline
Results
| Metric | Value | Baseline | Delta | Split / Dataset | Evidence | Evidence Ref |
|---|---|---|---|---|---|---|
| AUT Originality (LLM evaluation) | LLM Discussion mean 4.44 vs Single Agent 3.47 | Single Agent (zero-shot) | +0.97 | AUT (Table 2) | Table 2 (LLM evaluation AUT) | Table 2 |
| AUT Elaboration (LLM evaluation) | LLM Discussion mean 4.22 vs Single Agent 3.08 | Single Agent (zero-shot) | +1.14 | AUT (Table 2) | Table 2 (LLM evaluation AUT) | Table 2 |
What To Try In 7 Days
Prototype a 4‑agent discussion (different role prompts) using gpt‑3.5/gpt‑4 on 5 creative prompts.
Use 5 rounds: initiation, 3 discussion rounds, convergence; compare originality/elaboration vs single prompts.
Automate role generation (few role types) and keep roles fixed per run to diversify outputs.
Agent Features
Memory
Planning
Tool Use
Frameworks
Is Agentic
Yes
Architectures
Collaboration
Reproducibility
Risks & Boundaries
Limitations
Higher API cost and latency from running multiple agents and rounds.
Creativity gains depend on prompt/role quality; role set here is not claimed optimal.
When Not To Use
When the task is closed‑ended or factual—LLM Debate or verifier pipelines are better.
When low latency or low cost is required (multi‑agent rounds increase cost).
Failure Modes
Agents converge to repetitive or verbose ideas if roles or prompts are weak.
High temperature produces nonsense; length can inflate human elaboration scores.