Overview
MAO shows a practical way to generate BPMN text with GPT‑4 and automated checks; experiments use public datasets but rely on a closed model and limited BPMN elements, so adapt before broad production use.
Citations1
Evidence Strength0.70
Confidence0.85
Risk Signals11
Trust Signals
Findings with numeric evidence: 4/4
Findings with evidence refs: 4/4
Results with explicit delta: 1/3
Reproducibility
Status: Code + data available
Open source: Partial
At A Glance
Cost impact: 70%
Production readiness: 60%
Novelty: 60%
Why It Matters For Business
MAO automates BPMN drafting, reducing time and per‑model cost while producing models closer to reference designs than many human modelers on tested cases.
Who Should Care
Summary TLDR
MAO is a four‑phase framework that uses multiple LLM agents to turn textual requirements into BPMN process models. Phases: Generation (create initial BPMN text), Refinement (split activities/add gateways), Reviewing (fix semantic hallucinations via reviewer agents), and Testing (use external tools to fix format errors). Experiments with GPT‑4 on two public datasets (FG‑C, CG‑O) show MAO produces higher‑quality models than ProMoAI and outperforms most human modelers on the fine‑grained dataset. Code is publicly available.
Problem Statement
Manual BPMN modeling is slow and costly. LLMs can automate model creation but make logical (semantic) and formatting (syntax) errors. Existing LLM approaches either produce only simple sequences or require human fixes. The paper asks: can multi‑agent LLM orchestration generate usable BPMN models and automatically detect and repair hallucinations?
Main Contribution
MAO: a practical four‑phase multi‑agent pipeline (Generation, Refinement, Reviewing, Testing) to produce BPMN text from process requirements.
Prompt strategy that mixes knowledge injection (concise BPMN text format), few‑shot examples, and Chain‑of‑Thought to improve agent outputs.
Key Findings
MAO outperformed manual modelers on four FG‑C cases.
MAO is faster and cheaper than the compared LLM baseline (ProMoAI).
Results
| Metric | Value | Baseline | Delta | Split / Dataset | Evidence | Evidence Ref |
|---|---|---|---|---|---|---|
| Percent of manual models surpassed (FG‑C) | 89%, 61%, 52%, 75% (datasets 1–4) | Human-Mean | — | FG‑C (Camunda) | Table 4: proportion MAO > human models | Table 4 |
| Average generation time and cost | MAO: ~10 min, $0.12 per model; ProMoAI: ~15 min, $0.40 | ProMoAI | MAO ~33% faster, ~70% cheaper per reported run | CG-O (coarse cases) | Section 4.3 | Section 4.3 |
What To Try In 7 Days
Run the MAO repo on one simple process spec using GPT‑4 to see end‑to‑end BPMN text output.
Convert a few internal process descriptions to the paper's BPMN text format and compare outputs with existing diagrams.
Enable the Reviewing and Testing steps and measure how format checks reduce manual rework times.
Agent Features
Memory
Planning
Tool Use
Frameworks
Is Agentic
Yes
Architectures
Collaboration
Reproducibility
Risks & Boundaries
Limitations
Supports only common BPMN elements; data and message flows are not fully handled.
Relies on GPT‑4 (closed model) and API costs can scale with usage.
When Not To Use
When full BPMN features (rich message/data flows) are required.
When offline or closed‑network operation is mandatory (requires GPT‑4 APIs).
Failure Modes
Semantic hallucinations: wrong activity order or irrelevant activities.
Format hallucinations: missing attributes or malformed BPMN text.