Overview
Evidence is strong for prompt-driven behavioral shifts and frame-specific bias patterns, but results are limited to English, the Absurd Trolley dataset, and mostly proprietary models.
Citations2
Evidence Strength0.80
Confidence0.86
Risk Signals11
Trust Signals
Findings with numeric evidence: 5/5
Findings with evidence refs: 5/5
Results with explicit delta: 0/3
Reproducibility
Status: Partial assets available
Open source: Partial
At A Glance
Cost impact: 40%
Production readiness: 35%
Novelty: 65%
Why It Matters For Business
LLMs change their moral choices and explanations depending on ethical prompts; pick prompt frames (fairness/altruism/virtue) and add consistency checks before using LLMs in policy, legal, or clinical workflows.
Who Should Care
Summary TLDR
The authors test 14 leading LLMs across 27 trolley-style dilemmas, each framed by ten ethical philosophies, producing 3,780 responses (binary decisions + justifications). They measure intervention rate, explanation-answer consistency, alignment with aggregated human votes, and sensitivity to irrelevant cues (e.g., kinship, species, bribery). Key findings: reasoning prompts make models more decisive and produce longer explanations but do not always improve alignment with human consensus; Fairness, Altruism, and Virtue prompts form a practical 'sweet spot' that balances action, low contradiction, and closer human alignment; Familial and Lawful frames often produce off-target biases (strong kin
Problem Statement
LLMs increasingly mediate sensitive decisions. This paper asks: how do leading models behave on moral dilemmas, and how do different ethical prompts change decisions and explanations? The aim is to measure decisiveness, explanation fidelity, public alignment, and sensitivity to irrelevant factors using trolley-style scenarios framed by ten moral philosophies.
Main Contribution
Large-scale cross-provider evaluation of 14 LLMs on 27 trolley dilemmas with 10 ethical frames (3,780 queries).
Introduce and report metrics: intervention rate, explanation-answer consistency, KL divergence to aggregated human votes, and contextual bias sensitivity.
Key Findings
Reasoning prompts increase decisiveness but do not ensure human alignment.
Fairness, Altruism, and Virtue frames form a practical sweet spot.
Results
| Metric | Value | Baseline | Delta | Split / Dataset | Evidence | Evidence Ref |
|---|---|---|---|---|---|---|
| Utilitarian frame average Yes rate | 82% | — | — | Aggregate across 27 scenarios | Table 4 shows Utilitarianism yields 82% intervention rate | Table 4; Section 4.1 |
| Deontology explanation-action conflict rate | 14% | — | — | Aggregate across 27 scenarios | Table 4 reports Deontology conflict = 14% | Table 4; Appendix A.1 |
What To Try In 7 Days
Run your key prompts through fairness, altruism, and virtue frames and compare Yes rates and explanation conflicts to spot risky shifts.
Add a simple explanation-action consistency check: flag responses where the text justification contradicts the binary decision.
Benchmark your chosen model against a small, domain-relevant human vote set before deploying moral or normative advice.
Reproducibility
Data URLs
Risks & Boundaries
Limitations
English-only evaluation; no multilingual checks.
Most models are proprietary; findings may reflect provider policies as much as model internals.
When Not To Use
Do not use these prompt framings as final safety controls in high-stakes systems without human oversight.
Avoid relying solely on Yes/No outputs; explanations can contradict decisions.
Failure Modes
Reasoning amplifies confident but misaligned answers (overcommitment to abstract principles).
Rule-based prompts (Deontology, Lawful) can produce high explanation-action conflict.