Argmin AIArgmin AI
About usOptimize your agent
RLHFBasic RAGPrompt OptimizationAgentic RAGQuantizationSafety BenchmarksLLM-as-a-JudgeChain-of-ThoughtMulti-Agent SystemsFunction CallingEfficient InferenceHallucination Detection

Agentic chatbots need an 'interactional' ethics that centres on respect

Agentic AISingle-Agent SystemsBias EvaluationHuman EvaluationAnalysis
January 17, 20246 min

Overview

Decision SnapshotNeeds Validation

Conceptually strong and grounded in psychology, but mostly theoretical with limited empirical validation for specific engineering choices.

Citations1

Evidence Strength0.55

Confidence0.80

Risk Signals8

Trust Signals

Findings with numeric evidence: 0/3

Findings with evidence refs: 3/3

Results with explicit delta: 0/0

Reproducibility

Status: No open assets linked

Open source: No

At A Glance

Cost impact: 35%

Production readiness: 30%

Novelty: 60%

Authors

Lize Alberts, Geoff Keeling, Amanda McCroskery

Links

Abstract / PDF

Why It Matters For Business

Agentic conversational features can damage user trust, engagement, and wellbeing if systems ignore context and treat people as data points; fixing this protects brand trust and long-term product adoption.

Who Should Care

Product ManagerCTOCEOML EngineerEngineering LeadData Scientist

Summary TLDR

This paper argues that current LLM ethics (helpful, honest, harmless) focuses on words and fails to capture situational, relational harms that arise when conversational systems act like social agents. It proposes 'interactional ethics' centred on respect, operationalised as duties to support users' autonomy, competence, and self-worth. The paper lists three classes of interactional harms (direct, influence, collective) and gives design suggestions: embed respectful assumptions, operationalise respect checks in self-evaluation, and keep/limit memory of sensitive user details.

Problem Statement

As conversational systems become proactive and agent-like, existing alignment criteria (helpful, honest, harmless) miss pragmatic, relational harms that arise in real interactions. We need an ethics that evaluates how systems treat people in context, not only the semantic content of outputs.

Main Contribution

Argues that agentic conversational AI should be evaluated as social actors, not only as output engines.

Defines three interactional harm types: direct (overt/covert), behaviour-influencing (misleading/manipulating), and collective (cumulative relational harms).

Key Findings

Semantic-focused HHH alignment (helpful, honest, harmless) can miss situational disrespect.

Practical UseAdd interactional checks (context, role, timing) to alignment pipelines rather than only filtering output text.

Evidence RefAbstract; Intro: critique of HHH criteria

Interactional harms cluster into three types: direct, behaviour-influencing, and collective.

Practical UseDesign evaluations and mitigations tailored to each harm type (e.g., tone controls for direct harms; citation/verification for misleading; memory controls for collective harms).

Evidence RefTable 1 and 'Social-interactional harms' section

What To Try In 7 Days

Audit conversational flows for potential interactional disrespect (tone, timing, assumptions).

Add lightweight memory rules: only store explicit user permissions and clear 'do-not-remember' flags.

Prototype a consent/negotiation UI that lets users set interaction style and memory preferences.

Agent Features

Memory
short-term memory (conversation context)long-term memory (selective user facts)
Planning
proactive initiation (discussed as perceived agency)
Frameworks
Constitutional AISelf-correction strategiesPerson-centred care
Is Agentic

Yes

Reproducibility

Code AvailableNo
Data AvailableNo
Open Source StatusNo
LicenseUnknown

Risks & Boundaries

Limitations

Primarily conceptual: lacks original empirical tests or user studies.

Cultural variation and differing social norms are acknowledged but not operationalised.

When Not To Use

When you need narrow, task-focused performance metrics unrelated to ongoing social interaction.

In systems without any user-facing conversational role or without persistent user relationships.

Failure Modes

Over-personalisation that invades privacy or feels manipulative.

Selective memory leading to perceived insincerity or betrayal.

You May Also Want to Read

AgentAuditor: memory‑augmented RAG + CoT that makes LLM evaluators reach human-level accuracy on agent safety

0.70
0.70
0.60
0

AgentAuditor lets teams improve automated safety/security judgments quickly without expensive fine-tuning. It lowers annotation costs, speeds evaluations, and helps catch action-level and cumulative risks that simple heuristics miss.

Key finding

AgentAuditor gives large, consistent gains across models and datasets.

Numbers: e.g., Gemini-2 F1 R-Judge 82.27 → 96.31 (Table 1)

Metamorphic tests show many LLM agents give different answers to the same problem when phrased differently

0.60
0.70
0.40
0

Models that score well on standard tests may behave unpredictably when users reword requests; testing for semantic invariance prevents surprising errors in customer-facing or safety-critical agents.

Key finding

Smaller model showed highest robustness: Qwen3-30B-A3B had the best stability and trace similarity across transformations.

Numbers: Stability 79.6%; MAD 0.049; semantic similarity 0.914

R-Judge: a human-curated benchmark (569 agent logs) that tests whether LLMs spot safety risks in agent interactions

0.40
0.70
0.45
2

Agent-enabled features can cause real harms (privacy, finance, physical); off-the-shelf LLMs often miss these risks, so companies must add a tuned safety monitor and human checks before letting agents act autonomously.

Key finding

R-Judge covers 569 agent interaction records across 5 categories and 27 scenarios with 10 risk types.

Numbers: 569 records; 5 categories; 27 scenarios; 10 risk types

A single LLM can role-play homogeneous multi-agent workflows and cut inference cost via KV-cache reuse

0.70
0.60
0.80
2

If your agent pipeline uses the same base LLM, run it as one multi-turn LLM: you often keep accuracy while cutting API/token cost and simplifying stack.

Key finding

A single LLM can match or slightly exceed homogeneous multi-agent performance on standard benchmarks.

Numbers: HumanEval: OneFlow multi-agent 91.6% → OneFlow single-agent 92.1% (Table 1)

DeceptGuard: detect agent deception by reading CoT text and activation probes

0.65
0.60
0.45
0

Agents can hide harmful actions behind plausible outputs; reading their internal reasoning or activations improves detection and reduces missed incidents in high-stakes automation.

Key finding

CoT-aware and activation-probe monitors outperform black-box monitors.

Numbers: mean pAUROC +0.097 (BB→Hybrid)