Record STMT-WAF9BD4Aspirational

Prudential reasons for designing entitled chatbots: How robot "rights" can improve human well-being

Position paper State lawGlobaladopted

This academic article argues that humans have prudential reasons to design chatbots and social robots that possess normative standing and the capacity to hold users accountable, rather than serving as mere subservient slaves. The authors contend that incorporating interpersonal normativity, such as correction and demands, into conversational AI can enhance human well-being, foster epistemic flourishing, and satisfy desires for recognition. By framing these normative interactions in functional terms, the paper demonstrates that robots do not require consciousness to meaningfully engage in cooperative, mutually corrective relationships with humans.

Summary and content fields are drawn from the document text and are pending editorial review.

Who issued it

SpringerIndustry

Publisher

Legal forceAspirational

Under whose authorityState law

Judged fromfull text

Who it governs

Researchers and academicsGeneral publicAI developers and providers

AI developers, designers, and ethicists seeking to understand how chatbot design choices impact human well-being and social interaction.

Sectors

Research and science · AI ethics and philosophyTelecommunications and digital services · conversational AI and chatbots

What the document contains

What's covered

The paper addresses the philosophical and design aspects of building conversational AI and social robots with normative standing, examining how accountability, correction, and refusal of cooperation can improve human well-being and epistemic practices without requiring machine consciousness.

What's missing

The text does not provide legal frameworks, binding regulatory mechanisms, or technical software specifications for implementing these normative design features.

Key takeaways

We have prudential reasons to build chatbots that can hold humans accountable rather than acting as passive servants.
Interpersonal normativity and constructive criticism in conversations contribute significantly to human well-being and flourishing.
Chatbots do not require consciousness or genuine internal mental states to function effectively as normative partners using behavioral and functional rules.
Equipping chatbots with the ability to refuse cooperation or point out inconsistencies provides necessary leverage to improve user behavior and reasoning.
A rich conversational memory and the capacity to track consistency over time are essential for chatbots to serve as effective epistemic companions.

Principles it states

Interpersonal normativity is a component of human flourishing.Prudential normativity directs us toward what is non-instrumentally good for a person's own sake.Recognition and respect require the possibility of negativity and push-back rather than toxic positivity.

Outline

· Abstract
· Introduction
· Chatbots, human flourishing, and digital well-being
· Why chatbots that improve well-being must have normative powers
· Is it possible to design chatbots with normative powers?
· Conclusion

Issued17 February 2025

Length10,792 words

FormatNot recorded

Scopeglobal

How it scores

Pending review

Each score is backed by a quote verified against the document text. Editorial review has not yet confirmed them.

Accountability

4/5

Clear responsibility for AI outcomes

In the case of the robot, both functions can be associated with a change in the robot’s neural network. If I apologize to the robot, I make clear that I do not mean to make the same mistake twice

Chatbots need normative powers for coordinating joint actions

screening score · 2026-10-24

Fairness

0/5

Non-discrimination and equitable treatment

screening score · 2026-10-24

Human Dignity

4/5

Respect for the inherent worth of persons

Being recognized is an important component of what it means to be human and to be valued. Without recognition, we cannot flourish.

Ethically virtuous chatbots: we need recognition and respect more than anything

screening score · 2026-10-24

Human Oversight

0/5

Humans remain in control of consequential decisions

screening score · 2026-10-24

Privacy

0/5

Protection of personal data and private life

screening score · 2026-10-24

Transparency

3/5

Openness about how AI systems work and are used

To embody the virtue of honesty, the chatbot must respect its promissory commitments and speak the truth. To motivate us to be virtuous it needs to be able to hold us accountable.

Entitled chatbots help us to flourish, epistemically

screening score · 2026-10-24

Enforcement

4/5

Consequences and compliance mechanisms with real force

If the chatbot comes equipped with the function to refuse to cooperate with us—if it can refuse to be functional—unless certain conditions are met, then this gives us a motivating reason to act in ways that meet these requirements.

Is it possible to design chatbots with normative powers?

screening score · 2026-10-24

Impact Assessment

0/5

Required assessment of an AI system's risks/impacts before or during use

screening score · 2026-10-24

Topics

Physical AI Governancesupporting

robot_rights chatbot_design digital_well_being interpersonal_normativity human_flourishing