Large language model attributes and perceived moral agency of artificial moral advisors

Citation

Liew, Tze Wei and Tan, Su Mae and Lee, Yi Yong and Gan, Chin Lay and Chan, Tak Jie (2026) Large language model attributes and perceived moral agency of artificial moral advisors. Frontiers in Artificial Intelligence, 9. ISSN 2624-8212

[img] Text
Large language model attributes and perceived moral agency of artificial moral advisors.pdf - Published Version
Restricted to Repository staff only

Download (777kB)

Abstract

Large Language Models (LLMs) are increasingly used as conversational artificial moral advisors capable of providing ethical guidance, moral reflection, and recommendations regarding complex moral dilemmas. Despite their ability to generate coherent and persuasive moral discourse, LLMs lack genuine moral understanding, intentionality, and reflective judgment, raising concerns that users may overattribute moral agency to these systems. Drawing on Theory of Mind, AI Moral Agency, and the Godspeed framework, this study investigates how perceived LLM attributes—namely anthropomorphism, animacy, likeability, and intelligence—are associated with users’ perceptions of agency and morality in the context of artificial moral advisors. Methods: A cross-sectional survey was conducted with 758 valid respondents who were presented with vignette-based moral dilemmas relevant to young adults and instructed to imagine seeking advice from LLM-based conversational agents. Results: Perceived agency was positively associated with perceived morality, suggesting that users are more likely to regard LLM-based artificial moral advisors as morally capable when they perceive them as autonomous, intentional, and self-directed entities. Perceived LLM anthropomorphism and animacy were significantly and positively associated with perceived agency, with perceived agency fully mediating their associations with the perceived morality of artificial moral advisors. Perceived LLM likeability and intelligence were positively associated with perceived morality but were not significantly associated with perceived agency, suggesting that users may infer moral capability from social appeal and cognitive competence without necessarily attributing autonomy or intentionality to these systems. Discussion: These findings oer important theoretical and practical implications for the ethical design of artificial moral advisors, particularly regarding the need to prevent inflated perceptions of AI moral competence and authority

Item Type: Article
Uncontrolled Keywords: Artificial moral advisors, Godspeed indices
Subjects: B Philosophy. Psychology. Religion > BF Psychology (General)
Divisions: Faculty of Management (FOM)
Depositing User: Ms Rosnani Abd Wahab
Date Deposited: 29 Oct 2026 01:44
Last Modified: 29 Oct 2026 01:44
URII: http://shdl.mmu.edu.my/id/eprint/16969

Downloads

Downloads per month over past year

View ItemEdit (login required)