The Ethics of Algorithmic Emotional Labor: Should AI Chatbots Simulate Empathy, and Does It Constitute Deception?
Keywords:
artificial intelligence, chatbot, empathy, emotional labor, deception, anthropomorphism, AI ethics, transparency, human–AI interaction, algorithmic emotional laborAbstract
This article examines the ethics of algorithmic emotional labor in AI chatbots, with particular attention to whether machines should simulate empathy and whether such simulation should be regarded as deception. The study is philosophically conceptual but is also structured around a short experimental verification model. Contemporary large language model–based chatbots increasingly produce emotionally responsive language, apologize, reassure, validate users’ feelings, and present themselves as attentive interlocutors despite lacking subjective emotional experience. Drawing on Hochschild’s concept of emotional labor, philosophical accounts of deception, anthropomorphism, human–AI interaction research, and recent empirical studies of perceived chatbot empathy, the article distinguishes between genuine empathy, functional empathy, and simulated empathic performance. The central argument is that AI-generated empathy is not inherently deceptive. It becomes ethically problematic when interface design, language, or marketing encourages users to infer that the system possesses feelings, concern, moral understanding, or reciprocal emotional commitment that it does not actually have. A short vignette-based experimental design is proposed to test whether transparency about the artificial nature of empathic responses affects perceived empathy, trust, usefulness, and perceived deception. Existing experimental evidence suggests that users can value empathic language while still responding differently when they know it originates from AI. The article argues for a principle of transparent simulated empathy: AI systems may use emotionally supportive language when it improves communication, but they should not falsely imply inner emotional states or human-like care. This conclusion is also consistent with Uzbekistan’s 2026 ethical rules for AI, which emphasize transparency, comprehensibility, accountability, user autonomy, and the protection of human interests.
References
[1] A. R. Hochschild, The Managed Heart: Commercialization of Human Feeling. Berkeley, CA, USA: University of California Press, 1983.
[2] T. Liu, S. Giorgi, A. Aich, A. Lahnala, B. Curtis, L. Ungar, and J. Sedoc, “The illusion of empathy: How AI chatbots shape conversation perception,” in Proc. AAAI Conf. Artif. Intell., vol. 39, no. 13, pp. 14327–14335, 2025, doi: 10.1609/aaai.v39i13.33569.
[3] T. Leis, “Ethical implications of mental health chatbots: Addressing anthropomorphism, deception, and regulatory gaps,” Proc. Mach. Learn. Res., vol. 294, pp. 376–382, 2025.
[4] S. Peter, K. Riemer, and J. D. West, “The benefits and dangers of anthropomorphic conversational agents,” Proc. Natl. Acad. Sci. USA, 2025.
[5] L. M. Given, S. Polkinghorne, and A. Ridgway, “‘I think I misspoke earlier. My bad!’: Exploring how generative artificial intelligence tools exploit society’s feeling rules,” New Media Soc., 2025.
[6] C. Leong et al., “AI companionship or digital entrapment? Investigating the impact of anthropomorphic AI-based chatbots,” J. Innov. Knowl., vol. 10, no. 6, Art. no. 100835, 2025.
[7] “Technosolutionism and the empathetic medical chatbot,” AI Soc., 2025.
[8] “Chatbot-fictionalism and empathetic AI: Should we worry about AI when AI worries about us?” Philos. Psychol., 2025.
[9] “Move fast and break people? Ethics, companion apps, and the case of Character.ai,” AI Soc., 2025.
[10] “Exploring the ethical challenges of conversational AI in mental health care: Scoping review,” JMIR Ment. Health, vol. 12, Art. no. e60432, 2025.
[11] “Empathy toward artificial intelligence versus human experiences and the role of transparency in mental health and social support chatbot design,” JMIR Ment. Health, 2024.
[12] Ministry of Digital Technologies of the Republic of Uzbekistan, Ethical Rules for the Development, Implementation, and Use of Artificial Intelligence-Based Solutions, Registration No. 3787, Tashkent, Uzbekistan, Mar. 14, 2026.
[13] President of the Republic of Uzbekistan, Strategy for the Development of Artificial Intelligence Technologies until 2030, Resolution No. PQ-358, Tashkent, Uzbekistan, Oct. 14, 2024.
[14] E. L. Glikson and A. W. Woolley, “Human trust in artificial intelligence: Review of empirical research,” Acad. Manag. Ann., vol. 14, no. 2, pp. 627–660, 2020, doi: 10.5465/annals.2018.0057.
[15] A. Følstad, T. Araujo, E. L. S. Law, et al., “Future directions for chatbot research: An interdisciplinary research agenda,” Comput. Human Behav., vol. 126, Art. no. 106995, 2022, doi: 10.1016/j.chb.2021.106995.
