Moral Subjectivity and the Moral Status of Artificial Intelligence: A Philosophical and Psychological Perspective
Zbigniew WRÓBLEWSKI
John Paul II Catholic University of Lublin , Polandhttps://orcid.org/0000-0003-4477-6903
Paweł FORTUNA
John Paul II Catholic University of Lublin , Polandhttps://orcid.org/0000-0002-0633-4453
Abstract
The paper is a voice in the discussion concerning the possibility of assigning moral status to technological artifacts driven by artificial intelligence. In the dimension of philosophical reflection, it refers to the debate on the understanding of the concept of "moral status" and the related possibility of extending the moral community to include artificial agents. In the psychological perspective, on the other hand, it presents the results of a study that examined the importance of factors relevant to the assignment of moral status, such as the features of artifacts, dimensions of mind perception, soul assignment and anthropocentric beliefs. The considerations are set in the context of currently implemented innovations, pop culture narratives shaping the image of artificial systems and discussions on the possibility of the emergence of the so-called superhuman artificial intelligence.
Keywords:
artificial intelligence, moral subject, moral status, mind perception, soul assignmentReferences
Allen, Colin, Iva Smit, and Wendell Wallach. “Artificial Morality: Top-down, Bottom-up, and Hybrid Approaches.” Ethics and Information Technology 7 (2005): 149–55.
Andreotta, Adam J. “The hard problem of AI rights.” AI and Society (2020): 1–14.
Aristotle. Nicomachean Ethics. Translated by William. D. Ross. New York: World Library Classics, 2009.
Bentham, Jeremy. An Introduction to the Principles of Morals and Legislation. Oxford: Oxford University Press, 1998.
Bostrom, Nick, and Eliezer Yudkowsky. “The Ethics of Artificial Intelligence.” In The Cambridge Handbook of Artificial Intelligence. Edited by Keith Frankish, William Ramsey. Cambridge: Cambridge University Press, 2014.
Braidotti, Rosi. The Posthuman. Cambridge: Polity Press Ltd, 2013.
Bringsjord, Selmer, Paul Bello, and Naveen Sundar Govindarajulu. “Toward Axiomatizing Consciousness.” In The Bloomsbury Companion to the Philosophy of Consciousness. Edited by Dale Jacquette. London: Bloomsbury Academic, 2018.
Callicott, John B. In Defense of the Land Ethic: Essays in Environmental Philosophy. New York: State University of New York Press, 1989.
Cave, Stephen, Kanta Dihal, and Sarah Dillon. AI Narratives: A History of Imaginative Thinking about Intelligent Machines. Oxford: Oxford University Press, 2020.
Clark, Andy, and David Chalmers. “The Extended Mind.” Analysis 58, no. 1(1998): 7–19.
Coeckelbergh, Mark. “Virtual Moral Agency, Virtual Moral Responsibility: On the Moral Significance of the Appearance, Perception, and Performance of Artificial Agents.” AI & Society 24, no. 2 (2009): 181–89.
Danaher, John. Automation and Utopia: Human Flourishing in a World without Work. Harvard University Press: Cambridge, MA, 2019.
Davies, Jem. “AI Today, AI Tomorrow. The Arm 2020 Global AI Survey”. armBlueprint, February 3, 2020. https://www.arm.com/resources/report/ai-today-ai-tomorrow-ty.
Deleuze, Gilles. “Postscript on the Societies of Control.” October 59 (1990): 3-7.
Duffy, Brian. “Anthropomorphism and the Social Robot.” Robotic and Autonomous Systems 42, nos. 3-4 (2003): 177–90.
Epley, Nicholas, Adam Waytz, aand John T. Cacioppo, “On Seeing a Human: A Three-factor Theory of Anthropomorphism,” Psychological Review 114, no. 4 (2007): 864–86.
Fortuna, Paweł. Optimum: Idea cyberpsychologii pozytywnej. Warszawa: PWN, 2021.
Fortuna, Paweł, Arkadiusz Gut, Zbigniew Wróblewski, “Hey Robot, the Mind Is Not Enough to Join the Moral Community! The Effect of Assigning a Mind and a Soul to Humanoid Robot on Its Moral Status,” Annals of Psychology / Roczniki Psychologiczne (2023). Online first. https://doi.org/10.18290/rpsych2023.0008.
Fortuna, Paweł, and Oleg Gorbaniuk. “What is Behind the Buzzword for Experts and Laymen: Representation of ‘Artificial Intelligence’ in the IT-professionals’ and Non-professionals’ Minds,” Europe’s Journal of Psychology 8, no. 2 (2022): 207–18.
Gellers, Joshua C. Rights for Robots: Artificial Intelligence, Animal and Environmental Law. New York: Routledge, 2021.
Gladden, Matthew E. Posthuman Management. Indianapolis: Synthypnion Press, 2016.
Gray, Heather M., Kurt Gray, and Daniel M. Wegner. “Dimensions of Mind Perception.” Science 315, no. 5812 (2007): 619.
Gray, Kurt, Liane Young, and Adam Waytz, “Mind Perception is the Essence of Morality.” Psychological Inquiry 23, no. 2 (2012):101–24.
Griffin, Andrew. “Saudi Arabia Grants Citizenship to a Robot for the First Time Ever.” Independent UK, October 26, 2017. https://www.independent.co.uk/tech/saudi-arabia-robot-sophia-citizenship-android-riyadh-citizen-passport-future-a8021601.html.
Gunkel, David J. “The Other Question: Can and Should Robots Have Rights?” Ethics and Information Technology 20 (2018): 87–99.
Himma, Kenneth E. “Artificial Agency, Consciousness, and the Criteria for Moral Agency: What Properties Must an Artificial Agent Have to Be a Moral Agent?” Ethics and Information Technology 11 (2009): 19–29.
Nowak, Mateusz. “Elon Musk i założyciel Apple apelują o wstrzymanie prac nad AI. ‘Utrata kontroli nad cywilizacją.’” March 30, 2023. https://android.com.pl/tech/581815-apel-o-wstrzymanie-prac-nad-ai/.
Inbar, Yoel, Jeremy Cone, and Thomas Gilovich. “People’s Intuitions about Intuitive Insight and Intuitive Choice.” Journal of Personality and Social Psychology 99, no. 2 (2010): 232–47.
Jupiter, Alex. “The Human-Cyborg Continuum: Why AI Is Pointless and Why We Should All Become Cyborgs Instead.” Medium, June 4, 2016. https://medium.com/@AlexJupiter/the-human-cyborg-continuum-why-ai-is-pointless-and-why-we-should-all-become-cyborgs-instead-4de0c4bb476f.
Kamm, Frances M. Intricate Ethics: Rights, Responsibilities, and Permissible Harm. New York: Oxford University Press, 2007.
Kant, Immanuel. The Metaphysics of Morals. Cambridge: Cambridge University Press, 2017.
Kislev, Elyakim. Relationships 5.0: How AI, VR, and Robots Will Reshape Our Emotional Lives Oxford: Oxford University Press, 2022.
Laukyte, Migle. “Artificial Agents among Us. Should We Recognize Them as Agents Proper?” Ethics and Information Technology 19, no 1 (2017): 1–17.
Leopold, Aldo. A Sand County Almanac. Oxford: Oxford University Press, 1987.
Lindes, Peter. “Intelligence and Agency.” Journal of Artificial General Intelligence 11, no. 2 (2020): 47–49.
Loh, Wulf, and Janina Loh. “Autonomy and Responsibility in Hybrid Systems: The Example of Autonomous Cars.” In Robot Ethics 2.0: From Autonomous Cars to Artificial Intelligence. Edited by Patrick Lin, Keith Abney, and Ryan Jenkins. New York: Oxford University Press, 2017.
Lukaszewicz, Aleksandra, and Paweł Fortuna. “Towards Turing Test 2.0—Attribution of Moral Status and Personhood to Human and Non‐Human Agents.” Postdigital Science and Education 4 (2022): 860–76.
Malle, Bertram F. “How Many Dimensions of Mind Perception Really Are There?” In Proceedings of the 41st Annual Meeting of the Cognitive Science Society. Edited by Ashok Goel, Colleen Seifert, Christian Freksa. Montreal, QB: Cognitive Science Society, 2019.
Marchetti, Antonella, et al. “Theory of Mind and Humanoid Robots from a Lifespan Perspective.” Zeitschrift für Psychologie 226, no. 2 (2018): 98–109.
McCall, Rosie. “Japan Has Just Granted Residency to an AI Bot in a World First.” IFLScience, November 7, 2017. http://www.iflscience.com/technology/japan-has-just-granted-residency-to-an-ai-bot-in-a-world-first.
Monett, Dagmar, and Colin W.P. Lewis. “Getting Clarity by Defining Artificial Intelligence: A Survey.” In Philosophy and Theory of Artificial Intelligence 2017. Edited by Vincent C. Müller. Berlin: Springer, 2018.
Moor, James H. “The Nature, Importance, and Difficulty of Machine Ethics.” IEEE Intelligent Systems 21, no. 4 (2006): 18–21.
Müller, Vincent C. “Is it Time for Robot Rights? Moral Status in Artificial Entities.” Ethics and Information Technology 23 (2021): 579–87.
Muzyka, Kamil. “The Basic Rules for Coexistence: The Possible Applicability of Metalaw for Human-AGI Relations.” Paladyn, Journal of Behavioral Robotics 11, no. 1 (2020): 104–17.
Nilsson, Nils. The Quest for Artificial Intelligence. Cambridge: Cambridge University Press, 2009.
Noddings, Nel. Caring: A Feminine Approach to Ethics and Moral Education. Berkeley, Los Angeles: University of California Press, 2013.
Pennachin, Cassio, and Ben Goertzel. “Contemporary Approaches to Artificial General Intelligence.” In Artificial General Intelligence: Cognitive Technologies. Edited by Cassio Pennachin, Ben Goertzel. Berlin, Heidelberg: Springer, 2007.
Puzakova, Marina, Hyokjin Kwak, and Joseph F. Rocereto. “Pushing the Envelope of Brand and Personality: Antecedents and Moderators of Anthropomorphized Brands.” Advances in Consumer Research 36 (2009): 413–20.
Regan, Tom. The Case for Animals Rights. Berkeley, Los Angeles: University of California Press, 1983.
Russell, Stuart J., and Peter Norvig. Artificial Intelligence: A Modern Approach. Boston: Pearson, 2020.
Saltik, Imge, Deniz Erdil, and Burcu A. Urgen. “Mind Perception and Social Robots: The Role of Agent Appearance and Action Types.” In HRI’21: Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction: March 8-11, 2021, Boulder, CO, USA. New York, NY: Association for Computing Machinery, [2021].
Schneider, Susan. Artificial You: AI and the Future of Your Mind. Princeton: Princeton University Press, 2019.
Schweitzer, Albert. Civilization and Ethics. London: Adam & Charles Black, 1955.
Searle, John R. “Minds, Brains and Programs.” Behavioral and Brain Science 3, no. 3 (1980): 417–24.
Singer, Peter. Animal Liberation: A New Ethics for Our Treatment of Animals. New York: Harper Collins, 1975.
———. The Expanding circle: Ethics and Sociobiology. Oxford: Clarendon Press, 1981.
Taddeo, Mariarosaria, and Luciano Floridi. “How AI Can Be a Force for Good.” Science 361, no. 6404 (2018): 751–52.
Tegmark, Max. Life 3.0: Being Human in the Age of Artificial Intelligence. New York: Alfred A. Knopf, 2017.
Tiku, Nitasha. “The Google Engineer Who Thinks the Company’s AI Has Come to Life.” The Washington Post, June 11, 2022. https://www.washingtonpost.com/technology/2022/06/11/google-ai-lamda-blake-lemoine.
Torrance, Steve, and Denis Roche. “Does an Artificial Agent Need to Be Conscious to Have Ethical Status?” In Technologies on the Stand: Legal and Ethical Questions in Neuroscience and Robotics. Edited by Bibi van den Berg, Laura Klaming. Nijmegen: Wolf Legal Publishers, 2011.
Torrance, Steve. “Artificial Agents and the Expanding Ethical Circle.” AI and Society 28, no. 4 (2013): 399–414.
Turner, Jacob. “Rights for AI” In Idem. Robot Rules, Cham: Palgrave Macmillan, 2019).
De Waal, Frans. Primates and Philosophers: How Morality Evolved. Princeton: Princeton University Press, 2006.
Wang, Pei. “On Defining Artificial Intelligence.” Journal of Artificial General Intelligence 10, no. 2 (2019): 1–37.
Wang, Pei. Kai Liu, and Quinn Dougherty, “Conceptions of Artificial Intelligence and Singularity,” Information 9, no. 4 (2018): 79.
Warren, Mary A. Moral Status: Obligations to Persons and Other Living Things. Oxford: Clarendon Press, 1997.
Weisman, Kara, Carol S. Dweck, and Ellen M. Markman, “Rethinking People’s Conceptions of Mental Life.” Proceedings of the National Academy of Sciences of the United States of America 114, no. 43 (2017):11374–79.
Wiener, Norbert. The Human Use of Human Beings, Cybernetics and Society. Boston: Houghton Mifflin, 1950.
Wynsberghe, Aimee van, and Scott Robbins. “Critiquing the Reasons for Making Artificial Moral Agents.” Science and Engineering Ethics 25, no. 3 (2019): 719–35.
Zalta, Edward N., ed. The Stanford Encyclopedia of Philosophy, s.v. “Artificial Intelligence and Robotics” (by Vincent C. Müller). https://plato.stanford.edu/entries/ethics-ai/#AutoEmpl.
John Paul II Catholic University of Lublin https://orcid.org/0000-0003-4477-6903







