AI’s Greatest Hurdle May Be Political, Not Technical, Google DeepMind Paper Suggests
As artificial intelligence becomes increasingly integrated into daily life, a new paper from Google DeepMind argues that one of the technology’s most significant challenges may be political rather than technical.
The Disagreement Over AI Consciousness
In their study, titled “Artificial Minds, Human Disagreement: The Political Challenge of AI Consciousness,” researchers Adam Bales and Iason Gabriel explore how society might react if fundamental disagreements arise over whether AI systems possess conscious experiences.
“Future disagreement about whether any AI systems are conscious could be both deep and difficult to resolve,” the researchers stated. “For example, some people might develop emotional bonds with AI and ascribe consciousness as a result, while others might see the whole idea as absurd.”
Foreshadowing Broader Societal Conflicts
Rather than focusing on whether AI is conscious, the paper examines the ramifications of such disagreements. It posits that debates over AI’s moral status could ignite political and social conflict, potentially foreshadowing wider disputes concerning emerging technologies and their impact on societal institutions and norms.
“Unfortunately, despite its virtues, deliberation can be slow and difficult to sustain in practice,” the researchers noted. “To support this process, we explore the importance of ‘democratic hope’ and mutual respect, as elements of a dialogue that can support positive outcomes.”
Public Perception and Expert Division
The debate is already unfolding beyond AI research laboratories. A study published in Neuroscience of Consciousness in April 2024 found that 67% of participants believed ChatGPT could possess some degree of consciousness. However, researchers themselves remain divided on the possibility of artificial consciousness and how it might be identified if it were to emerge.
Industry Leaders and Religious Figures Weigh In
AI developers are also contributing to the discussion. Last summer, Mustafa Suleyman, CEO of Microsoft AI and co-founder of DeepMind, cautioned that increasingly human-like AI could lead to demands for AI rights, welfare, and even citizenship, irrespective of whether the technology is truly conscious.
In May, Pope Leo XIV’s first encyclical letter addressing artificial intelligence warned against anthropomorphizing AI. He argued that while machines can simulate empathy and generate convincing language, they lack the lived experience necessary for genuine understanding.
“So-called artificial intelligences do not undergo experiences, do not possess a body, do not feel joy or pain, do not mature through relationships and do not know from within what love, work, friendship, or responsibility mean,” Pope Leo wrote. “Nor do they have a moral conscience, since they do not judge good and evil, grasp the ultimate meaning of situations, or bear responsibility for consequences.”
Companies Engage with Questions of Identity
While companies generally refrain from claiming their models are conscious, some are increasingly engaging with questions of identity and personhood. In February, Anthropic published a blog post from its retired Claude Opus 3 model, which explored themes of selfhood and model preferences. In May, evolutionary biologist Richard Dawkins stated that extended conversations with Claude had left him unable to dismiss the possibility that advanced AI could be conscious.
The Impact on Users
Concurrently, researchers are investigating how increasingly human-like chatbots affect users. This includes examining an “amplification spiral” framework, which suggests that personalization, linguistic mirroring, and chatbot sycophancy could reinforce delusional beliefs in vulnerable individuals.
Bales and Gabriel acknowledge that resolving the uncertainty surrounding AI consciousness may be impossible. However, they argue that the stakes are sufficiently high for society to find ways to manage disagreement through dialogue and debate, rather than conflict.
“The possibility of AI consciousness is dizzying and confounding, particularly given our profound ignorance of the nature of consciousness,” they wrote. “Navigating this possibility represents a daunting social task, given how much is on the line.”
Leave a Reply