Essay
AI - Artificial Intelligence
Culture
9 min read

Here’s why AI needs a theology of tech

As AI takes on tasks once exclusively human, we start to doubt ourselves. We need to set the balance right.

Oliver Dürr is a theologian who explores the impact of technology on humanity and the contours of a hopeful vision for the future. He is an author, speaker, podcaster and features in several documentary films.

In the style of an icon of the Council of Nicea, theologians look on as a cyborg and humanoid AI shake hands
The Council of Nicaeai, reimagined.
Nick Jones/Midjourney.ai

AI is all the rage these days. Researchers branching into natural and engineering sciences are thriving, and novel applications enter the market every week. Pop culture explores various utopian and dystopian future visions. A flood of academic papers, journalistic commentary and essays, fills out the picture.  

Algorithms are at the basis of most activities in the digital world. AI-based systems work at the interface with the analogue world, controlling self-driving cars and robots. They are transforming medical practices - predicting, preventing, diagnosing and supporting therapy. They even support decision-making in social welfare and jurisprudence. In the business sector, they are used to recruit, sell, produce and ship. Much of our infrastructure today crucially depends on algorithms. But while they foster science, research, and innovation, they also enable abuse, targeted surveillance, regulation of access to information, and even active forms of behavioural manipulation. 

The remarkable and seemingly intellectual achievements of AI applications uniquely confront us with our self-understanding as humans: What is there still categorically that distinguishes us from the machines we build? 

In all these areas, AI takes on tasks and functions that were once exclusive to humans. For many, the comparison and competition between humans and (algorithmically driven) machines are obvious. As these lines are written, various applications are flooding the market, characterized by their ‘generative' nature (generative AI). These algorithms, such OpenAI’s the GPT series, go further than anyone expected. Just a few years ago, it was hard to foresee that mindless computational programs could autonomously generate texts that appear meaningful, helpful, and in many ways even ‘human’ to a human conversation partner. Whether those innovations will have positive or negative consequences is still difficult to assess at this point.  

For decades, research has aimed to digitally model human capabilities - our perception, thinking, judging and action - and allow these models to operate autonomously, independent of us. The most successful applications are based on so-called deep learning, a variant of AI that works with neural networks loosely inspired by the functioning of the brain. Technically, these are multilayered networks of simple computational units that collectively encode a potentially highly complex mathematical function.  

You don’t need to understand the details to realize that, fundamentally, these are simple calculations but cleverly interconnected. Thus, deep learning algorithms can identify complex patterns in massive datasets and make predictions. Despite the apparent complexity, no magic is involved here; it is simply applied mathematics. 

Moreover, this architecture requires no ‘mental' qualities except on the part of those who design these programs and those who interpret their outputs. Nevertheless, the achievements of generative AI are astonishing. What makes them intriguing is the fact that their outputs can appear clever and creative – at least if you buy into the rhetoric. Through statistical exploration, processing, and recombination of vast amounts of training data, these systems generate entirely new texts, images and film that humans can interpret meaningfully.  

The remarkable and seemingly intellectual achievements of AI applications uniquely confront us with our self-understanding as humans: Is there still something categorically that distinguishes us from the machines we build? This question arises in the moral vacuum of current anthropology. 

Strictly speaking, only embodied, living and vulnerable humans really have problems that they solve or goals they want to achieve... Computers do not have problems, only unproblematic states they are in. 

The rise of AI comes at a time when we are doubting ourselves. We question our place in the universe, our evolutionary genesis, our psychological depths, and the concrete harm we cause to other humans, animals, and nature as a whole. At the same time, the boundaries between humans and animals and those between humans and machines appear increasingly fuzzy.  

Is the human mind nothing more than the sum of information processing patterns comparable to similar processes in other living beings and in machine algorithms? Enthusiastic contemporaries believe our current AI systems are already worthy of being called ‘conscious’ or even ‘personal beings.’ Traditionally, these would have been attributed to humans exclusively (and in some cases also to higher animals). Our social, political, and legal order, as well as our ethics, are fundamentally based on such distinctions.  

Nevertheless, companies such as OpenAI see in their product GPT-4 the spark of ‘artificial general intelligence,’ a form of intelligence comparable to or even surpassing humans. Of course, such statements are part of an elaborate marketing strategy. This tradition dates to John McCarthy, who coined the term “AI” and deliberately chose this over other, more appropriate, descriptions like “complex information processing” primarily because it sounded more fundable. 

Such pragmatic reasons ultimately lead to an imprecise use of ambiguous terms, such as ‘intelligence.’ If both humans and machines are indiscriminately called ‘intelligent,’ this generates confusion. Whether algorithms can sensibly be called ‘intelligent’ depends on whether this term refers to the ability to perform simple calculations, process data, the more abstract ability to solve problems, or even the insightful understanding (in the sense of Latin intellectus) that we typically attribute only to the embodied reason of humans.  

However, this nuanced view of ‘intelligence’ was given up under the auspices of the quest for an objectively scientific understanding of the subject. New approaches deliberately exclude the question of what intelligence is and limit themselves to precisely describing how these processes operate and function.  

Current deep learning algorithms have become so intricate and complex that we can’t always understand how they arrive at their results. These algorithms are transparent but not in how they reach a specific conclusion; hence, they are also referred to as black-box algorithms. Some strands in the cognitive sciences understand the human mind as a kind of software running on the hardware of the body. If that were the case, the mind could be explained through the description of brain states, just like the software on our computers.  

However, these paradigms are questionable. They cannot explain what it feels like to be a conscious person, to desire things, be abhorred by other things and to understand when something is meaningful and significant. They have no grasp on human freedom and the weight of responsibility that comes with leading a life. All of these human capacities require, among other things, an understanding of the world, that cannot be fully captured in words and that cannot be framed as a mathematical function.  

There are academic studies exploring the conception of embodied, embedded, enactive, and extended cognition, which offer a more promising direction. Such approaches explore the role of the body and the environment for intelligence and cognitive performance, incorporating insights from philosophy, psychology, biology, and robotics. These approaches think about the role our body as a living organism plays in our capacity to experience, think and live with others. AI has no need for such a living body. This is a categorical difference between human cognition and AI applications – and it is currently not foreseeable that those could be levelled (at least not with current AI architectures). Therefore, in the strictest sense, we cannot really call our algorithms ‘intelligent' unless we explicitly think of this as a metaphor. AI can only be called 'intelligent' metaphorically because these applications do not 'understand' the texts they generate, and those results do not mean anything to them. Their results are not based on genuine insight or purposes for the world in which you and I live. Rather they are generated purely based on statistical probabilities and data-based predictions. At most, they operate with the human intelligence that is buried in the underlying training data (which human beings have generated).  

However, all of this generated material has meaning and validity only for embodied humans. Strictly speaking, only embodied, living and vulnerable humans really have problems that they solve or goals they want to achieve (with, for example, the help of data-based algorithms). Computers do not have problems, only unproblematic states they are in. Therefore, algorithms appear 'intelligent' only in contexts where we solve problems through them. 

 When we do something with technology, technology always also does something to us. 

AI does not possess intrinsic intelligence and simulates it only due to human causation. Therefore, it would be more appropriate to speak of ‘extended intelligence': algorithms are not intelligent in themselves, but within the framework of human-machine systems, they represent an extension of human intelligence. Or even better would be to go back behind McCarthy and talk about 'complex information processing.’ 

Certainly, such a view is still controversial today. There are many philosophical, economic, and socio-political incentives to attribute human qualities to algorithms and, at the same time, to view humans as nothing more than biological computers. Such a view already shapes the design of our digital future in many places. Putting it bluntly, calling technology ‘intelligent’ makes money. 

What would an alternative, more holistic view of the future look like that took the makeup of humanity seriously?  

A theology of technology (Techniktheologie) tackles this question, ultimately placing it in the horizon of belief in God. However, it begins by asking how technology can be integrated into our lives in such a way that it empowers us to do what we truly want and what makes life better. Such an approach is neither for or against technology but rather sober and critical in the analytical sense. Answering those questions requires a realistic understanding of humans, technology, and their various entanglements, as well as the agreement of plural societies on the goals and values that make a good life.  

When we do something with technology, technology always also does something to us. Technology is formative, meaning it changes our experience, perception, imagination, and thus also our self-image and the future we can envision. AI is one of the best examples of this: designing AI is designing how people can interact with a system, and that means designing how they will have to adapt to it. Humans and technology cannot be truly isolated from each other. Technology is simply part of the human way of life.  

And yet, we also need to distinguish humans from technology despite all the entanglements: humans are embodied, rational, free, and endowed with incomparable dignity as images of God, capable of sharing values and articulating goals on the basis of a common (human) way of life. Even the most sophisticated deep learning applications are none of these. Only we humans live in a world where responsibility, sin, brokenness, and redemption matter. Therefore it is up to us to agree on how we want to shape the technologized future and what values should guide us on this path.  

Here is what theology can offer the development of technology. Theology addresses the question of the possible integration of technology into the horizon of a good life. Any realistic answer to this question must combine an enlightened understanding of technology with a sober view of humanity – seeing both human creative potential and their sinfulness and brokenness. Only through and with humans will our AI innovations genuinely serve the common good and, thus, a better future for all.  

 

Find out more about this topic: Assessing deep learning: a work program for the humanities in the age of artificial intelligence 

Review
Culture
Film & TV
Trauma
Work
4 min read

Severance: the ins and outs of seeking oblivion

We can't contain trauma to just one sphere of our lives.

Josh is a curate in London, and is completing a PhD in theology.

In a retro-future styled office, workers stand or sit around a pod of desks.
Apple TV.

How far would you go to stop yourself doing late-night emails? Or what would you be willing to do to escape those painful memories? Severance, returning for its second season on AppleTV+, explores an extreme solution to both. 

The show follows a group of office workers at Lumon who have had their memories severed: when outside of work they do not remember what they do at work and when at work they do not know anything about their lives outside. The work-self, referred to as an 'innie', enters the elevator at 5pm and immediately finds themselves back in the elevator at 9am the next day. They feel rested without any memory of the rest. Their "outie" blinks at 9am and then it is 5pm.  

Adam Scott's protagonist, Mark, joined Lumon Industries as a severed employee working in "Macrodata Refinement" (MDR) as a result of losing his wife. In an episode early in the second season, one character recounts Mark telling them that he applied for the role because it felt like he was "choking on her ghost." Being severed offers Mark hours each working day where a version of him can work oblivious to this grief. 

Of course, Mark's employer is up to something sinister, though exactly what remains unclear even to the innies. Lumon is at times terrifying, at times goofy and always unsettling. Innies are mistreated but cannot communicate with their outie beyond what Lumon allows. Even in these conditions, the small MDR team, each with no more than a couple of years' worth of memories, find purpose in their relationships with one another and in seeking to understand their bosses' designs.  

Severance has attracted a lot of attention and reflection. Writing for the Financial Times, Emma Jacobs concludes that the show points us to our impossible longing for a boundaried life. The Northeastern University academic Tomas Elliot proposes that Severance can be read as an inversion of The Matrix: employees knowingly placing themselves in a state of naivety. Jacobs and Elliot both read the show as pointing to the paradoxical nature of modern work as both the cause of discontentment and the place many look to for a sense of purpose and fulfilment.  

Instability cannot be contained to one sphere of life. Life is hard and so is work. Neither can offer escape from the other. 

At the heart of many of the questions that Severance raises is the relationship between work and identity. Most of us live with a sense that who we are is found in our relationships. Work means something because it is one of the places we are most powerfully shaped by and shape relationships with colleagues, competitors, consumers and everyone else. Work becomes destructive when it cultivates destructive relationships in the workplace or when it displaces other forms of community and sources of identity.  

The process of severance  protects outies from the formative power of workplace relationships: their strains and their joys. No doubt we could each imagine benefits to this. However, it leaves Mark's outie paralysed by grief because he has denied himself a key source of relationships through which he could begin to heal, integrating that grief into a new sense of self. 

Just as Mark's innie is protected by the outie's grief, the outie is protected from discovering who he could be without his wife. As the series progresses, it becomes less clear whether Mark's motivation is the fear of grief's crushing burden or the fear that one day the burden may ease.  

In his book Resonance, Hartmut Rosa writes: 

Time and again, human beings come to discover that they can become "different people" in different contexts. And under the highly dynamic conditions of late modernity, the task of finding out who we really are collides… with repeatedly having to "reinvent" and creatively redefine ourselves. That said reinvention also should be "completely authentic" is surely one of the more pointed paradoxes of the present age.  

As Rosa notes, the dynamism of contemporary market forces produces a dynamism in our sense of identity, which can be experienced as instability. One response to this instability—and all the other humiliations and challenges of living at this time—is to look for ways of separating "work" and "life", to carve out a space where I can be free from constant performance and reinvention. And yet, as Severance shows us, whatever part of ourselves we designate as "life" or "outie", it cannot be free from pain and sometimes we will escape to, rather than from, "work".  

Instability cannot be contained to one sphere of life. Life is hard and so is work. Neither can offer escape from the other. Some things must be resisted and some must simply be lived with. Both can only be done together. Ultimately, both can only be done if we are held in and defined by a relationship secure through any failure or loss. Seeking such a relationship is a life's work, for both innies and outies.  

Join with us - Behind the Seen

Seen & Unseen is free for everyone and is made possible through the generosity of our amazing community of supporters.

If you’re enjoying Seen & Unseen, would you consider making a gift towards our work?

Alongside other benefits (book discounts etc.), you’ll receive an extra fortnightly email from me sharing what I’m reading and my reflections on the ideas that are shaping our times.

Graham Tomlin

Editor-in-Chief