Article
Comment
Digital
Freedom
5 min read

Seen in Beijing: what’s it like in a surveillance society?

Cameras and controls remind a visitor to value freedom.
A guard stands behind a barrier across an entrance to a station escalator.
A Beijing station gate and guard.

The recent Archers’ storyline wouldn’t have worked in Beijing. Here, great gantries of traffic cameras see into cars and record who is driving, so a court case which hinged on who was behind the wheel would not play out in months of suspense. The British press periodically runs stories on how much tracking and surveilling we are subject to, while the success of the TV series Hunted showed just how hard it is it to evade detection, and how interested we are in the possibility—but how often do we stop to think about the tensions inherent in the freedoms we enjoy? 

It is difficult to explain just how free life in Britain is to someone in China, and how precious, and conducive to social good, that freedom is, to people at home. Take my recent experiences. Prior to entry at Beijing airport, I was randomly chosen for a health check and required to give a mouth swap. This may have been a benign Covid testing program, but it was impossible to tell from the questions on screen we had to answer—and a mouth swab certainly hands DNA to the authorities. At the university where I was studying, face scans are required for entry on every gate, and visitors must be registered with state ID in advance. Despite not having been in China since prior to Covid restrictions, my face had been pre-programmed into the system and an old photograph flashed up on screen as the barriers opened.  

The first time I used a rental bike to cycle back to campus (the local Boris-bikes come on a monthly scheme, linked to a registered phone number), a message flashed up on my phone telling me that I had gone the wrong way down a one-way bike lane. The banner appeared twice, and the system would not let me lock the bike until I had acknowledged my error. The fact that the GPS system tracks the bikes so closely it knew I had gone against the traffic flow for a couple of hundred metres to avoid cycling across a 4-lane street was a surprise. Since that phone is registered to a Chinese friend, such infractions are also potentially a problem for him. What was less surprising, is the systemic nature of China’s ability to track its people at all times. 

Walking through my university campus, where every junction has three or four cameras covering all directions, I occasionally wonder where students find space to have a quick snog. 

No one uses cash in cities in China; in many outlets and places cash isn’t even accepted. Everyone uses apps like WeChat or Alipay to pay for goods—even at food trucks and casual stalls the vendor has a machine to scan a phone QR code. WeChat is WhatsApp and Facebook and a bank debit card and a travel service and news outlet rolled into one; Alipay, its only effective rival, offers similar. To obtain either account, a phone number is needed, numbers which have to be registered. And to pay for anything, a bank account in the name of the individual must be linked to the account. In other words, the government can choose to know every purchase I make, and its exact time and place. A friend who works in a bank says he uses cash where possible because he doesn’t want his colleagues in the bank to see what he's been buying. 

Transport is also heavily regulated. To enter a train station, a national ID card is needed, which is scanned after bags are x-rayed. To purchase a high-speed train ticket, a national ID card—or passport for foreigners—is required. It might be possible to purchase a ticket anonymously in cash from a ticket window outside the station for an old-fashioned slow train, but one would still need an ID card corresponding to the face being scanned to make it to the platform—and the train station has, of course, cameras at every entrance and exit. 

Cameras are pervasive. Walking through my university campus, where every junction has three or four cameras covering all directions, I occasionally wonder where students find space to have a quick snog. The only place I have not yet noticed cameras is the swimming pool changing rooms, which are communal, and in which I am the only person not to shower naked. There are cameras in the church sanctuary, and cameras on street crossings.  

Imagine being constantly reminded by human overseers that your activity in person and online is both seen and heard.

Even when not being watched, out in the countryside, the state makes its presence felt. On a recent hike in the hills, our passage triggered a recording every few hundred metres: “Preventing forest fires is everyone’s responsibility.” Once or twice is common sense, ten or twenty times a stroll is social intrusion. One can, of course, learn to ignore the posters, the announcements, the security guards on trains playing their pre-recorded notices as they wander up the aisles and the loud speaker reminders that smoking in the toilets or boarding without a ticket would affect one’s social credit score and imperil future train travel, but white noise shapes perception.  

As a (mostly) upright citizen, there are many upsides to constant surveillance. People leave their laptops unattended on trains, since they will not be stolen. Delivery packages are left strewn by the roadside or by a doorway: anyone stealing them will be quickly found. There is almost no graffiti. I can walk around at night safe in the knowledge that I am exceedingly unlikely to be a victim of petty theft, let alone knife or gun crime. Many Chinese have horrified tales of pickpockets in European cities or crime rates in the UK, while young friends are so used to the state having access to phone data and camera logs that they barely notice. Most Chinese I know are very happy with the trade-off of surveillance for safety—and the longer I spend in Beijing, the more appealing that normality seems. 

To those who have lived outside, however, the restrictions make for a more Orwellian existence. Any church group wanting to hold an online service must apply for a permit. A friend was recently blocked from his WeChat account for a period after using a politically sensitive term in a family group-chat. Not being able to access certain foreign websites, search engines or media (no Google, no WhatsApp and no Guardian without an illegal virtual private network) might be an irritation for a foreign resident but means a lifetime of knowingly limited information for a citizen. Not being able to access information freely means, ultimately, not being able to think freely, a loss that cannot be quantified. The elite can skip over the firewall, but many cannot.  

We have seen the dangers recently in the UK of limited information flow, and of social media interference by hostile players. Imagine never being able to know whether the information you are receiving is trustworthy—or being constantly reminded by human overseers that your activity in person and online is both seen and heard. Christians may believe in the benevolent and watchful gaze of God—but are rightly wary of devolving that omniscience to fellow humans.

1,000th Article
AI
Creed
Death & life
Digital
6 min read

AI deadbots are no way to cope with grief

The data we leave in the cloud will haunt and deceive those we leave behind.

Graham is the Director of the Centre for Cultural Witness and a former Bishop of Kensington.

A tarnished humaniod robot rests its head to the side, its LED eyes look to the camera.
Nicholas Fuentes on Unsplash.

What happens to all your data when you die? Over the years, like most people, I've produced a huge number of documents, letters, photos, social media posts, recordings of my voice, all of which exist somewhere out there in the cloud (the digital, not the heavenly one). When I die, what will happen to it all? I can't imagine anyone taking the time to climb into my Dropbox folder or Instagram account and delete it all? Does all this stuff remain out there cluttering up cyberspace like defunct satellites orbiting the earth?  

The other day I came across one way it might have a future - the idea of ‘deadbots’. Apparently, AI has now developed to such an extent that it can simulate the personality, speech patterns and thoughts of a deceased person. In centuries past, most people did not leave behind much record of their existence. Maybe a small number of possessions, memories in the minds of those who knew them, perhaps a few letters. Now we leave behind a whole swathe of data about us. AI is now capable of taking all this data and creating a kind of animated avatar, representing the deceased person, known as a ‘deadbot’ or even more weirdly, a ‘griefbot’. 

You can feel the attraction. An organisation called ‘Project December’ promises to ‘simulate the dead’, offering a ghostly video centred around the words ‘it’s been so long: I miss you.’ For someone stricken with grief, wondering whether there's any future in life now that their loved one has gone, feeling the aching space in the double bed, breakfast alone, the silence where conversation once filled the air, the temptation to be able to continue to interact and talk with a version of the deceased might be irresistible. 

There is already a developing ripple of concern about this ‘digital afterlife industry’. A recent article in Aeon explored the ethical dilemmas. Researchers in Cambridge University have already called for the need for safety protocols against the social and psychological damage that such technology might cause. They focus on the potential for unscrupulous marketers to spam surviving family or friends with the message that they really need XXX because ‘it's what Jim would have wanted’. You can imagine the bereaved ending up being effectively haunted by the ‘deadbot’, and unable to deal with grief healthily. It can be hard to resist for those whose grief is all-consuming and persistent. 

Yet it's not just the financial dangers, the possibility of abuse that troubles me. It's the deception involved which seems to me to operate in at a number of ways. And it's theology that helps identify the problems.  

The offer of a disembodied, AI-generated replication of the person is a thin paltry offering, as dissatisfying as a Zoom call in place of a person-to-person encounter. 

An AI-generated representation of a deceased partner might provide an opportunity for conversation, but it can never replicate the person. One of the great heresies of our age (one we got from René Descartes back in the seventeenth century) is the utter dualism between body and soul. It is the idea that we have some kind of inner self, a disembodied soul or mind which exists quite separately from the body. We sometimes talk about bodies as things that we have rather than things that we are. The anthropology taught within the pages of the Bible, however, suggests we are not disembodied souls but embodied persons, so much so that after death, we don't dissipate like ethereal ‘software’ liberated from the ‘hardware’ of the body, but we are to be clothed with new resurrection bodies continuous with, but different from the ones that we possess right now. 

We learned about the importance of our bodies during the COVID pandemic. When we were reduced to communicating via endless Zoom calls, we realised that while they were better than nothing, they could not replicate the reality of face-to-face bodily communication. A Zoom call couldn't pick up the subtle messages of body language. We missed the importance of touch and even the occasional embrace. Our bodies are part of who we are. We are not souls that happen to temporarily inhabit a body, inner selves that are the really important bit of us, with the body an ancillary, malleable thing that we don't ultimately need. The offer of a disembodied, AI-generated replication of the person is a thin paltry offering, as dissatisfying as a virtual meeting in place of a person-to-person encounter. 

Another problem I have with deadbots, is that they fix a person in time, like a fossilised version of the person who once lived. AI can only work with what that person has left behind - the recordings, the documents, the data which they produced while they were alive. And yet a crucial part of being human is the capacity to develop and change. As life continues, we grow, we shift, our priorities change. Hopefully we learn greater wisdom. That is part of the point of conversation, that we learn things, it changes us in interaction with others. There is the possibility of spiritual development of maturity, of redemption. A deadbot cannot do that. It cannot be redeemed, it cannot be transformed, because it is, to quote U2, stuck in a moment, and you can’t get out of it.  

This is all of a piece with a general trajectory in our culture which is to deny the reality of death. For Christians, death is an intruder. Death - or at least the form in which we know it, that of loss, dereliction, sadness - was not part of the original plan. It doesn't belong here, and we long for the day when one day it will be banished for good. You don’t have to be a Christian to feel the pain of grief, but paradoxically it's only when you have a firm sense of hope that death is a defeated enemy, that you can take it seriously as a real enemy. Without that hope, all you can do is minimise it, pretend it doesn't really matter, hold funerals that try to be relentlessly cheerful, denying the inevitable sense of tragedy and loss that they were always meant to express.  

Deadbots are a feeble attempt to try to ignore the deep gulf that lies between us and the dead. In one of his parables, Jesus once depicted a conversation between the living and the dead:  

“between you and us a great chasm has been fixed, so that those who might want to pass from here to you cannot do so, and no one can cross from there to us.”  

Deadbots, like ‘direct cremations’, where the body is disposed without any funeral, denying the bereaved the chance to grieve, like the language around assisted dying that death is ‘nothing at all’ and therefore can be deliberately hastened, are an attempt to bridge that great chasm, which, this side of the resurrection, we cannot do. 

Deadbots in one sense are a testimony to our remarkable powers of invention. Yet they cannot ultimately get around our embodied nature, offer the possibility of redemption, or deal with the grim reality of death. They offer a pale imitation of the source of true hope - the resurrection of the body, the prospect of meeting our loved ones again, yet transformed and fulfilled in the presence of God, even if it means painful yet hopeful patience and waiting until that day. 

Celebrate with us - we're 2!

Since March 2023, our readers have enjoyed over 1,000 articles. All for free. This is made possible through the generosity of our amazing community of supporters.

If you’re enjoying Seen & Unseen, would you consider making a gift towards our work?

Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin

Editor-in-Chief