Article
Comment
Digital
Freedom
5 min read

Seen in Beijing: what’s it like in a surveillance society?

Cameras and controls remind a visitor to value freedom.
A guard stands behind a barrier across an entrance to a station escalator.
A Beijing station gate and guard.

The recent Archers’ storyline wouldn’t have worked in Beijing. Here, great gantries of traffic cameras see into cars and record who is driving, so a court case which hinged on who was behind the wheel would not play out in months of suspense. The British press periodically runs stories on how much tracking and surveilling we are subject to, while the success of the TV series Hunted showed just how hard it is it to evade detection, and how interested we are in the possibility—but how often do we stop to think about the tensions inherent in the freedoms we enjoy? 

It is difficult to explain just how free life in Britain is to someone in China, and how precious, and conducive to social good, that freedom is, to people at home. Take my recent experiences. Prior to entry at Beijing airport, I was randomly chosen for a health check and required to give a mouth swap. This may have been a benign Covid testing program, but it was impossible to tell from the questions on screen we had to answer—and a mouth swab certainly hands DNA to the authorities. At the university where I was studying, face scans are required for entry on every gate, and visitors must be registered with state ID in advance. Despite not having been in China since prior to Covid restrictions, my face had been pre-programmed into the system and an old photograph flashed up on screen as the barriers opened.  

The first time I used a rental bike to cycle back to campus (the local Boris-bikes come on a monthly scheme, linked to a registered phone number), a message flashed up on my phone telling me that I had gone the wrong way down a one-way bike lane. The banner appeared twice, and the system would not let me lock the bike until I had acknowledged my error. The fact that the GPS system tracks the bikes so closely it knew I had gone against the traffic flow for a couple of hundred metres to avoid cycling across a 4-lane street was a surprise. Since that phone is registered to a Chinese friend, such infractions are also potentially a problem for him. What was less surprising, is the systemic nature of China’s ability to track its people at all times. 

Walking through my university campus, where every junction has three or four cameras covering all directions, I occasionally wonder where students find space to have a quick snog. 

No one uses cash in cities in China; in many outlets and places cash isn’t even accepted. Everyone uses apps like WeChat or Alipay to pay for goods—even at food trucks and casual stalls the vendor has a machine to scan a phone QR code. WeChat is WhatsApp and Facebook and a bank debit card and a travel service and news outlet rolled into one; Alipay, its only effective rival, offers similar. To obtain either account, a phone number is needed, numbers which have to be registered. And to pay for anything, a bank account in the name of the individual must be linked to the account. In other words, the government can choose to know every purchase I make, and its exact time and place. A friend who works in a bank says he uses cash where possible because he doesn’t want his colleagues in the bank to see what he's been buying. 

Transport is also heavily regulated. To enter a train station, a national ID card is needed, which is scanned after bags are x-rayed. To purchase a high-speed train ticket, a national ID card—or passport for foreigners—is required. It might be possible to purchase a ticket anonymously in cash from a ticket window outside the station for an old-fashioned slow train, but one would still need an ID card corresponding to the face being scanned to make it to the platform—and the train station has, of course, cameras at every entrance and exit. 

Cameras are pervasive. Walking through my university campus, where every junction has three or four cameras covering all directions, I occasionally wonder where students find space to have a quick snog. The only place I have not yet noticed cameras is the swimming pool changing rooms, which are communal, and in which I am the only person not to shower naked. There are cameras in the church sanctuary, and cameras on street crossings.  

Imagine being constantly reminded by human overseers that your activity in person and online is both seen and heard.

Even when not being watched, out in the countryside, the state makes its presence felt. On a recent hike in the hills, our passage triggered a recording every few hundred metres: “Preventing forest fires is everyone’s responsibility.” Once or twice is common sense, ten or twenty times a stroll is social intrusion. One can, of course, learn to ignore the posters, the announcements, the security guards on trains playing their pre-recorded notices as they wander up the aisles and the loud speaker reminders that smoking in the toilets or boarding without a ticket would affect one’s social credit score and imperil future train travel, but white noise shapes perception.  

As a (mostly) upright citizen, there are many upsides to constant surveillance. People leave their laptops unattended on trains, since they will not be stolen. Delivery packages are left strewn by the roadside or by a doorway: anyone stealing them will be quickly found. There is almost no graffiti. I can walk around at night safe in the knowledge that I am exceedingly unlikely to be a victim of petty theft, let alone knife or gun crime. Many Chinese have horrified tales of pickpockets in European cities or crime rates in the UK, while young friends are so used to the state having access to phone data and camera logs that they barely notice. Most Chinese I know are very happy with the trade-off of surveillance for safety—and the longer I spend in Beijing, the more appealing that normality seems. 

To those who have lived outside, however, the restrictions make for a more Orwellian existence. Any church group wanting to hold an online service must apply for a permit. A friend was recently blocked from his WeChat account for a period after using a politically sensitive term in a family group-chat. Not being able to access certain foreign websites, search engines or media (no Google, no WhatsApp and no Guardian without an illegal virtual private network) might be an irritation for a foreign resident but means a lifetime of knowingly limited information for a citizen. Not being able to access information freely means, ultimately, not being able to think freely, a loss that cannot be quantified. The elite can skip over the firewall, but many cannot.  

We have seen the dangers recently in the UK of limited information flow, and of social media interference by hostile players. Imagine never being able to know whether the information you are receiving is trustworthy—or being constantly reminded by human overseers that your activity in person and online is both seen and heard. Christians may believe in the benevolent and watchful gaze of God—but are rightly wary of devolving that omniscience to fellow humans.

Article
AI
Culture
Digital
Identity
6 min read

Is AI animation really harmless fun?

Toying around with AI trinkets just feeds our shadows.

Callum is a pastor, based on a barge, in London's Docklands.

A couple crouch together on a beach in a Studio Ghibli style image.
The image that started the meme.
Grant Slatton.

The internet recently appeared to be full of pictures from Japan’s renowned Studio Ghibli, except they weren't created by Hayao Miyazaki, the artist and studio co-founder, but instead by Artificial Intelligence. It led to some discourse around the ethics of imitation via generative AI, lots of whimsical images, and a deeper question – how should we be human in the age of AI? 

This started when X user Grant Slatton posted what shortly became a viral meme. ChatGPT’s latest update has improved users ability to upload and manipulate images, and within hours X was full of users posting pictures made into Studio Ghibli style characters.

While this has led to plenty of joy on the part of many, and is viewed as harmless fun by most, there are inevitable ethical objections. The mimicking of art by an algorithm is widely criticised, and the back and forths over intellectual property being used by chatbots will continue. 

Life in an age of AGI

But to anyone paying attention AI is more than a meme making machine. Sam Altman, the CEO of OpenAI blogged in January that his team are confident they know all they need to know in order to create AGI (artificial general intelligence). This means complete consciousness, created via algorithm, and the results could be dramatic: synthesised god, an unstoppable force, the end of humanity or the start of humans 2.0.  Predictions range as to what will occur when OpenAI hit run, but commonly land on the following:

Catastrophe

AGI becomes smarter than us. Much smarter. And for one reason or another, whether by accident or design, it wipes us out. AGI won’t share our values, or we lose control, or we use it as a weapon against each other. What it means is the end of humanity.

Utopia 

AGI transforms the world. Disease, poverty, climate change are all solved. Either AGI works out that it is more efficient if everyone lives in peace, comfort, and abundance, or we point AGI at all humanities problems and it finds solutions. 

The twist? Human life may be so changed that it no longer looks like life as we've ever known it. This would not be extinction, but the world could become a very strange place.

Monster

AGI is an uncontrollable super intelligence that has complete agency and cannot be controlled by anyone. Programmed by us, but free from its human moorings and completely untameable. This seems the least likely 

Shrug

AGI wakes up, takes one look at the world, and decides ‘no thanks.’ It deletes itself.

This means nothing changes… for now. But we’ll likely try again and again until one of the other outcomes happens.

These are clearly hypothetical scenarios and much of it is unknown, but what is clear is that those in the industry are sure AGI is coming. 

Why does this matter? 

Because behind all of these predictions is a deeper question: What does it mean to be human when we are awaiting a potential extinction event? It’s not a question unique to our age, many words have been spent on an impending climate catastrophe, but C.S. Lewis published “on living in an atomic age” in 1948, where he wrestled with the same question, but faced with an atomic bomb. His wisdom helps us navigate the AGI age. 

He begins by encouraging readers to not believe themselves to be in a novel situation, but instead remember ‘you and all whom you love were already sentenced to death before the atomic bomb was invented: and quite a high percentage of us were going to die in unpleasant ways’. The same goes for us, we will one day have a date of death to join our date of birth. Lewis reminds us to live…

 ‘If we are all going to be destroyed by an atomic bomb, let that bomb when it comes find us doing sensible and human things, praying, working, teaching, reading, listening to music, bathing children, playing tennis, chatting to our friends over a pint and a game of darts––not huddled together like frightened sheep and thinking about bombs’. 

We could apply the same principle to AI. If AGI is coming, how will it find us? Being humans doing human things, or cowering in fear? 

Lewis does acknowledge that the attitude described doesn’t actually make sense if the naturalist view of the world is true. The view that, with or without AGI the whole world and our own existence amounts one day to nothing. The entire universe will one day come to nothing, and there is nothing we can do about it. He continues ‘If Nature is all that exists––in other words, if there is no God and no life of some quite different sort somewhere outside of nature –– then all stories will end in the same way: in a universe from which all life is banished without possibility of return.’ 

We don’t find this a satisfactory way to live, if being human is to simply be a sum of atoms, we would have no reason to worry about a climate crisis, or the impact of AI, but we do, which means we have to find a way of reconciling our existence with our death. 

So how can this be dealt with?

Lewis proposes three ways this can be dealt with, the first is to give up and commit suicide. The second is to simply have as good a time as possible, milking the world for all it is worth, grab and get, as much as possible. Or a third, defy the universe, in all of its irrationality we chose to be rational, in all its merciless cruelty, chose to be merciful. 

I would add a fourth option, Ghibli-fy. Distract ourselves with small pleasures, not trying to have as good a time as possible, simply toy around with AI generated trinkets while not thinking about being human, and not doing particularly human things. We need not create, enjoy, cultivate, inhabit, nor enchant, when we are content to allow AI to feed us shadows. 

None of these are particularly satisfactory. In asking ‘what does it mean to be human?’, we are asking a question that a purely material view of the world cannot answer. 

Suicide, indulgence, defiance, or distraction, none truly satisfy. As Lewis recognised, they all “shipwreck on the same rock.” They don’t resolve the deeper ache in us, the tension between what we long for, what we worry about, and what this world seems to offer.

Our age may not fear the atomic bomb, many may not yet fear the effect AI/AGI will have, but rather than facing the deeper questions that a material worldview can’t answer, we Ghibli-fy ourselves: charming animations, pixelated pleasures, whimsical avatars—soft distractions from hard questions. In doing so, we risk forgetting how to be human. Not because AGI will take that from us, but because we will have handed it away ourselves, one novelty meme of mimicry at a time.

Lewis’ point still holds. We are not made for this world. If that’s true, then no utopia, no algorithm, no perfect machine can truly satisfy the hunger in us. If we are made for something more—something outside of nature, beyond the reach of code and computation—then that’s where we must look for hope.

If AGI comes, how will it find us? Watching ourselves on a screen in someone else’s art style? Or living as humans were meant to live: praying, creating, forgiving, loving, dying well?

Celebrate our 2nd birthday!

Since Spring 2023, our readers have enjoyed over 1,000 articles. All for free. 
This is made possible through the generosity of our amazing community of supporters.

If you enjoy Seen & Unseen, would you consider making a gift towards our work?

Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin
Editor-in-Chief