“Intelligence is the wrong metaphor for what we’ve built”

Travelling From Apple to Anomaly, Trevor Paglen’s installation at the Barbican’s Curve gallery in London, for New Scientist, 9 October 2019

A COUPLE of days before the opening of Trevor Paglen’s latest photographic installation, From “Apple” to “Anomaly”, a related project by the artist found itself splashed all over the papers.

ImageNet Roulette is an online collaboration with artificial intelligence researcher Kate Crawford at New York University. The website invites you to provide an image of your face. An algorithm will then compare your face against a database called ImageNet and assign you to one or two of its 21,000 categories.

ImageNet has become one of the most influential visual data sets in the fields of deep learning and AI. Its creators at Stanford, Princeton and other US universities harvested more than 14 million photographs from photo upload sites and other internet sources, then had them manually categorised by some 25,000 workers on Amazon’s crowdsourcing labour site Mechanical Turk. ImageNet is widely used as a training data set for image-based AI systems and is the secret sauce within many key applications, from phone filters to medical imaging, biometrics and autonomous cars.

According to ImageNet Roulette, I look like a “political scientist” and a “historian”. Both descriptions are sort-of-accurate and highly flattering. I was impressed. Mind you, I’m a white man. We are all over the internet, and the neural net had plenty of “my sort” to go on.

Spare a thought for Guardian journalist Julia Carrie Wong, however. According to ImageNet Roulette she was a “gook” and a “slant-eye”. In its attempt to identify Wong’s “sort”, ImageNet Roulette had innocently turned up some racist labels.

From “Apple” to “Anomaly” also takes ImageNet to task. Paglen took a selection of 35,000 photos from ImageNet’s archive, printed them out and stuck them to the wall of the Curve gallery at the Barbican in London in a 50-metre-long collage.

The entry point is images labelled “apple” – a category that, unsurprisingly, yields mostly pictures of apples – but the piece then works through increasingly abstract and controversial categories such as “sister” and “racist”. (Among the “racists” are Roger Moore and Barack Obama; my guess is that being over-represented in a data set carries its own set of risks.) Paglen explains: “We can all look at an apple and call it by its name. An apple is an apple. But what about a noun like ‘sister’, which is a relational concept? What might seem like a simple idea – categorising objects or naming pictures – quickly becomes a process of judgement.”

The final category in the show is “anomaly”. There is, of course, no such thing as an anomaly in nature. Anomalies are simply things that don’t conform to the classification systems we set up.

Halfway along the vast, gallery-spanning collage of photographs, the slew of predominantly natural and environmental images peters out, replaced by human faces. Discrete labels here and there indicate which of ImageNet’s categories are being illustrated. At one point of transition, the group labelled “bottom feeder” consists entirely of headshots of media figures – there isn’t one aquatic creature in evidence.

Scanning From “Apple” to “Anomaly” gives gallery-goers many such unexpected, disconcerting insights into the way language parcels up the world. Sometimes, these threaten to undermine the piece itself. Passing seamlessly from “android” to “minibar”, one might suppose that we are passing from category to category according to the logic of a visual algorithm. After all, a metal man and a minibar are not so dissimilar. At other times – crossing from “coffee” to “poultry”, for example – the division between categories is sharp, leaving me unsure how we moved from one to another, and whose decision it was. Was some algorithm making an obscure connection between hens and beans?

Well, no: the categories were chosen and arranged by Paglen. Only the choice of images within each category was made by a trained neural network.

This set me wondering whether the ImageNet data set wasn’t simply being used as a foil for Paglen’s sense of mischief. Why else would a cheerleader dominate the “saboteur” category? And do all “divorce lawyers” really wear red ties?

This is a problem for art built around artificial intelligence: it can be hard to tell where the algorithm ends and the artist begins. Mind you, you could say the same about the entire AI field. “A lot of the ideology around AI, and what people imagine it can do, has to do with that simple word ‘intelligence’,” says Paglen, a US artist now based in Berlin, whose interest in computer vision and surveillance culture sprung from his academic career as a geographer. “Intelligence is the wrong metaphor for what we’ve built, but it’s one we’ve inherited from the 1960s.”

Paglen fears the way the word intelligence implies some kind of superhuman agency and infallibility to what are in essence giant statistical engines. “This is terribly dangerous,” he says, “and also very convenient for people trying to raise money to build all sorts of shoddy, ill-advised applications with it.”

Asked what concerns him more, intelligent machines or the people who use them, Paglen answers: “I worry about the people who make money from them. Artificial intelligence is not about making computers smart. It’s about extracting value from data, from images, from patterns of life. The point is not seeing. The point is to make money or to amplify power.”

It is a point by no means lost on a creator of ImageNet itself, Fei-Fei Li at Stanford University in California, who, when I spoke to Paglen, was in London to celebrate ImageNet’s 10th birthday at the Photographers’ Gallery. Far from being the face of predatory surveillance capitalism, Li leads efforts to correct the malevolent biases lurking in her creation. Wong, incidentally, won’t get that racist slur again, following ImageNet’s announcement that it was removing more than half of the 1.2 million pictures of people in its collection.

Paglen is sympathetic to the challenge Li faces. “We’re not normally aware of the very narrow parameters that are built into computer vision and artificial intelligence systems,” he says. His job as artist-cum-investigative reporter is, he says, to help reveal the failures and biases and forms of politics built into such systems.

Some might feel that such work feeds an easy and unexamined public paranoia. Peter Skomoroch, former principal data scientist at LinkedIn, thinks so. He calls ImageNet Roulette junk science, and wrote on Twitter: “Intentionally building a broken demo that gives bad results for shock value reminds me of Edison’s war of the currents.”

Paglen believes, on the contrary, that we have a long way to go before we are paranoid enough about the world we are creating.

Fifty years ago it was very difficult for marketing companies to get information about what kind of television shows you watched, what kinds of drinking habits you might have or how you drove your car. Now giant companies are trying to extract value from that information. “I think,” says Paglen, “that we’re going through something akin to England and Wales’s Inclosure Acts, when what had been de facto public spaces were fenced off by the state and by capital.”

Turning over new leaves

Contemplating Trees at Fondation Cartier, Paris for the Financial Times, 1 August 2019

Trees, a group show at the Fondation Cartier in Paris featuring artists, botanists and philosophers, screams personality — by which I mean eccentricity, thought and argument. Appropriately, it’s an exhibition that lives and breathes. I hated some of it and walked out of the gallery grinning from ear to ear. It absolutely does its job: it makes trees treeish again.

The French state’s funding for the arts is generous in quantity but conservative in taste. It doesn’t fund the Fondation Cartier, leaving it free to be playful — to hang so-called “outsider” and indigenous artists alongside established names; to work with artists in the long term, developing and acquiring pieces as collaborations grow. In other words, Paris’s first private foundation for contemporary art is free to behave as a private patron should and to learn on the job.

Trees is the latest in a line of exhibitions conceived by the Fondation Cartier that seek to decentre humans’ view of ourselves as overlords of creation. In 2016, The Great Animal Orchestra exhibition (which visits London in October) sought to establish common intellectual ground between species. Trees goes further, seeking a rapprochement between two kingdoms, the animals and the plants.

Trees are weirdly hard to see because they hide in plain sight. “The tree is the chair on which we sit, the table we use to write, it is our cupboards, our furniture, but also our most ordinary tools,” as Parisian philosopher Emanuele Coccia writes in the exhibition catalogue.

Tree-blindness is made worse by a western intellectual inheritance. When Aristotle asserted in his De plantis that vegetable life is insensate, he was going against Plato, Anaxagoras, Democritus and Empedocles. And he was wrong: plants detect and react to temperature, humidity, air pressure, vibration, sound, touch, trauma and chemical information that we have no short names for. They respond to these sensations as quickly as any animal. They are not less than animals, but they are radically, mind-bendingly different.

A life among trees does things to the eye. Perspective is not much help in reading a treescape, while pattern recognition is vital. Work here by Kalepi, Joseca and Ehuana Yaira, Yanomami artists from the Amazon rainforest, explores the architectonic quality of trees, expressing them as entire bodies rather than (as the western eye prefers) complex assortments of twigs and leaves. The Paraguayan artists of the Gran Chaco region included here, meanwhile, express their forest home more through typology than through aesthetics. Theirs is a forest as well-stocked and well-ordered as a supermarket. Count all the little animals and plants laid out in rows: this is not a wilderness but a tally of self-renewing plenty. The general lesson seems to be that a forest is an environment that’s easier to read for what it contains than to swallow in one gulp.

Drawings and diagrams by contemporary botanist Francis Hallé honour natural history, a European tradition in which aesthetic knowledge and scientific knowledge run parallel. Twentieth-century laboratory-based science finds its way on to Fabrice Hyber’s huge canvases — like wall-sized notebook pages annotated with multicoloured scribbles, graphs, colour wheels and wave forms. In each, Hyber reduces the trees to a single trunk, or a trunk and a branch: a world of abstractions and generalis­ations. Cesare Leonardi’s meticulous drawings reveal the architectural potential of trees — a potential mischievously misappropriated in Peruvian photo­grapher Sebastian Mejía’s pictures of trees strained through fence wire, incorporated into walls or otherwise appropriated by the unliving city.

Some works here protest against the world’s breakneck deforestation. Thijs Biersteker, in collaboration with botanist Stefano Mancuso, offers a salve, wiring two trees in the Fondation’s extensive garden to scientific visualisations to help us empathise with what trees are sensing in real time. (This is more than a rhetorical flourish: the sense data that the piece collects are being corroborated and fed into scientific research, in a work that fulfils a dual artistic and scientific function.)

The lion’s share of the show is given over to Brazilian artist Luiz Zerbini, whose muted, simple monotypes and huge, complex, colourful canvases surround a table herbarium and a tree. The paintings are an Anthropocene jungle of sorts in which urban and natural forms hide in plain sight within a fiercely perpectiveless, rectilinear grid. Give your eyes time to adjust, and you find yourself in a city/forest of the future, where nature is exploited but not exhausted, and beauty and utility coexist.

These canvases suggest that we humans, having crafted our way out of the trees and developed those crafts on an industrial scale, can perhaps learn an even neater trick and make the whole human adventure last beyond this current, rapine moment

I came out of this show happy. I wasn’t just enthused. I’d been converted.

Art that hides in plain sight

Visiting Takis’s survey show at Tate Modern for the Spectator, 13 July 2019

Steel flowers bend in a ‘breeze’ generated by magnetic pendulums. This is the first thing you see as you enter Tate Modern’s survey show. And ‘Magnetic Fields’ (1969) is pretty enough: the work of this self-taught artist, now in his nineties, has rarely been so gentle, or so intuitive.

But there’s a problem. ‘I would like to render [electromagnetism] visible so as to communicate its existence and make its importance known,’ Takis has written. But magnetism hides in plain sight. A certain amount of interference is necessary before it will reveal itself.

Does the interference matter? Does the fact that gallery assistants have to activate this work every ten minutes spoil the ‘cosmicness’ of Takis’s art? The sculptor Alberto Giacometti thought so: ‘One day, during one of my exhibitions, he told me that he didn’t agree with my use of electricity for some of my works,’ Takis recalled in an interview in 1990. ‘He disliked the fact that if you switched off the power, the work would cease to function.’

Why Takis’s pieces should prompt such a finicky response isn’t immediately obvious. What do we expect of this stuff? Perpetual motion? One moment we wonder at the invisible force that can suspend delicate metal cones fractions of an inch above the surface of a canvas. The next moment, we’re peering where we shouldn’t, trying to figure out the circuitry that keeps a sphere swinging over a steel wire.

We’re presented with many wonders — objects rendered weightless, or put into permanent vibration. And as the show progresses (it’s surprisingly large, designed to unfold around corners and spring surprises at your back) the work gets less intuitive, and a lot louder. A pendulum, orbiting a strong, floor-mounted magnet, whips eccentrically and not at all gently about its centre of attraction. It’s like nothing in visible nature. There’s no ‘magnetic breeze’ here, no ‘force like gravity’, just the thing, the weirdness itself. Now we’re getting somewhere.

Born Panayiotis Vassilakis in 1925, Takis discovered his alchemical calling early. One memoir recalls how ‘as a small boy, he would bury pieces of broken glass and other such oddments in the ground to see what happened to them when he impatiently dug them out a couple of days later’. In 1954 he moved to Paris, where he fell in with Marcel Duchamp and Yves Tanguy. In London he inspired a group of young artists who went on to create the politically radical Signals London gallery. In America the beats admired him, the Massachusetts Institute of Technology gave him a fellowship, and the composer John Cage encouraged his shamanism. (‘I cannot think of my work as entirely my work,’ Takis writes. ‘In a sense, I’m only a transmitter.’)

Takis treads the same awkward line in visual art that Cage did in music. Cage promised us that behind the music of signs lay some sort of sonic essence. But his snark hunt proved rather dull. Takis’s own search ends more happily, if only because the eye, in its search for signs, doesn’t admit defeat nearly as quickly as the ear. Takis’s traffic signals, stripped of context and perched on tall poles, become eyes full of sadness and yearning. They still mean something. They’re still signs of something.

Made from oddments plucked from boxes of army and air-force surplus on Tottenham Court Road, some of Takis’s more engineered work has dated. We look at it as a sort of industrial archaeology. Its radicalism, its status as ‘anti-technology’, is hard to fathom.

But the simpler pieces need no translation. They are (suitably enough, for an artist whose works often screech and rattle) a sort of visual equivalent of music. They do not mean anything. They are meaning. They reflect harmonious relationships between energy and space and mass. Takis’s work is like his subject: it hides in plain sight.

A clown, a fool, a “klimatosser”

I went round to Olafur’s house for New Scientist, 13 July 2019

SIXTEEN years ago, Danish-Icelandic artist Olafur Eliasson caught London off guard with a massive indoor artwork. Some 2 million people visited The Weather Project at the Tate Modern gallery to bask in the glow of a giant, artificial sun. It was a rare moment of collective awe – created using the simplest of materials. This week, Eliasson is back with a major retrospective exhibition and most of the pieces are new to the UK. But a lot has changed since 2003. Days before his new show opens, we asked the artist about selfie culture, what accessible art looks like in the teched-up Anthropocene, and the hefty carbon footprint that pictures and installations leave behind.

Do big art and big science have to justify themselves to people who don’t get the point?

Sadly, yes, and it’s an argument we’re losing because great science and great art are very much long-term projects, views given to politicians with short-term goals. Making a work might take 10 years. Getting it shown might take another 10. For people to finally settle down with the experience might take 10 years, too. It’s a very slow piece of communication.

You command big budgets. Is the relationship with money tricky for artists?

To make big projects is expensive. But think about how much money an alcohol company throws into the promotion of some new drink! I believe there are studies showing that if you throw a euro or a pound into the culture sector, it generates two to three times as much income. There are more people working in the culture sector than there are in the car industry. It’s also a part of our democratic stability. It’s a space where we feel we can have difficult conversations. Is that expensive? No. It’s actually very cheap.

What can we expect from the show at Tate Modern?

We have about 42 works, big and small. Some are entertaining, like Your Uncertain Shadow and Your Blind Passenger, where a tunnel full of smoke gives you the experience of being blind. Of course, instantly your ears get more active, you touch the wall and stretch out your hand so as not to bump into somebody. Other works are more contemplative.

Wasn’t there a plan to stage something outside the gallery?

Yes. We’re installing three waterfalls. We know today there are no real waterfalls left because they’re all human-influenced, if not human-made. So our waterfalls are as real as anything in nature – or as unreal.

Do you consider yourself an environmental artist?

In the show, there is a series of 40 photos of glacial tongues from Iceland, taken in 1998. I believed then that culture and nature were two distinct spaces. I didn’t fully understand that the Anthropocene age had started. When people look at the photos now, they say “this is about climate”. When I took them, it was about their beauty. Soon, I’ll be retaking those photos from the same angles, in the same places. Maybe in October, if I’ve finished, we will sneak in the new pictures so we have the two series hanging next to each other, 20 years apart.

In December, you brought 30 polar ice blocks from Greenland to London and let them melt. Why?

Some 235,000 people were estimated to have been not just walking by, but at the ice – sometimes physically hugging it – and this, I think, made Ice Watch a clear and robust statement. This is what the data from the scientists looks like. This is what a block of ice 15,000 years old looks like. And it’s going to be gone in a week.

How big is the carbon footprint of your work?

We worked with a consultancy called Julie’s Bicycle, which helps people in the culture sector calculate their climate footprint. The London project came to the equivalent of 52 return flights from London to Ilulissat in Greenland. For almost two years, we’ve been trying to come up with a step-by-step solution for my Berlin studio. And whenever I work with museums and logistics teams, I ask them to come up with a response to the climate.

Our readers care about green footprints, but does everyone?

I was with teenage children in Ethiopia in January. They knew all about global warming, they understood about greenhouse gases and how it wasn’t really them, their parents or their ecology that created this problem. There is no place left where people don’t know this. There are deniers in places like the White House who deny things because they’re following other economic or power priorities.

What can artists bring to the climate debate?

Recently, a far right Danish politician lost a huge number of voters and one of the most prominent members of that party said, well, it’s all these climate fools. And immediately, across the political spectrum, people picked up on it, saying “I’m a clown, a fool, a klimatosser“. If we’re going to re-engineer the systems of tomorrow, we need to risk being foolish. Previous models of success can’t be applied. The planet simply can’t host them any longer. We need to take risks.

How has social media affected your work?

It’s kind of the stone age, the way people walk through exhibitions. People walk up to a piece of art that’s very tangible, highly emotional, with sounds and smells and all sorts of things – and they just bloody look at their phone! The problem isn’t necessarily the audience, but the way institutions over-explain everything, as though without a long text people just won’t get it. And once we are used to that, that’s how we react: “My God, there was no text! I had to find out everything myself!” I say, yes, art and culture are hard work, not consumerism. You have to give something to get something.

Does activism consume much of your working life?

I’m lucky that art can be seen to be flirting with activism, and maybe there is a fertilising relationship there. But that’s one of the good things about getting older: you know there are things that you aren’t good at. I’m very content just being an artist.

But you run a business to drive social change.

I have a social entrepreneurship project called Little Sun, which makes a small, handheld, portable solar lantern. On one side, it has a photovoltaic panel, on the other an LED. It replaces the kerosene or petroleum lantern that you would have used previously. Obviously, sitting with an open-wick petroleum lantern is both very unhealthy and very bad for the climate. It’s also expensive.

Is the Little Sun a success?

We’ve done studies on the impact of the lamp. Say a family eats dinner, then the girl does the dishes while the boy does his homework. Once the girl is done, she sits down only to find there’s not enough petroleum left for her homework. One study showed that the Little Sun increased the boy’s homework efficiency by 20 per cent, but increased the girl’s efficiency by 80 per cent. So the Little Sun project is incredibly inspiring.

 

“And it will no longer be necessary to ransack the earth…”

Visiting Raw Materials: Plastics at the Nunnery Gallery, Bow Arts, for the Spectator, 1 June 2019

Plastics — even venerable, historically eloquent plastics — hardly draw the eye. As this show’s insightful accompanying publication (a snip at £3) would have it, ‘Plastics have no intrinsic form or texture, thus they are not materials that can be true to themselves.’ They exist within inverted commas. They can be shell-like, horn-like, stony, metallic — they do not really exist on their own behalf.

Mind you, the first vitrine in Raw Materials: Plastics at the Nunnery Gallery in east London contains an object of rare beauty: a small, mottled, crazed, discoloured sphere that looks for all the world like the planet Venus, reduced to handy scale.

It’s a billiard ball, made of the first plastic: cellulose nitrate. Its manufacture had been keenly anticipated. In the US, a $10,000 prize had been offered for anything that could replace ivory in the manufacture of billiard balls (and no wonder: a single tusk yields only three balls).

Under various brand names (Celluloid, Parkesine, Xylonite), and in spite of its tendency to catch fire (colliding snooker balls would occasionally explode), cellulose nitrate saved the elephant. And not just the elephant: plastics pioneer John Wesley Hyatt reckoned that ‘Celluloid [has] given the elephant, the tortoise, and the coral insect a respite in their native haunts; and it will no longer be necessary to ransack the earth in pursuit of substances which are constantly growing scarcer.’

The whole point of plastic is that it has no characteristics of its own, only properties engineered for specific uses. Cheaper than jade. Less brittle than bone. It’s the natural material of the future, always more becoming than being. Hence the names: Xylonite. Bexoid. Halex. Lactoid.

Unable to nail the material in words, one writes instead about its history, sociology, industrial archaeology or ecological impact. On remote islands in the Pacific, thousands of albatross chicks are starving because the parents mistake floating plastic debris for food. Stories like this conjure up a vision of vast islands of discarded plastic coagulating in the Pacific Ocean, but there aren’t any. Instead, plastics eventually fragment into ever smaller pieces that are ingested by marine animals and carried to the sea bottom. In the Mariana Trench, all crustaceans tested had plastics in their guts. So plastics rise and fall through the food chain, creating havoc as they go — a bitter irony for a material that saved the elephant and the turtle, made fresh food conveyable and modern medicine possible, and all for less than 15 per cent of global oil consumption.

What can be gained from looking at the stuff itself? Raw Materials: Plastics transcends the limitations of its material by means of a good story. The first plastics were made in the Lea Valley, not from crude oil, but from plant materials, in a risky, artisanal fashion that bore, for a while, the hallmarks of older crafts including baking, woodcutting and metalwork. Fast-forward 140 years or so and, under the umbrella term ‘bioplastics’, plant-based and biodegradable synthetic products promise to turn the wheel of development full circle, returning plastics to their organic roots. (Designer Peter Marigold’s FORMCard plastic, used here in an excellent school art project, is a starch-based bioplastic made from potato skins.) Then, perhaps, we can break the bind in which we currently find ourselves: the one in which we’re poisoning the planet with plastic in our efforts not to further despoil it.

This is the third and for my money the most ambitious of the gallery’s ongoing series of small, thoughtful exhibitions about the materials, processes and industries that have shaped London’s Lea Valley. (Raw Materials: Wood ran in 2017; Raw Materials: Textiles last year.) The show is more chronicle than catalogue, but the art, scant as it is, punches above its weight.

I was struck, in particular, by France Scott’s ‘PHX [X is for Xylonite]’, a 13-minute collage of photogrammetry, laser scanning and 16mm film. It ought, by all logic, to be a complete mess and I still haven’t been able to work out why it’s so compelling. Is it because digital artefacts, like their plastic forebears, are themselves prisoners of contingency, aping the forms of others while stubbornly refusing to acquire forms of their own?

Venice in interesting times

Visiting May You Live In Interesting Times, the 58th International Art Exhibition at the Venice Biennale, for New Scientist, 16 May 2019

BETWEEN now and 24 November, half a million people will visit May You Live in Interesting Times, the main art exhibition of the Venice Biennale. More than 120 years old, the Biennale is the world’s biggest and most venerable art fair. This year’s offering overflows its historical venue in the gardens on Venice’s eastern edge and sprawls across the city.

In a 300-metre-long former rope-making factory in Venice’s Arsenale, a complex of former shipyards and armouries, it is hard to miss data-verse 1 by Japanese DJ and data artist Ryoji Ikeda: the first instalment of a year-long project to realise an entire universe on a gigantic, wall-sized high-definition screen.

Back in Paris, in a studio that consists of hardly more than a few tables and laptops, Ikeda and his programmers have been peeling open huge data sets, using software they have written themselves. From the flood of numbers issuing from CERN, NASA, the Human Genome Project and other open sources, they have fashioned highly detailed abstract animations.

Ikeda is self-taught. He came to visual art from making animations to accompany DJ sets in the squats, clubs and underground parties of Kyoto, Japan. While his own musical taste was eclectic in the extreme, “from classical to voodoo”, Ikeda was drawn to house and dub: forms in which he says “the sound system is the real subject, not the music being played”.

His own “music” reduces sound to sine waves and impulses – and the animations to accompany his sets are equally minimal. “If the sine wave is the simplest expression of sound, what’s the simplest expression of light? For the scientist, that’s a complicated question, but for the artist, the answer is simple: it’s the pixel,” he says.

Ikeda’s project to reduce the world to its essentials continues: “I wondered what would happen if matter were reduced the same way.” Now Ikeda has turned himself into one of art’s curious beasts, the pure “data artist”.

Each of data-verse 1‘s 15-minute-long abstract “dances” explores the universe at a different scale, from the way proteins fold to the pattern of ripples in the cosmic background radiation. However, Ikeda’s aim is not to illustrate or visualise the universe, but to convey the sheer quantity of data we are now gathering in our effort to understand the world.

In the Arsenale, there are glimpses of this new nature. The Milky Way, reduced to wheeling labels. The human body, taken apart and presented as a sequence of what look like archaeological finds. A brain, colour-coded, turned over and over, as if for the inspection of a hyperactive child. A furious blizzard of solar images. And other less-easily identified sequences, where the information has peeled away entirely from the thing it represents, and takes on a life of its own: red pixels move upstream through flowing numbers like so many salmon.

Ikeda differs from his fellow data artists. While a generation has embraced and made art from “big data” – the kind of dynamic information flow that derives from recording a constantly changing world – Ikeda remains wedded to an earlier, more philosophical definition of data as the record of observed facts. Chaos and complexity for their own sake do not interest him. “I never use dynamic data in my work,” he says.

He did try, once. In 2014, he won a residency at the Large Hadron Collider at CERN, Switzerland. But he found the data overwhelming. “They have supercomputers and one experiment takes two years to analyse and compute,” he says, “and still it’s not really enough. They proposed I use this dynamic data, but how could one single artist handle this? We talk of ‘big data’ but no one imagines really how big it is.”

So Ikeda’s data-verse 1 project, which will take a year and two more productions to reach fruition, is founded on that most old-fashioned of ideas, a record of objective truth. It is neither easy nor cheap to realise, and is being supported by watch-makers Audemars Piguet, an increasingly powerful patron of artists who operate on the boundaries between art and science.

Last year, the firm helped Brighton-based art duo Semiconductor realise their CERN-inspired kinetic sculpture HALO. Before that, it invited lidar artist Quayola to map the Swiss valley where it has its factory.

While Audemars Piguet has an interest in art that pushes technological boundaries, Ikeda fights shy of talk of technology, or even physics. He is interested in the truth bound up in numbers themselves. In an interview with Japanese art critic Akira Asada in 2009, he remarked: “I cannot help but wonder if there are any artists today that give real consideration to beauty. To me, it is mathematicians, not artists, who epitomise that kind of individual. There is such a freeness to their thinking that it is almost embarrassing to me.”

Other highlights at the Arsenale include Dominique Gonzalez-Foerster’s Endodrome, (above) a purely virtual work, accessed through a HTC Vive Pro headset. The artist envisioned it “as a kind of organic and mental space, a slightly altered state of consciousness”. Manifesting at first as a sort of hyper-intuitive painting app, in which you use your own outpoured breath as a brush, Endodrome’s imagery becomes ever more precise and surreal. In a show that bristles with anxiety, Gonzalez-Foerster offers the festival-goer an oasis of creative contemplation.

Also at the Arsenale, and fresh from her show Power Plants at London’s Serpentine Gallery, the German artist Hito Steyerl presents This Is the Future, (above) a lush, AI-generated garden of the future, all the more tantalising for the fact that you’ll probably die there. Indeed, this being the future, you’re sure to die there. Steyerl mixes up time and risk, hope and fear, in a wonderfully sly send-up of professional future-gazing.

The Giardini, along the city’s eastern edge, are the traditional site of La Biennale Art Exhibitions since they began in 1895. They’re where you’ll find the national pavilions. Hungary possesses one of the 29 permanent structures here, and this year it’s full of imaginary cameras. They’re the work of cartoonist-turned media artist Tamás Waliczky. Some of his Imaginary Cameras and Other Optical Devices (above) are based on real cameras, others on long-forgotten 19th-century machines; still others are entirely fictional (not to mention impossible). Can you tell the difference? In any event, this understated show does a fine job of reminding us that we see the world in many, highly selective ways.

There’s quite as much activity outside the official venues of the Biennale as within them. At the Ca’ Rezzonico palazzo until 6 July, you have a chance to save an internationally celebrated artist from drowning (or not- it’s really up to you). A meticulously rendered volumetric avatar of Marina Abramović beckons from within a glass tank that is slowly filling with water, in a bid to draw attention to rising sea levels in a city which is famously sinking. Don’t knock Rising (above) till you’ve tried it: this ludicrous-sounding jape proved oddly moving.

Back at the Arsenale, Ed Atkins reprises his installation Olde Food, (above) which had its UK outing at London’s Cabinet gallery last year. Atkins has spent much of his career exploring what roboticist Masahiro Mori’s famously dubbed the “uncanny valley” — the gap that is supposed to separate real people from their human-like creations. Mori’s assumption was that the closer our inventions came to resembling us, the creepier they would become.

Using commercially purchased avatars which he animates using facial recognition software, Atkins has created his share of creepy art zombies. In Olde Food, though, he introduces a new element: an almost unbearably intense compassion.

Atkins has created a world populated by uncanny digital avatars who (when they’re not falling from the sky into sandwiches — you’ll have to trust me when I say this does make a sort of sense) quite clearly yearn for the impress of genuine humanity. These near-people pray. They play piano (or try to). They weep. They’re ugly. They’re uncoordinated. They’re quite hopeless, really. I do wish I could have done something for them.

In the realm of mind games

By the end of the show, I was left less impressed by artificial intelligence and more depressed that it had reduced my human worth to base matter. Had it, though? Or had it simply made me aware of how much I wanted to be base matter, shaped into being by something greater than myself? I was reminded of something that Benjamin Bratton, author of the cyber-bible The Stack, said in a recent lecture: “We seem only to be able to approach AI theologically.”

Visiting AI: More Than Human at London’s Barbican Centre for the Financial Times, 15 May 2019.

“Bloody useless at objects. Bloody brilliant at space”

Playing Lunatick by Antony Gormley and Priyamvada Natarajan for New Scientist, 27 March 2019

VISIT The Store X, a venue for art and design in London’s West End, and you are in for quite a journey. Wearing an HTC Vive headset, you are given an island to explore in Lunatick, a glossy, game-like virtual-reality experience that starts at Kiribati in Micronesia. For a while, you have the run of the place by means of hand controllers, although producers Acute Art plans to use EEG to let you control it with your thoughts.

Don’t get too comfortable. Wandering past a stone platform triggers the space elevator. It lifts you gently off your feet, then propels you through the stratosphere. This long, beautiful and increasingly uncanny transit carries you into the void between the moon and Earth.

Take a breath. Look around you. The geometrical relationship between the sun, Earth and its moon unwinds around you as time skews and the moon swells. Before you know it, you are skating around lunar crater rims, plummeting into craters, flying high, until, losing control again, you are flung into the sun.

Lunatick is the first joint work by British artist Antony Gormley and astrophysicist Priyamvada Natarajan from Yale University. Natarajan visualises the accretion history of black holes, and maps the granularity of dark matter by studying the way it bends light – a phenomenon called gravitational lensing. But she couldn’t resist the idea of giving space a sensual dimension by making the vastness and loneliness of the cosmos tangible.

Artist and scientist bonded over their early love of science fiction. H. G. Wells’s 1901 novel The First Men in the Moonwas Natarajan’s contribution: a fictional journey powered by the mysterious gravity-less mineral cavorite. Gormley, in his turn, recalled C. S. Lewis’s space trilogy that began with Out of the Silent Planet, in which a man travels the solar system pinned in a coffin.

Both influences emerge clearly enough in Lunatick, but the real star of the show isn’t fictional: it is the flyable lunar terrain wrestled into shape by Rodrigo Marques, Acute Art’s chief technology officer, from data sent back by NASA’s Lunar Reconnaissance Orbiter. “There’s something both moving and funny about skating over the surface of the moon,” says Gormley. “I’ve got very fond of skiing along the ridges then down into the crater bottoms.”

Gormley’s art is popular globally, not least because people find it easy to grasp. Never mind the cosmological and philosophical dimensions: what strikes the viewer is how he renders, in solid matter, the building blocks of our lives.

Gormley has been making sculptural art out of wireframes and voxels (three-dimensional pixels), even as architects and games designers having been moving away from model-making into a purely virtual 3D design space. “Until recently, I had no idea what a voxel was,” says Gormley, who has spent more than five years making oddly expressive low-resolution sculptures assembled from cubes and cuboids. His wireframe experiments (assembled from real wires and rods) are older still, dating back to the late 1990s.

Why has Gormley chosen to enter the virtual realm now? First, Lunatick was a chance to explore a medium that, he says, is “bloody useless at objects and bloody brilliant at space”. Objects, ultimately, are bodies: VR is hobbled because it can’t convey their mass and tactility. But space is different. We perceive space primarily through seeing, which means VR can convey scale and immensity to a sublime degree.

But why should an artist best known for exploring the sculptural possibilities of the human body (particularly his own) be keen on disembodied space? The image of body-as-spaceship crops up intermittently in Gormley’s work, but rarely so urgently. He says he is haunted by an image of long-haul flight, where the shutters are down and everyone is watching movies: virtual versions of human life.

“I want this piece to say to people, ‘Break out!’,” he says. “Of course we get very obsessed with human matters. But there are bigger affairs out there. Recognise your cosmic identity!”

Slightly fleshy, slightly scabby, cast adrift

Exploring Matthew Day Jackson’s show Pathetic Fallacy at Hauser & Wirth Somerset for the Times Literary Supplement, 26 February 2019

The New York-based artist Matthew Day Jackson takes mixed media seriously. Behind the techniques and materials, the molten lead and the axe handles, the T-shirts and laser-etched Formica, Jackson’s aesthetic sees the world not as a continuum but as a mass of odd juxtapositions. Since his first big solo show in 2004, he has intertwined the grotesque and the beautiful. Every ten years, he paints a picture of himself as a corpse, but the majority of his work is mischievous, holding the autobiographical and the cerebral in an uneasy balance.

Hauser and Wirth, an international gallery with a strong educational remit, regularly brings its spikier artists to its property in Bruton, Somerset, to stay, work and reflect. The residencies come without strings, there are no prescribed outcomes, and one suspects there’s a certain mischief in who gets chosen. First to arrive, in 2014, was the (intermittently scary) video artist Pipilotti Rist. Seduced by her surroundings, she came up with sensuously observed close-ups of bodies and leaves in intimate proximity. Nothing wrong with that, of course. But it’s a risk for the gallery, and a challenge for the artists who stay here, that the landscape round about is so ridiculously seductive.

Showing next door to Matthew Day Jackson, Eve, an exhibition of paintings by the Somerset-based artist Catherine Goodman, is unashamedly paradisal. Even its edge of Freudian melancholy proves heartwarming in the end.

What on earth will Jackson, a cerebral city-dwelling proponent of an aesthetic he dubs the “horriful”, do with all this serried loveliness? He says that at first he found the landscape hard to read. “It’s more like urban space”, he says. “Everywhere you look, you can trace how humans have engaged with this place.” He can’t get over the time-worn depth of the lanes here. There’s no equivalent back home: “Maybe in Oregon and Wyoming, you can find tracks still rutted by wagon wheels”.

Predictably, for an artist who’s spent his career mapping the failures of American utopianism, Jackson has responded to the beauty around him by mourning its passing. His Solipsist collage-paintings of silk-screened Formica zoom out to encompass large swathes of the planet. Seen from various orbital viewpoints (the images are based on photographs taken by NASA astronauts) four elements emerge. Mine workings strip the Earth back to, well, its earth. The hopelessly polluted Ganges and the virtually vanished Ural Sea stand for water. Smoke plumes from forest fires give a shape to air. Yellowstone Lake inhabits a caldera that, if it erupted, would consume most life on Earth.

Each landscape, weirdly colourized (“Formica limits your colour palette”), laser etched with precise contours and subtle, uninterpretable boundary lines, resembles a computer-readable map. “Over” it (or, to be literal about this, embedded in it) is the flattened image of a satellite, made of cast lead.

The fact that the satellite observing the view is itself melted into the picture suggests a colossal foreshortening. There’s something suggestive of Jean Dubuffet, too, in the way the texture of the satellite is employed to convey a radical flatness. There’s no shade here, no occlusion, no hint of curvature. Human activity and human destiny are being measured and metricized to the point where even the planet has nowhere to turn.

Jackson’s flower paintings in the next room continue the theme: vases of hallucinatory Formica and fabric blooms, backlit by unearthly aurorae that may reference the tie-dye fad of the early 1970s but are more likely – given the way this show is going – something ghastly to do with nuclear testing.

The paintings work with the Astroturf floor and Jackson’s experimental, sculptural furniture to explore the idea that we only ever see things through their use. This isn’t a human foible: living things generally only sense what is relevant to their survival. So if Jackson is holding humanity to account here, it is a gentle and considered judgement. “What we most want is to feel that we exist”, he says, as we contemplate vanished seas and shredded mountain ranges. “We want not be lonely. Hence the appeal of metrics: they give us a sense of accomplishment.”

It can be a nuisance, having the artist around when you’re viewing a show. I was initially thinking about our greed and rapacity, and now, looking at these spoiled and garishly mapped earths, all I can see is our pathos: how we are polishing our rock down to the granite, just so we can glimpse ourselves in it.

Pathetic Fallacy is a well-chosen title for this show. John Ruskin coined the phrase to have a dig at the emotional falsity of poets who made clouds weep and trees groan. Jackson’s show is more in the spirit of Wordsworth’s defence of the practice, arguing that “objects . . . derive their influence not from properties inherent in them . . . but from such as are bestowed upon them by the minds of those who are conversant with or affected by these objects”.

In other words, we impose ourselves on the world because we feel we are the only meaning makers. On the way out, I pass more pictures: flattened lead satellites, cast in moulds made of corrugated cardboard, twine, sawdust, glue. This close, they appear slightly fleshy, slightly scabby, cast adrift, and travelling out into space.

Tonight the World

Visiting Tonight the World, Daria Martin’s new show at the Barbican, for the Financial Times, 5 February 2019

The terrible thing about dreams is that you cannot look away. You cannot peek around corners. You cannot glance at your feet. You must see – and cannot unsee – what you are given.

And while video games sometimes offer you the opportunity to shift from first to third person, so that you can see your avatar operating in the game, for the most part you’re suspended, disembodied, in a dream.

Daria Martin’s gallery-sized installation Tonight the World, now occupying the Barbican Centre’s Curve Gallery, begins with a video game. In an eleven-minute screen capture, we explore a monochrome, abstracted version of the house in Czechoslovakia where Martin’s grandmother, Susi Stiassni, spent her early childhood.

The house is real enough: a modernist redoubt just outside Brno, built by architect Ernst Wiesner in the late 1920s for Susi’s father, the Jewish textile manufacturer Alfred Stiassni. Later, the house was home to a string of Czech presidents. House guests included Fidel Castro.

Students from Oxford University and from the University of Masaryk in Brno recorded the building using photogrammetry, and it’s their data that powers Martin’s videogame. They scanned most of the rooms, and more or less all the furniture, but none of the objects. This is one reason why the gameable villa Stiassni is furnished but unadorned. Blank white canvases in white frames hang from white walls. The shelves lining the library are empty. The only objects here are game objects, seeded into the scene so as to reveal, on a click, glimpses of the house’s history.

At this point, Martin’s show could go either way. We could be in for a rather stilted, tech-heavy exploration of her family’s fraught history. (Susi Stiassni fled Nazi occupation with her family in 1938, first to London, then to Brazil, finally to California.) But the way gallery has been decked out suggests (rightly) that a warmer, more intimate, ultimately more disturbing game is afoot. Past the first screen, fellow gallery-goers bleed in and out of view round a series of curved wooden walls painted a warm terracotta. Is the colour a reference to interwar architecture? All I can think of is the porn set in David Cronenberg’s existentialist shocker Videodrome. There is something distinctly fleshy going on.

Tonight the World turns out not to be a show about Susi Stiassni’s life; not, anyway, about those parts of her life that anyone else could have witnessed, or participated in. It’s about Susi’s dreams, which she recorded year after year in a colossal typewritten diary. We get to see some of her work, hung up like a vast storyboard, through a gap in one of the walls.

This diary provides the storyline for five short films, looping on a huge curved screen at the farthest end of the gallery. In each dream, four actresses play Susi at different life stages; chief among them, and the eldest, is Hayley Carmichael. She was the eponymous Hunger Artist in Martin’s 2017 film, which won the Film London Jerwood prize last year. Carmichael is extraordinary: she serves up pathos by the yard just by standing still and staring.

In one film Susi confronts an army patrol; in another, she discovers a proletarian man living in a wall space behind her living room. The page from Susi’s diary which describe these dreams are pinned on a wall nearby. In one, Susi writes: “I call in that we are the Korean army… Actually the Korean army isn’t us but they are just outside the house.”

We’re not just talking about disembodiment here. We’re talking about the dislocation of the survivor; about the strategies of identification and alienation by which a human psyche eludes mortal threat. These dreams are about being several people at once, in the hope that at least one of you will survive.

An episodic film about dislocation with four actresses playing the same person: what, one is tempted to ask, could possibly go right? But Martin maintains control — indeed, makes the dreams both comprehensible and gripping, in a way that other people’s dreams almost never are — by keeping an iron grip on the viewpoint. You never feel as if you’re looking through a camera; you’re always looking through the eyes of one or another Susi. Now and again, points of view are established before the characters doing the looking step into the appropriate part of the frame. It’s a neat trick and one that’s quite difficult to pull off: the same bit of film grammer Andrei Tarkovksy played with in Mirror.

Given her previous work — a Kafka adaptation, films about mirror synaesthesia, intimacy and robots — it’s hardly a surprise to find Daria Martin’s current show steeped in the uncanny. But how well does it all hang together?

Better in the viewing than in the telling, I suspect. Words imply chronology, and that’s very much not what this show is about. Susi’s dreams were shaped by her history, but they don’t depict that history. The men coming in through the windows of her half-forgotten family home are as likely to be Koreans as Nazis. They could be tourists, or players of a video game, or a Californian child (Daria Martin herself, perhaps) dressed as a cowboy. All times are one; all fears are universal.

Tonight the World is certainly an “immersive” experience, for what that word is worth. A dark, echoey interior, objects seen through chinks, and single pages that stand for whole manuscripts: there’s a little bit of Punchdrunk theatre company’s Tunnel 228 about the enterprise. There’s also an attempt, which doesn’t quite pay off, to have a piece of imagery from Martin’s video game bleed into the gallery space. This invasion comes across as more of a joke than a psychic rupture: a measure of how monomaniacally exact you have to be, if you want to conjure fantasy in real space.

What of that video game? Though it’s a chilly, jerky and rather daunting way to open the show, the mathematically rendered villa Stiassi — stripped of objects, provenance and affect — sets the right tone, I think, particularly in relation to the very next object Martin offers us: a chink in a wall, housing a small family photograph of the villa as it really was: a home filled with lace and rugs and books and bric-a-brac and life. The world is empty, until we ourselves enchant it — with monsters, or delights.