{"id":2754,"date":"2019-08-05T11:05:22","date_gmt":"2019-08-05T11:05:22","guid":{"rendered":"http:\/\/simonings.com\/?p=2754"},"modified":"2019-08-05T11:05:22","modified_gmt":"2019-08-05T11:05:22","slug":"attack-of-the-vocaloids","status":"publish","type":"post","link":"http:\/\/www.simonings.net\/?p=2754","title":{"rendered":"Attack of the Vocaloids"},"content":{"rendered":"<p><img decoding=\"async\" class=\"alignnone size-full wp-image-2755\" src=\"http:\/\/www.simonings.net\/wp-content\/uploads\/2019\/08\/NEW-Music.jpg\" alt=\"\" width=\"820\" height=\"550\" srcset=\"http:\/\/www.simonings.net\/wp-content\/uploads\/2019\/08\/NEW-Music.jpg 820w, http:\/\/www.simonings.net\/wp-content\/uploads\/2019\/08\/NEW-Music-300x201.jpg 300w, http:\/\/www.simonings.net\/wp-content\/uploads\/2019\/08\/NEW-Music-768x515.jpg 768w, http:\/\/www.simonings.net\/wp-content\/uploads\/2019\/08\/NEW-Music-447x300.jpg 447w\" sizes=\"(max-width: 820px) 100vw, 820px\" \/><\/p>\n<p><a href=\"https:\/\/www.spectator.co.uk\/2019\/08\/can-computers-compose\/\">Marrying music and mathematics for <em>The Spectator<\/em>,\u00a03 August 2019<\/a><\/p>\n<p>In 1871, the polymath and computer pioneer Charles Babbage died at his home in Marylebone. The encyclopaedias have it that a urinary tract infection got him. In truth, his final hours were spent in an agony brought on by the performances of itinerant hurdy-gurdy players parked underneath his window.<\/p>\n<p>I know how he felt. My flat, too, is drowning in something not quite like music. While my teenage daughter mixes beats using programs like GarageBand and Logic Pro, her younger brother is bopping through Helix Crush and My Singing Monsters \u2014 apps that treat composition itself as a kind of e-sport.<\/p>\n<p>It was ever thus: or was once 18th-century Swiss watchmakers twigged that musical snuff-boxes might make them a few bob. And as each new mechanical innovation has emerged to \u2018transform\u2019 popular music, so the proponents of earlier technology have gnashed their teeth. This affords the rest of us a frisson of Schadenfreude.<\/p>\n<p>\u2018We were musicians using computers,\u2019 complained Pete Waterman, of the synthpop hit factory Stock Aitken Waterman in 2008, 20 years past his heyday. \u2018Now it\u2019s the whole story. It\u2019s made people lazy. Technology has killed our industry.\u2019 He was wrong, of course. Music and mechanics go together like beans on toast, the consequence of a closer-than-comfortable relation between music and mathematics. Today, a new, much more interesting kind of machine music is emerging to shape my children\u2019s musical world, driven by non-linear algebra, statistics and generative adversarial networks \u2014 that slew of complex and specific mathematical tools we lump together under the modish (and inaccurate) label \u2018artificial intelligence\u2019.<\/p>\n<p>Some now worry that artificially intelligent music-makers will take even more agency away from human players and listeners. I reckon they won\u2019t, but I realise the burden of proof lies with me. Computers can already come up with pretty convincing melodies. Soon, argues venture capitalist Vinod Khosla, they will be analysing your brain, figuring out your harmonic likes and rhythmic dislikes, and composing songs made-to-measure. There are enough companies attempting to crack it; Popgun, Amper Music, Aiva, WaveAI, Amadeus Code, Humtap, HumOn, AI Music are all closing in on the composer-less composition.<\/p>\n<p>The fear of tech taking over isn\u2019t new. The Musicians\u2019 Union tried to ban synths in the 1980s, anxious that string players would be put out of work. The big disruption came with the arrival of Kyoko Date. Released in 1996, she was the first seriously publicised attempt at a virtual pop idol. Humans still had to provide Date with her singing and speaking voice. But by 2004 Vocaloid software \u2014 developed by Kenmochi Hideki at the Pompeu Fabra University in Barcelona \u2014 enabled users to synthesise \u2018singing\u2019 by typing in lyrics and a melody. In 2016 Hatsune Miku, a Vocaloid-powered 16-year-old artificial girl with long, turquoise twintails, went, via hologram, on her first North American tour. It was a sell-out. Returning to her native Japan, she modelled Givenchy dresses for\u00a0<em>Vogue<\/em>.<\/p>\n<p>What kind of music were these idoru performing? Nothing good. While every other component of the music industry was galloping ahead into a brave new virtualised future \u2014 and into the arms of games-industry tech \u2014 the music itself seemed stuck in the early 1980s which, significantly, was when music synthesizer builder Dave Smith had first come up with MIDI.<\/p>\n<div class=\"middle-promo\">\n<div class=\"sub-content-promo big-bottom\">\n<div id=\"div-gpt-ad-Mag-MidArticleBanMPU\" data-google-query-id=\"COnr_qDJ6-MCFQHB5godcxYLNA\"><\/div>\n<\/div>\n<\/div>\n<p>MIDI is a way to represent musical notes in a form a computer can understand. MIDI is the reason discrete notes that fit in a grid dominate our contemporary musical experience. That maddenning clockwork-regular beat that all new music obeys is a MIDI artefact: the software becomes unwieldy and glitch-prone if you dare vary the tempo of your project. MIDI is a prime example (and, for that reason, made much of by internet pioneer-turned-apostate Jaron Lanier) of how a computer can take a good idea and throw it back at you as a set of unbreakable commandments.<\/p>\n<p>For all their advances, the powerful software engines wielded by the entertainment industry were, as recently as 2016, hardly more than mechanical players of musical dice games of the sort popular throughout western Europe in the 18th century.<\/p>\n<p>The original games used dice randomly to generate music from precomposed elements. They came with wonderful titles, too \u2014 witness C.P.E. Bach\u2019s\u00a0<em>A method for making six bars of double counterpoint at the octave without knowing the rules<\/em>\u00a0(1758). One 1792 game produced by Mozart\u2019s publisher Nikolaus Simrock in Berlin (it may have been Mozart\u2019s work, but we\u2019re not sure) used dice rolls randomly to select beats, producing a potential 46 quadrillion waltzes.<\/p>\n<p>All these games relied on that unassailable, but frequently disregarded truth, that all music is algorithmic. If music is recognisable as music, then it exhibits a small number of formal structures and aspects that appear in every culture \u2014 repetition, expansion, hierarchical nesting, the production of self-similar relations. It\u2019s as Igor Stravinsky said: \u2018Musical form is close to mathematics \u2014 not perhaps to mathematics itself, but certainly to something like mathematical thinking and relationship.\u2019<\/p>\n<p>As both a musician and a mathematician, Marcus du Sautoy, whose book\u00a0<em>The Creativity Code<\/em>\u00a0was published this year, stands to lose a lot if a new breed of \u2018artificially intelligent\u2019 machines live up to their name and start doing his mathematical and musical thinking for him. But the reality of artificial creativity, he has found, is rather more nuanced.<\/p>\n<p>One project that especially engages du Sautoy\u2019s interest is Continuator by Fran\u00e7ois Pachet, a composer, computer scientist and, as of 2017, director of the Spotify Creator Technology Research Lab. Continuator is a musical instrument that learns and interactively plays with musicians in real time. Du Sautoy has seen the system in action: \u2018One musician said, I recognise that world, that is my world, but the machine\u2019s doing things that I\u2019ve never done before and I never realised were part of my sound world until now.\u2019<\/p>\n<p>The ability of machine intelligences to reveal what we didn\u2019t know we knew is one of the strangest and most exciting developments du Sautoy detects in AI. \u2018I compare it to crouching in the corner of a room because that\u2019s where the light is,\u2019 he explains. \u2018That\u2019s where we are on our own. But the room we inhabit is huge, and AI might actually help to illuminate parts of it that haven\u2019t been explored before.\u2019<\/p>\n<p>Du Sautoy dismisses the idea that this new kind of collaborative music will be \u2018mechanical\u2019. Behaving mechanically, he points out, isn\u2019t the exclusive preserve of machines. \u2018People start behaving like machines when they get stuck in particular ways of doing things. My hope is that the AI might actually stop us behaving like machines, by showing us new areas to explore.\u2019<\/p>\n<p>Du Sautoy is further encouraged by how those much-hyped \u2018AIs\u2019 actually work. And let\u2019s be clear: they do not expand our horizons by thinking better than we do. Nor, in fact, do they think at all. They churn.<\/p>\n<p>\u2018One of the troubles with machine-learning is that you need huge swaths of data,\u2019 he explains. \u2018Machine image recognition is hugely impressive, because there are a lot of images on the internet to learn from. The digital environment is full of cats; consequently, machines have got really good at spotting cats. So one thing which might protect great art is the paucity of data. Thanks to his interminable chorales, Bach provides a toe-hold for machine imitators. But there may simply not be enough Bartok or Brahms or Beethoven for them to learn on.\u2019<\/p>\n<p>There is, of course, the possibility that one day the machines will start learning from each other. Channelling Marshall McLuhan, the curator Hans Ulrich Obrist has argued that art is an early-warning system for the moment true machine consciousness arises (if it ever does arise).<\/p>\n<p>Du Sautoy agrees. \u2018I think it will be in the world of art, rather than in the world of technology, that we\u2019ll see machines first express themselves in a way that is original and interesting,\u2019 he says. \u2018When a machine acquires an internal world, it\u2019ll have something to say for itself. Then music is going to be a very important way for us to understand what\u2019s going on in there.\u2019<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Marrying music and mathematics for The Spectator,\u00a03 August 2019 In 1871, the polymath and computer pioneer Charles Babbage died at his home in Marylebone. The encyclopaedias have it that a urinary tract infection got him. In truth, his final hours &hellip; <a href=\"http:\/\/www.simonings.net\/?p=2754\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[621,78],"tags":[392,647,716,223,715,496],"class_list":["post-2754","post","type-post","status-publish","format-standard","hentry","category-music","category-reviews-and-opinion","tag-ai","tag-artificial-intelligence","tag-jazz","tag-mathematics","tag-midi","tag-spectator"],"_links":{"self":[{"href":"http:\/\/www.simonings.net\/index.php?rest_route=\/wp\/v2\/posts\/2754","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.simonings.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.simonings.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.simonings.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.simonings.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2754"}],"version-history":[{"count":1,"href":"http:\/\/www.simonings.net\/index.php?rest_route=\/wp\/v2\/posts\/2754\/revisions"}],"predecessor-version":[{"id":2756,"href":"http:\/\/www.simonings.net\/index.php?rest_route=\/wp\/v2\/posts\/2754\/revisions\/2756"}],"wp:attachment":[{"href":"http:\/\/www.simonings.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2754"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.simonings.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2754"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.simonings.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2754"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}