Happy to be involved in this fascinating New Scientist article on MIDI 2.0’s potential.
Happy to be involved in this fascinating New Scientist article on MIDI 2.0’s potential.
The genome is formed by a long sequence of 4 types of nucleotides: adenine (A), guanine (G), cytosine (c), and uracil (U). This sequence is used to synthesise specific proteins such as the “Spike protein”, which gives COVID-19 its crown-like appearance. A mutation happens when a nucleotide is changed, inserted or deleted in the sequence.
The current sonification methodology associates notes’ timing to the position of the mutation within the DNA and pitch to the type of nucleotide mutation (e.g. adenine to guanine). This means that the position of the mutation results in different rhythmic placement, and the type of nucleotide mutation results in different melodies, giving each genome its own musical signature. Furthemore, repeating musical patterns mean that a mutation has persisted over time.
Note that although it may seem like the number of mutations is large, COVID-19 is actually considered a relatively stable virus.
The project uses the database of the National Center for Biotechnology Information (NCBI), which is being updated every day with new COVID-19 sequences coming from research centres across the world. The website is available here: NCBI Covid-19 page
The data is parsed and downloaded using the covid-genome-matlab-parser.
The first step is to obtain the mutations are obtained from the NCBI dataset:
The second step is to translate the mutations into music. Below are two examples of how to do this.
Below are the details of the procedure to generate the sound from the mutations:
-sign indicates an insertion or a deletion; all other types of mutations are ignored.
|Old basis||New basis||Midi note||Note|
Here, over 500 genome sequences are translated into two octaves of a B minor scale. The translations are selected by mapping the most common mutations types (‘note deltas’ above) into the most common diatonic scale degrees on a sample of Western Art Music (see Huron 2008). This results in familiar melodic motifs for the most commonly retained mutations and pandiatonic blurring for the more novel mutations. At the tempo selected this results in a surprisingly engaging piece of music lasting over 42 minutes, where the language of mutation is translated into the language motivic transformation, a deeper sonificaiton beyond arbitrary chormatic or ‘safe’ scale choices.This is performable by choir and organ nut its here rendered with MIDI instrumentations in Ableton Live with UAD and Native Instrument plugins.
Please keep the coding convention.
We are particularly interested in collaborations with Molecular Biologists. Contact enzodesena AT gmail DOT com if interested.
We are both with the Department of Music and Media, University of Surrey, Guildford, UK University of Surrey DMM Website.
We would like to thank Gemma Bruno (Telethon Institute of Genetics and Medicine, Italy) and Niki Loverdu (KU Leuven, Belgium) for the useful discussions on topic. Also, we would like to thank our friends and colleagues for the useful feedback on the presentation.
The project also uses internally:
 Durbin, R., Eddy, S., Krogh, A., and Mitchison, G. (1998). Biological Sequence Analysis (Cambridge University Press).
 H. Hacıhabiboğlu, E. De Sena, Z. Cvetković, J.D. Johnston and J. O. Smith III, “Perceptual Spatial Audio Recording, Simulation, and Rendering,” IEEE Signal Processing Magazine vol. 34, no. 3, pp. 36-54, May 2017.
 E. De Sena, Z. Cvetković, H. Hacıhabiboğlu, M. Moonen, and T. van Waterschoot, “Localization Uncertainty in Time-Amplitude Stereophonic Reproduction,” IEEE/ACM Trans. Audio, Speech and Language Process. (in press).
 E. De Sena, H. Hacıhabiboğlu, and Z. Cvetković, “Analysis and Design of Multichannel Systems for Perceptual Sound Field Reconstruction,” IEEE Trans. on Audio, Speech and Language Process., vol. 21 , no. 8, pp 1653-1665, Aug. 2013.
 E. De Sena, H. Hacıhabiboğlu, Z. Cvetković, and J. O. Smith III “Efficient Synthesis of Room Acoustics via Scattering Delay Networks,” IEEE/ACM Trans. Audio, Speech and Language Process., vol. 23, no. 9, pp 1478 – 1492, Sept. 2015.
 Huron, D. (2008) Sweet Anticipation: Music and the Psychology of Expectation. MIT Press
 https://www.nytimes.com/interactive/2020/04/03/science/coronavirus-genome-bad-news-wrapped-in-protein.html (Accessed on: 8/3/2020)
This project is licensed under the GNU License. The code will be made available soon. In the meantime, contact enzodesena AT gmail DOT com if interested.
You use the code, data and findings here at your own risk. See the LICENSE.md file for details.
A pleasure to take part in this BBC Scotland documentary on sleep, presented by Ian Hamilton and produced by Laura Kingwell. Ian, who is blind has a particualr interest in sleep disorders and the work of Prof Debra Skene, a key collaborator in Sound Asleep. First broadcast 29/3/20 on Good Morning Scotland on BBC Radio Scotland.
A cute little Arvo Part machine, for creating tintinnabuli voices (Demo, background, tutorial and free download below)
Download here, free to use, but please credit Milton Mermikides (miltonline.com), and let me know here about any published or exciting work you are doing with it 🙂
British Psychosocial Oncology Conference Feb 27-28 2020
Accessing patients’ perspectives of acute lymphoblastic leukaemia (ALL) through the arts
Hosted by Dr Alex and Dr Milton Mermikides
Milton is Reader in Music at University of Surrey. Alex is Doctoral Programme Leader at the Guildhall School of Music & Drama
Bloodlines is dance-lecture performance depicting a patient’s experiences of ALL and its treatment through stem cell transplant. Here, it’s makers, Milton (a composer and ALL survivor) and Alex
(theatre-maker and his sibling bone marrow donor) share extracts of the work and reveal some of techniques they used to turn their personal experience, and their medical data, into an artwork.
Bloodlines was first performed at the Science Museum, London and has since been seen by medical students and professionals, patient groups and general audiences. It has featured in the Times Higher Education and on Midweek (BBC Radio 4). Its development was funded by the Arts and Humanities Research Council.
Lecture and Workshop for Ableton at Glasgow’s Question Session in the beautiful Lighthouse venue. Make music from anything.
Feb 8 2020 Free Entry – For all Info: https://www.questionsession.co.uk
For centuries. composers have been reaching out beyond the musical world into nature, science and other disciplines for inspiration. Pythagoras conceived of a harmony created by the orbiting planets (The Music of the Spheres), Newton attached 7 colours of the rainbow to the notes of a scale, composers like J.S. Bach encoded their names into musical motifs, and Villa Lobos wrote melodies tracing the New York skyline. This workshop enables musicians of all styles to tap into this vast and profound craft of ‘data-music’. This long-established but niche craft has now been given a profound renaissance with contemporary technology: Ableton Live with bespoke Max for Live devices (available to participants in the workshop and distributed online) allow a world of real-time music creativity beyond the limits of human imagination. We will demonstrate such techniques as the automatic translation of your name into melodies, works of art into rhythms, spider webs into virtual harps, live weather reports into MIDI controls and countless other possible translations. This approach provides a uniqueness and profound meaning to your music-making whatever your stylistic interest, allowing you to tap into the infinite and uncharted universe of musical creativity.
Pleasing to see my ‘postcard’ analyses of Arvo Pärt’s Beatitudes and Spiegel Im Spiegel published in Andrew Shenton’s fine new work Arvo Pärt’s Resonant Texts (Cambridge University Press).
Here they are without explanation.
I’ll be keynote speaker-erm-ing at the Royal Asociety of Medicine on Tuesday 4th September at the Royal Society of Medicine, London.
More details here and at the link above:
Join us as we explore the links between sleep, sleep disorders and all forms of art, literature, and music including modern digital media.
We will look at the effect of music in the sleeping brain, the portrayal of sleep and sleep disorders within works of art, the perils and pleasures of sleep apps and their effect on the public perception of sleep and the literature of dreams.
You will learn to:
Sound Asleep was filmed by Jake Davison, Kate Wallace, Josephine Hannon and Megan Brown. They interviewed Professor Morten Kringelbach, a neuroscientist at the University of Oxford, and Professor Milton Mermikides, a composer guitarist and music theorist.
Jake explains: “The film is about the discovery of newly described changes in brain activity during sleep by Professor Kringelbach and his team, and how conversion of these findings to music could provide a useful diagnostic tool and possibly a therapeutic for sleep disorder treatment. We decided to cover this story because, in the age of smartphones, tablets and a 24/7 world, the quality of our sleep is decreasing and its importance is often overlooked. This new model of sleep brain activity developed by Professor Kringelbach and his team, as well as his collaboration with Professor Milton Mermikides to produce musical compositions from this data, will help us understand the mechanism of sleep better and therefore allow us to improve our own sleep. Both the ground-breaking nature of this research and the unorthodox method of utilising music to potentially unlock more discoveries seemed intriguing to us and something that needed to be heard about
The keynote presentation ‘Plucked from Thin Air’ on improvisation and the guitar, was presented as part of the International Guitar Research Centre’s 2019 Conference at the Hong Kong Academy of the Performing Arts on Tuesday 16th July 2019 to an international cohort of guitar scholars and practitioners. Borges, Coltrane and m-finity.
A collaboration with Professor Morten Kringelbach, producing music based on his team’s research into the transitional networks involved during sleep is featured on BBC Radio 4’s weekly science podcase Inside Science and broadcast 28/3/19 at 16:30 and 21:00. Catch up here to listen And here for the wonderful research paper “Discovery of key whole-brain transitions and dynamics during human wakefulness and non-REM sleep” (Nature Comms)
How fast was the petition to revoke Article 50 signed in the 24 hours surrounding Theresa May’s speech on March 20th 2019?
Well if a note was played on the piano every time the petition was signed it would sound (and look) like this.
Ableton Live 10 + Max/MSP + Excel + UAD Apollo + Adam Audio S2V + NI S88 Keyboard with Light Guide + NI Komplete + Lava Lamp
23 February 2019, The Sound Asleep project was presented by Prof Debra Skene at the Designing Time even at the Design Museum, London:
A day of talks and live performances exploring the design of alternative time systems, based on daily bodily rhythms (known as circadian rhythm).
Currently, ‘clock time’ structures and directs human behaviour. But are there alternative time systems that are better for our health, happiness and overall productivity? Rather than being guided by the clock, the installation investigates new time systems and ways of living.
A series of participatory events and activities over the course of the weekend will test and challenge the structures and rhythms of contemporary life. On Saturday evening there will be a public talk by scientists, artists and designers on the design of time and the nature of temporality.
A lovely discussion with BBC Studio Manager (and Radiophonic scholar) Jo Langton and presenter Tom Service on Radio 3’s Hidden Voices series on Music Matters. Kathleen Schlesinger’s The Greek Aulos, Ancient Greek Modes, microtonality, the work of Elsie Hamilton and its legacy today.
Book for the free December 5th 2018 6pm event at the Barbican here:
Hear what the neuroscience of falling asleep sounds like! Join composer and guitarist Milton Mermikides and Oxford Professor Morten Kringelbach – an expert in the neuroscience of pleasure – as they explore the musical qualities of sleep. This exciting dialogue will cover the science of sleep and its parallels with musical composition.
Kringelbach will discuss the neuroscience of music and why it is one of the strongest and most universal sources of human pleasure. Mermikides believes everything we do is music, and that music exists from the galaxies down to subatomic particles.
Together they will look at the neuroscience of human sleep and how harmonic patterns in our sleep cycle can be used to create musical compositions reflecting sleep during both health and disease. You will hear both what good and disrupted sleep patterns sound like. You’ll also find out how our body clock differs from the 24-hour clock and how this impacts our natural sleep cycle.
Kringelbach will present his new research identifying the neural pathways for how we fall asleep. Building on this, Mermikides will present new music he has composed based on Kringelbach’s discoveries. For the first time, you will hear what the neuroscience of falling asleep sounds like.
Sound Asleep is a public lecture open to everyone. It’s part of The Physiological Society’s Sleep and Circadian Rhythms meeting taking place at the Barbican between 5-6 December 2018.
By (heavily belated) popular demand here’s a stab at ‘common-practice’ chord progressions in major and now minor keys!
Really looking forward to being on this fabulous panel at the fabulous QED conference in fabulous Manchester. Panel on 14th October 2018 Time TBC
My deep interest in the fields of (micro/macro) rhythm and data music, came together in the BBC Radio 4 ‘The Rhythm of Life’ 2-episode series presented by Evelyn Glennie. A great pleasure to chat rhythm and music translations with her, among fabulous Bridget Riley prints at the Tate Britain. I appear briefly at the end of Episode 1, but with more to say in Episode 2 The World as an Orchestra.
Listen live on Tuesday 28th 2018 and September 1st 2018 11.30am, or catch up after the first airing here
Here’s some background
Virtuoso percussionist Dame Evelyn Glennie reveals a hidden world of rhythm around us and searches for musical inspiration from some unlikely sources.
As a musician and rhythm obsessive, Evelyn has always beenfascinated by the rhythmic nature of the world around us. She explains that, by learning to focus our attention, we can tap into a complex realm of energy and pattern in our surroundings. Over the course of the programme, Evelyn tunes into everything from the oscillation of a tree in the wind to the polyrhythmic groove of our solar system.
Visiting the Mini plant in Oxford, an enormous factory that beats out a steady meter of 1000 cars a day, Evelyn surveys the endless rows of robotic arms and describes the location as “like being in a massive percussion instrument”. Walking around the factory, Evelyn is desperate to “play the space”. Back in her studio, surrounded by percussion instruments, she does exactly that – hammering out a metallic improvisation inspired by the rhythms of the production line.
Evelyn explains that she has always drawn inspiration from non-musical art forms. At Tate Britain, surrounded by prints by Bridget Riley, Evelyn meets the composer Milton Mermikides who uses digital technology to translate Riley’s famously rhythmic paintings into mesmeric music. Evelyn also performs a percussive piece in response to the looping rhythms of Riley’s work.
Finally, Evelyn gazes up at the buildings that line the Thames with composer Peter Adjaye, whose work is heavily influenced by the rhythm of architecture. Evelyn explains that, like a piece of music, a building is a composition based on structure, ornamentation, repetitive patterns and layer upon layer of rhythm.
Presenter: Evelyn Glennie
Producer: Max O’Brien
A TBI production for BBC Radio 4.
A max/msp/Ableton Live tool I’m building to aid my hidden music projects. So many possibilities, these are literally first-go unpolished demos. Images by Bridget Riley.
Monday: horror. Look up appointments nearest Wednesday Afternoon: Peterborough (London on Friday), next morning managed to get Wednesday AM in London, countersignatory rejected, Thursday AM it’s accepted. Friday PM a text that said (basically) “approved it ill be there in a few days”. Tuesday AM a text in am “It’s coming today”. Tuesday 2-3pm passport arrives (posted through door).
Anonymous 1: Tuesday AM Appointment (Peterborough), Thursday “few days” text, Friday passport arrives (nice).
Good luck, my idiotic friend, you will get it sorted and there are many adventures ahead.