Audification Explained

Audification is an auditory display technique for representing a sequence of data values as sound. By definition, it is described as a "direct translation of a data waveform to the audible domain."[1] Audification interprets a data sequence and usually a time series, as an audio waveform where input data are mapped to sound pressure levels. Various signal processing techniques are used to assess data features. The technique allows the listener to hear periodic components as frequencies. Audification typically requires large data sets with periodic components.

Audification is most commonly applied to get the most direct and simple representation of data from sound and to convert it into a visual. In most cases it will always be used for taking sounds and breaking it down in a way that we can visually understand it and construct more data from it.

History

The idea of audification was introduced in 1992 by Greg Kramer, initially as a sonification technique. This was the beginning of audification, but is also why most people to this day still consider audification a type of sonification.

The goal of audification is to allow the listener to audibly experience the results of scientific measurements or simulations.

A 2007 study by Sandra Pauletto and Andy Hunt at the University of York suggested that users were able to detect attributes such as noise, repetitive elements, regular oscillations, discontinuities, and signal power in audification of time-series data to a degree comparable with visual inspection of spectrograms.

Applications

Applications include audification of seismic data and of human neurophysiological signals. An example is the esophageal stethoscope, which amplifies naturally occurring sound without conveying inherently noiseless variables such as the result of gas analysis.[2]

Medicine

Converting ultrasound to audible sound is a form of audification that provides a form of echolocation.[3] [4] Other uses in the medical field include the stethoscope[5] and the audification of an EEG.[6]

Music

The development of electronic music can also be considered the history of audification. This is because all electronic instruments involve electric process audified using a loudspeaker.

Seismology

Audification is of interest for research into Auditory Seismology. It is used in earthquake prediction.[7] Applications include using seismic data to differentiate bomb blasts from earthquakes.

The technique presents sound waves of earthquakes alongside a visual representation. The addition of audio allows both the eye and ears to contribute to better understanding.

NASA

NASA has used audification to represent radio and plasma wave[8] measurements.[9]

Sonification

Both sonification and audification are representational techniques in which data sets or its selected features are mapped into audio signals.[10] However, audification is a kind of sonification, a term which encompasses all techniques for representing data in non-speech audio. Their relationship can be demonstrated in the way data values in some sonifications that directly define audio signals are called audification.[11]

Notes and References

  1. Book: Dean, Roger. The Oxford Handbook of Computer Music. Oxford University Press. 2009. 9780195331615. New York. 321.
  2. Advanced Patient Monitoring Displays: Tools for Continuous Informing. Sanderson. Penelope. Watson. Marcus. 2005. Anesthesia and Analgesia. Russell. W. John. 18818792. 101. 1. 161-8, table of contents. 10.1213/01.ANE.0000154080.67496.AE. 15976225. free.
  3. Davies . T. Claire . Pinder . Shane D. . Dodd . George . Burns . Catherine M. . Where did that sound come from? Comparing the ability to localise using audification and audition . Disability and Rehabilitation: Assistive Technology . March 2012 . 7 . 2 . 130–138 . 10.3109/17483107.2011.602172 . 21923566 .
  4. Book: Davies, Clare. Audification of Ultrasound for Human Echolocation. Clare Davies. 2008.
  5. Web site: Introduction to Digital Stethoscopes and Electrical Component Selection Criteria - Tutorial - Maxim. www.maximintegrated.com. 2019-05-07.
  6. Book: Temko. A.. Marnane. W.. Boylan. G.. O'Toole. J. M.. Lightbody. G.. 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society . Neonatal EEG audification for seizure detection . August 2014. 2014. 4451–4454. 10.1109/EMBC.2014.6944612. 25570980. 978-1-4244-7929-0. 18784120.
  7. Web site: Sounds of Seismic - Earth System Soundscape. sos.allshookup.org. 2019-05-07.
  8. Scarf. F. L.. Gurnett. D. A.. Kurth. W. S.. Coroniti. F. V.. Kennel. C. F.. Poynter. R. L.. 1987. Plasma wave measurements in the magnetosphere of Uranus. Journal of Geophysical Research: Space Physics. 92. A13. 15217–15224. 10.1029/JA092iA13p15217. 1987JGR....9215217S. 2156-2202.
  9. Web site: Using Audification in planetary seismology. Dombois. Florian. Legacy.
  10. Direct Segmented Sonification of Characteristic Features of the Data Domain. Vickers. Paul. Holdrich. Robert. December 2017 . 1711.11368. cs.HC.
  11. Book: The Aesthetics of Scientific Data Representation: More than Pretty Pictures. Philipsen. Lotte. Kjærgaard. Rikke. Routledge. 2018. 9781138679375. New York.