Space as a Data Channel: Spatial Sonification Design

Module A: Sonification in 3D. Lesson 2 of 20, 30 min.

Abstract

Spatial position can carry data with little cross-talk and helps listeners follow several streams at once, but spatial hearing is far from uniform. This lesson matches data dimensions to the coordinates the ear resolves well and renders the result as object-based scenes for binaural, Atmos and Ambisonics.

By the end you can

  • Explain how localisation acuity varies across azimuth, elevation and distance and what that implies for data mapping
  • Apply auditory scene analysis and spatial release from masking to decide how many streams to present and how to separate them
  • Map categorical, continuous and ordinal data dimensions to appropriate spatial coordinates with redundant cues
  • Generate an object-based spatial data scene in Python and render it to binaural, loudspeaker or Ambisonics formats

In the previous lesson, sound carried data through pitch, loudness, timbre and time. Immersive audio adds one more dimension: where a sound appears to come from. This lesson looks at how precisely listeners can actually read that dimension, how spatial separation helps them follow several data streams at once, and how to turn a dataset into an object-based scene that can be rendered to binaural, Dolby Atmos or Ambisonics.

Why space is a data channel

Spatial position is unusual among auditory parameters. It is largely independent of the sound itself: a tone can move left to right without changing pitch or timbre, so position suffers less cross-talk than pitch-brightness mappings. It helps the auditory system organise scenes, grouping sounds and picking one voice out of many. And it carries meaning: "left", "above" and "far away" map easily onto categories, priority and uncertainty.

The catch is that spatial hearing is far from uniform: sharp in front, coarser at the sides, unreliable in elevation and front-back position with generic head-related transfer functions (HRTFs), and weakest for distance. Good spatial sonification gives each data dimension a coordinate the ear can resolve with the precision that dimension needs. The plan:

  • Read the psychophysics of direction and distance acuity.
  • Use scene analysis to decide how many streams to present and how to separate them.
  • Assign data dimensions to azimuth, elevation and distance accordingly.
  • Represent the result as audio objects and render it to the delivery format.

If you need a refresher on interaural cues and HRTFs, see the core lesson How We Hear in 3D. For the format landscape, see Immersive Audio Formats.

The rest of this lesson, its lab and self-check are part of Academy Advanced, a paid course. See who has access.

Key readings

  • Mills, A. W. (1958). On the Minimum Audible Angle. Journal of the Acoustical Society of America, 30(4), 237-246.
  • Middlebrooks, J. C., & Green, D. M. (1991). Sound Localization by Human Listeners. Annual Review of Psychology, 42, 135-159.
  • Wenzel, E. M., Arruda, M., Kistler, D. J., & Wightman, F. L. (1993). Localization Using Nonindividualized Head-Related Transfer Functions. Journal of the Acoustical Society of America, 94(1), 111-123.
  • Zahorik, P., Brungart, D. S., & Bronkhorst, A. W. (2005). Auditory Distance Perception in Humans: A Summary of Past and Present Research. Acta Acustica united with Acustica, 91(3), 409-420.
  • Bregman, A. S. (1990). Auditory Scene Analysis: The Perceptual Organization of Sound. MIT Press.