What is "Auralization"?

“Auralization”, also spelled as “auralisation”, is the process of listening to any audio file as it would sound if played inside a simulated or measured space. For example, in ODEON it is possible to simulate how an orchestra, speech, or any other source would sound in the room you wish, at any position. The simulation results in a binaural audio, which is a highly realistic 3D sound or “out-of-head localization”, known as auralization. The word “auralization” is an analogy to the word “visualization”, only referring to sound instead of visuals.

To get an early idea of what can be achieved via auralization, try listening to the audio below which is a simulation of hand claps at different positions in an IEC listening room. Make sure to listen to it wearing headphones (the reason why this is required is explained further below).

play_circle_filled
pause_circle_filled
Clapping hands, various positions
volume_down
volume_up
volume_off

Auralization process

In order to produce an auralization, two main ingredients are required: a room’s measured or simulated impulse response, and an anechoic audio file. A room’s impulse response is a short signal that fully represents the room’s acoustics, containing information such as the frequency response and the reverberation time. However, a single impulse response is only valid for one source-receiver combination. You may read more about impulse responses in this page.

Anechoic audio files

An audio file is “anechoic” when it has been recorded inside a fully absorbing chamber, therefore practically without any reflections (i.e.: in an anechoic chamber).

Example of an anechoic recording being made at DTU.

The reason why an auralization requires an anechoic file is in order to avoid contaminating the auralization with reflections from the recording room. Otherwise, the acoustics from two rooms would stack on top of each other: the target simulated/measured room (contained in the impulse response file) and the room where the recording was made (contained in the now not-so-anechoic audio file). In order to achieve an accurate auralization, the only reflections involved in the process should be the ones contained in the impulse response.

In practice, an anechoic chamber can be difficult to find or to build. Therefore, a room with very low reverberation (called a dry room in acoustics) – such as a recording studio or a fully furnished and carpeted bedroom – can be a fair alternative. 

Convolution: combining the impulse response and the anechoic audio

An auralization file is made by convolving the input anechoic audio file with the impulse response of the simulated or measured space. Convolution is a digital signal processing operation, which in simple words can be understood as a process that combines two time-varying signals in one.

The beauty of auralization is that it makes it possible to listen to the same anechoic file as it would sound in different rooms, by combining it with the different impulse responses associated to those rooms.

In our website, you may find and freely download examples of anechoic files and impulse responses.

Creating an auralization in ODEON

To create an auralization, ODEON will first calculate the impulse responses between all desired sources, and a single listening position. Then, ODEON will convolve each impulse response with the anechoic audio associated to each impulse response. Finally, all resulting signals are added together.

Some of the auralization features available in ODEON are:
 
  • Streaming convolution: Almost real time. Listen to the room immediately after an impulse response has been calculated; switch between your favourite sound examples (speech, music, hand clap, etc.).
  • Headphone presentation with your preferred HRTF filter and adjustable m-factor: Highly realistic 3D sound; out-of-head localisation
  • Loudspeaker presentation through surround setup. Number of loudspeakers from two to 50: High quality sound presentation of room simulations; for customers or for research.
  • Built-in mixer for multiple sources: Easy management of auraliziation with multiple sources.
 

The simplest way to experience an auralization using ODEON is to create a binaural auralization, meant to be reproduced over headphones.

However, for a binaural auralization to be as realistic as possible, two additional facts must be considered: the interaction of sound with our bodies before it is picked up with our ears, and more importantly, the fact that humans typically listen with two ears. Accounting for these factors yields a more specific type of impulse response, called the “binaural room impulse response” (BRIR).

Binaural room impulse response

For creating the auralizations, a dummy head (having a microphone in the entrance of the left and right ear) is simulated in the receiver position. A real-life example of a dummy head is shown below.

B&K Head and Torso Simulator. Photo by 2014AIST

This dummy head is simulated by introducing yet another step into the process: applying a head-related transfer function, or HRTF. This function is contained within a file which, when selected in ODEON, further modifies the impulse response to simulate the effects of:

  1. Sound reflecting off the shoulders and torso
  2. The head being an obstacle to a sound wave
  3. Diffraction of sound waves around our bodies
  4. Mechanical sound transmission of our pinnae

     

This yields two new impulse responses, associated to the sound reception at each ear. Together, these two impulse responses constitute the binaural room impulse response. This file is applied on a single receiver, which means that despite being at a single position, it will produce two slightly different impulse responses.

It is important to consider that different people have slightly different bodies. Therefore, the only way to experience a practically perfect auralization, is to obtain a measurement of your very own, personal head-related transfer function. However, this is very costly and complicated. In practice, one may simply use an average human HRTF, and this already produces a very realistic auralization. Alternatively, you may download a public domain database of HRTFs for 45 different subjects, at this page.

Listening to binaural auralizations

For a faithfully simulated experience, auralizations are meant to be listened to using headphones, due to the following factors:

  • The binaural room impulse response was calculated at the position of the simulated dummy head ears, so the playback position must be matched by wearing headphones. Basically, you could say that you are putting yourself in the position of the dummy head. On the other hand, using speakers will distort the experience as the speaker positions will be unrelated to what the BRIR represents.
  • Playing the sound freely in a room means that you are adding up your own room’s acoustics together with the target room’s, as well as stacking two head-related transfer functions (the one applied to the calculations, and your real body’s transfer function at the moment of playback).

Moreover, one must remember that headphones also have their own impulse response, meaning that they will have a filtering effect on the electric signal. For an even more accurate auralization, one could design a filter that compensates for the headphones’ response, allowing to play back the auralization as intended. ODEON comes with a tool for designing headphone filters for binaural listening. For more details, you may consult Appendix D of the user manual.

Auralizations using ambisonics B-format

An alternative way of producing an auralization is via ambisonics, which is a full-sphere surround sound format. It is based on the principle of spherical harmonics, which can be explained as a set of 3-dimensional and orthogonal polar patterns that can be summed together to fully describe the directionality of a source or receiver (analogous to signal reconstruction using Fourier analysis and synthesis).

Spherical harmonics up to the 3rd order. The black lobes represent negative polarity. Image adapted from the work of Dr. Franz Zotter.

In the image above, the 0th order polar pattern would be an omnidirectional receiver, while the 1st order patterns would be three figure 8 receivers pointing to each of the 3-dimensional rectangular axes: x, y, and z. As an example, one could describe a uni-directional (cardioid) receiver by adding together the 0th order pattern and any of the 1st order patterns – the positive side of the 1st order pattern would be reinforced, while the negative side would cancelled out by the positive polarity of the 0th order pattern.

Ambisonics aims to record a real or simulated impulse response using spherical harmonics up to a certain order. For example, 1st order ambisonics would record an impulse response using 0th and 1st order spherical harmonics, which can be achieved by using one omnidirectional microphone and three perpendicular figure 8 microphones (ambisonics mics designed for this purposed are currently available in the market). This already gives us a 3D description of the source, although somewhat blurred. 2nd order ambisonics would use 0th, 1st and 2nd order spherical harmonics, for a finer description of the source.

The information is then stored in what is called B-format, where one channel is associated to each spherical harmonic. In the case of 1st order ambisonics, this results in 4 channels, named W, X, Y and Z. The omnidirectional information is stored in channel W, while the information in the x, y and z directions (1st order harmonics) are stored in the X, Y and Z channels.

One of the advantages of B-format is that the channels are not restricted to specific speakers, and instead it can be decoded for playback on any number of speakers.

In ODEON, you can obtain an impulse response in B-format, and decode it for a 2D surround system (that is, a surround setup that does not involve the vertical direction). You would only need to specify your surround setup within the software before generating the impulse response. For any other speaker configuration, you can still get the impulse response in B-format, but you would need to decode it yourself outside of ODEON.

Examples

Several examples of binaural auralization are available at this page. You will find auralizations of concert halls, worship spaces, among others. The auralizations are actually pretty fun to listen to, so we encourage you to check them out! For example, when listening to the receivers closest to and farthest from the source, the difference is very noticeable, especially in the level, and in the ratio between direct sound and reverberant sound.

In the case of concert halls, all listeners should ideally be able to not only see the orchestra playing, but also experience the sound with the same quality. However, in reality, concert halls are typically large rooms, so it is inevitable that the distance from the orchestra will vary considerably from position to position. Even the listening and viewing angle may differ. This is all taken into account when calculating the binaural room impulse responses to be convolved with the anechoic recordings for the final auralization. Since the early reflections are not as strong for the listeners in the back of the hall in comparison with the ones close to the orchestra, it results in a more reverberant audio for listeners in the back in most of the cases.

In the examples, pictures with a 3D view such as the one shown below are taken from ODEON’s 3D OpenGL, which is an alternative way of checking your room model and the sources and receivers’ positions. The red spheres are sources and the blue spheres are receivers.

3D OpenGL view of the byzantine church Hagia Sofia

When simulating an existing place, it is usually difficult to have the information of the absorption coefficient of every surface in the room. A great idea to make sure your simulations are as real as possible, is to match the simulations to a measurement. The image below shows an example of one such comparison.

Comparison of simulated and measured reverberation time T30 at 1 kHz of the Theatre Treze de Maio

If you would like to make sure of the reliability of the software’s simulations, you can read up on room acoustic simulation round robins at this page.

You can get the impulse responses with a computer, ODEON 12 or newer, a source (omnidirectional), and a microphone (omnidirectional). You can learn about performing impulse response measurements by watching the videos at this page, or reading up in the user manual.

It is also possible to load the impulse response (.wav audio file) measured with any other device.

After running the multi-point calculation and comparing the measurement vs. simulation results, you should start tuning the model manually, trying different absorption and scattering coefficients in order to have less error. From ODEON 13, the genetic optimization tool is available, which is capable of tuning the model automatically for you.