It’s been a while since last post. I have given an workshop on latest AES convention, which was held online (thus it was named Virtual Vienna). Shame I couldn’t visit Vienna and meet all of the AES folk. Maybe next time! For those who participated the convention – you can still watch my workshop online on the on demand site until the end of June.
Idea for listing my favourite tools was with me for a long time. I think this is a good moment to do it. These are my top tools at this very moment, this might change since the spatial audio is now on the fast lane and new hardware and software is showing up every second.
Audiokinetic Wwise is not recognised so much as an spatial audio software. Game engine audio middleware is for sure now one of the most used spatial audio tools, in most cases as the part of game titles. But you can use it in many ways. What you can have using it:
- supports up to 5th order ambisonics decoding and encoding. What you can achieve is eg. generating 5th order recording from object sources positioned and manipulated in game engine.
- auralisation based on raytracing using geometry and acoustic materials – and you can encode it in ambisonics!
- works in multiple OS – I have succeed decoding 4th order ambisonics on android based Oculus Quest, this was not possible using previous methods such as eg. Audio360 SDK from Facebook.
- convolve signal with HOA IRs (up to 3th order)
- decode binaural using Google Resonance or Auro Headphone
- decode to multiple speaker systems, including Atmos and Auro
If you are looking for decent rendering, panning, auralisation and more you should have a look at Wwise.
Dear Reality Spatial Connect + DearVR Pro
This duo is something that is going to grow in the nearest future. If you are working with cinematic VR this one is a game changer. You can sit in VR and work with 3D panning as smoothly as it can get. When using DearVR Ambi Micro you can have your whole project headtracked even, if not all the tracks are spatialised with DearVR Pro plugin.
With help of Virtual Desktop you can use it wirelessly on Oculus Quest. Nice addon is that you can have your DAW on mac and VR video on PC. Spatial Connect Adapter helps enables you to connect over IP with desired workstation.
It works up to 3rd order, and offers number of output formats, speaker systems and binaural with choice of HRTFs.
The downsides are that DearVR is a closed system, so you cannot use headtracking data for other plugins. Also, the video timecode works correctly only with 30 fps videos which is not always the case.
If you are looking for software that can generate dynamic movement of multiple sound sources Sound Particles is the ultimate tool for this task.
You can define paths and generation points with simple equations. Whats most interesting is that you can render these “scenes” to almost every known microphone configuration (of course these are virtual microphones).
This is a great set of ambisonic tools created by Peter Stitt. The set of tool from standard, like panner, to more sophisticated ones, like equalizer, deesser or compressor. They come in a bundle for FOA, TOA and even 7OA.
This is one of the most advanced plugin packages for ambisonics. If you are looking for convenient way for working with soundfield, this set might find your needs.
AFAIK Peter is working on even more advanced tools, which I had occasion to test, but I don’t know if I am allowed to elaborate more on this. I reccomend you to have a look at his website from time to time.
As it is stated on their website: IEM Plug-in Suite is a free and Open-Source audio plugin suite including Ambisonic plug-ins up to 7th order created by staff and students of the Institute of Electronic Music and Acoustics.
Most comprehensive set of tools available for free. Period.
Runner up for the most comprehensive set of tools available for free.!
Richard Furse is a known name in spatial audio world. His tools cover every aspect of spatial audio, from siple decodeing and encoding up to sophisticated playback systems for gaming engines. It is recommended to start with O3A Core free set of plugins.
Unreal Engine 4.25
Unreal Engine supports now native FOA and I think that this is going to get better in nearest future as UE5 is upcoming. Audio team of UE now is focusing more on spatial audio. My vision is that game engines will become basic tools for working with audio and video. You can design your own set of needed tools there. I can say that my favourite DAW now is UE4 😉