With AR Studio's audio tools, you can add ambient and scripted sounds to your projects.
Ambient sounds are looping audio files that run constantly through the lifetime of an effect. You might use these to create a specific mood, setting or vibe.
Scripted sounds allow you to control when your audio plays. You can either script these sounds or create them using visual programming. You can trigger sounds based on:
AR Studio allows you to do some sound mixing, but for the most part, audio clips should be digitally mastered before you import them. This helps to ensure that none of the imported sounds dominate the experience.
AR Studio supports mono M4A files. We require that you only use files with a 44.1kHz sample rate and 16-bit-depth resolution in order to constrain the size of an effect and preserve its audio quality. You should be able to achieve this conversion through a DAW, but you can also use a program such as iTunes to accomplish this task.
If you are converting ambient or music beds from stereo tracks to mono, it's best to convert to summed mono, rather than just dropping one of the tracks. If you do the latter, you're likely to lose elements of the audio file. In general, try converting your files to the lowest kbps possible, while checking that they still sound good through the device. We don't recommend going lower than 64kbps when converting to m4as.
When creating your ambient audio assets, it's important to consider:
If you create a smaller, seamlessly looping ambient sound asset, you'll need to edit the file in a digital audio workstation, such as Pro Tools, and make the edit cut on the zero crossing at the sample level. This edit is essential to creating a seamless loop, so make sure you cut it so that the wavelength at the end of the file and the wavelength at the beginning of the file flow continuously into each other, without a fade applied to either end.
Below are two screen shots: on the left, the wavelength has been cut correctly and no pop will occur, on the right, the wavelength has been cut incorrectly and this will result in a pop when your ambient bed ends and begins again.
When mixing ambient beds, we recommend that you record audio from a couple of mobile devices and import those files to mix against in your digital audio workstation. An effective ambient bed, much like environmental sounds or a score in a film, should sit well below the production audio (or a person's voice in a capture video), so creating some dummy audio captures will help you achieve the proper levels. You'll be able to make adjustments in AR Studio (only in lowering dB levels, currently), so testing on a mobile device and mixing levels before implementation will save you a lot of time on the implementation stage.
Adding scripted sounds to effects is a good way to add depth to interactive moments. If you had an effect that made the hat on your head fall off and a bird fly out when you opened your mouth, the effect would be more of an immersive experience with the sound of the wind and of the bird flying away.
With scripted audio assets, it's important to consider:
You can use a one shot - a trigger that plays only once all the way through - to trigger a scripted sound.
If you plan to couple ambient beds with scripted effects, make sure to mix both assets together and against the production audio references that you capture from your test mobile device. You'll be able to adjust scripted audio assets in AR Studio just as you can adjust ambient beds, but it's best to get your levels set before importing.
The Audio Source is a speaker in the scene to which you can connect audio clips. In its default state it won't render any sound in your project, but you can configure it to represent audio effects. You can have multiple audio sources in a scene.
Uncheck this box to stop the audio source from being rendered in the scene.
Add an audio clip from your computer, select one from the Assets panel or select the Microphone.
Adjust the volume level of your audio source in the scene.
This appears when an audio clip is added in Audio Source. Check Ambient to make your audio source loop continuously.
This appears when Microphone is selected in Audio Source. Use built in Digital Signal Processing (DSP), more commonly known as 'voice changing effects' to configure a voice-changer effect.
Edit the position of the audio source in your scene.
Choose the camera or cameras on a mobile device in which the audio should play.
This capability is added automatically when you insert an audio source into your scene. It lets you add audio to your project.
To add audio to your project:
If you'd rather have a scripted sound, you can use the Audio module.
It's always a good idea to test effects through a device during the creation process. There are mirroring programs you can leverage to hear the audio through a connected device, or you can always use cloud storage to test mixes on device. Testing often in the design stage will make the refining process at the implementation stage much easier!
Once you've added audio to your project, make sure you test it. Mobile devices can vary widely in their speaker sets and microphones, which can vastly impact the performance of audio effects. Due to the range of mobile devices and environments that your effect could be used in, it's important to try to experience as many different variations of the effect as possible before uploading it to the camera.
When testing, you'll need to check:
Make sure you test your audio in various environments, like outside, inside, with people and without, and on multiple mobile devices.
Device microphones will pick up anything played from the phone's speakers, so playing audio over the device's speaker during recording results in drastically lower quality audio. Doing so would re-record any audio you've added to an effect and would potentially overtake the microphone input, leading to a poor quality mix with doubled and out-of-sync audio.
This would also interfere with any use of DSP effects, since any audio picked up by the device's microphone would be processed and modulated unintentionally.
Muting audio elements during recording allows for DSP use of microphone input to be processed independently of any additional effect audio, flexible, high quality processing options and creates audio quality on the same level as standard HD videos.