You can add sounds to your projects using AR Studio's audio tools.
You can easily play sound in the background of your effect either once, or continuously, using an Asset included in AR Studio called a Playback Controller.
Use the Patch Editor or scripting to add audio to your effects based on different triggers, and create more complex effects
Audio clips should be prepped before you import them.
First insert a speaker. The speaker is a scene object to which you can connect audio clips. In its default state it won't render any sound in your project, but you can configure it to represent audio effects. Click + above the Scene tab and select Speaker.
When it's selected in the Scene tab you'll see its properties in the Inspector panel.
Next, create a playback controller. A playback controller will allow you to control when and how audio is played within the effect, by adjusting its properties in the Inspector panel.
In the Assets panel, click + then Create New Playback Controller. Then:
The final step is to select the speaker in the Scene tab. In the Inspector panel, change Audio to the name of your playback controller.
If you disable this setting, the speaker will be hidden from the scene.
Add an audio clip from your computer, select a playback controller from the Assets panel or select the Microphone.
Adjust the volume level of your audio source in the scene.
Edit the position of the audio source in your scene.
Choose the camera or cameras on a mobile device in which the audio should play.
This capability is added automatically when you insert an audio source into your scene. It lets you add audio to your project.
Add an audio clip from your computer
Clicking the circle next to Play will create a blue consumer patch in the Patch Editor. The patch can be used to play your audio clip based on a specific instruction.
Clicking the circle next to Play will create a blue consumer patch in the Patch Editor. Your audio clip will loop continuously.
Use the sliders to adjust the speed in which the audio file plays.
Clicking the circle next to Play will create a blue consumer patch in the Patch Editor. The patch can be used to stop your audio clip based on a specific instruction.
It's always a good idea to test effects through a device during the creation process. There are mirroring programs you can leverage to hear the audio through a connected device, or you can always use cloud storage to test mixes on device. Testing often in the design stage will make the refining process at the implementation stage much easier!
Once you've added audio to your project, make sure you test it. Mobile devices can vary widely in their speaker sets and microphones, which can vastly impact the performance of audio effects. Due to the range of mobile devices and environments that your effect could be used in, it's important to try to experience as many different variations of the effect as possible before uploading it to the camera.
When testing, you'll need to check:
Make sure you test your audio in various environments, like outside, inside, with people and without, and on multiple mobile devices.
Device microphones will pick up anything played from the phone's speakers, so playing audio over the device's speaker during recording results in drastically lower quality audio. Doing so would re-record any audio you've added to an effect and would potentially overtake the microphone input, leading to a poor quality mix with doubled and out-of-sync audio.
This would also interfere with any use of DSP effects, since any audio picked up by the device's microphone would be processed and modulated unintentionally.
Muting audio elements during recording allows for DSP use of microphone input to be processed independently of any additional effect audio, flexible, high quality processing options and creates audio quality on the same level as standard HD videos.