Audio

You can add sounds to your projects using AR Studio's audio tools.

You can easily play sound in the background of your effect either once, or continuously, using an Asset included in AR Studio called a Playback Controller.

Use the Patch Editor or scripting to add audio to your effects based on different triggers, and create more complex effects

Audio clips should be prepped before you import them.

Adding an Audio Clip

First insert a speaker. The speaker is a scene object to which you can connect audio clips. In its default state it won't render any sound in your project, but you can configure it to represent audio effects. Click + above the Scene tab and select Speaker.

When it's selected in the Scene tab you'll see its properties in the Inspector panel.

Next, create a playback controller. A playback controller will allow you to control when and how audio is played within the effect, by adjusting its properties in the Inspector panel.

In the Assets panel, click + then Create New Playback Controller. Then:

  1. Select the playback controller in the Assets panel.
  2. In the Inspector panel, Select Import file next to Audio.
  3. Import your audio file.

The final step is to select the speaker in the Scene tab. In the Inspector panel, change Audio to the name of your playback controller.

You'll need to use the Patch Editor to trigger audio in your effects. Find out more about the Audio patches and how they can be used to create effects with audio.

Speaker Properties

Visible

If you disable this setting, the speaker will be hidden from the scene.

Audio

Add an audio clip from your computer, select a playback controller from the Assets panel or select the Microphone.

Volume

Adjust the volume level of your audio source in the scene.

Transformations

Edit the position of the audio source in your scene.

Enable For

Choose the camera or cameras on a mobile device in which the audio should play.

Audio Capability

This capability is added automatically when you insert an audio source into your scene. It lets you add audio to your project.

Playback Controller Properties

Audio

Add an audio clip from your computer

Play

Clicking the circle next to Play will create a blue consumer patch in the Patch Editor. The patch can be used to play your audio clip based on a specific instruction.

Loop

Clicking the circle next to Play will create a blue consumer patch in the Patch Editor. Your audio clip will loop continuously.

Speed

Use the sliders to adjust the speed in which the audio file plays.

Stop

Clicking the circle next to Play will create a blue consumer patch in the Patch Editor. The patch can be used to stop your audio clip based on a specific instruction.

Testing

During design

It's always a good idea to test effects through a device during the creation process. There are mirroring programs you can leverage to hear the audio through a connected device, or you can always use cloud storage to test mixes on device. Testing often in the design stage will make the refining process at the implementation stage much easier!

After building

Once you've added audio to your project, make sure you test it. Mobile devices can vary widely in their speaker sets and microphones, which can vastly impact the performance of audio effects. Due to the range of mobile devices and environments that your effect could be used in, it's important to try to experience as many different variations of the effect as possible before uploading it to the camera.

When testing, you'll need to check:

  • If you can hear the sounds you've added
  • Whether the ambient sound plays during preview and playback or not
  • Whether your scripted sound plays when it's supposed to or not
  • Whether there's a pop sound or a gap when the sound loops or not
  • If the ambient sound sits below your voice in the mix when you capture some dialog
  • If the scripted sound is startling or repetitive

Make sure you test your audio in various environments, like outside, inside, with people and without, and on multiple mobile devices.

Expected Audio Behavior

Pre-Capture

  • Audio plays as intended: ambient loops and triggered SFX are both audible
  • DSP effects cannot be previewed because these require microphone input during capture

Capture

  • Audio elements are muted during recording

Device microphones will pick up anything played from the phone's speakers, so playing audio over the device's speaker during recording results in drastically lower quality audio. Doing so would re-record any audio you've added to an effect and would potentially overtake the microphone input, leading to a poor quality mix with doubled and out-of-sync audio.

This would also interfere with any use of DSP effects, since any audio picked up by the device's microphone would be processed and modulated unintentionally.

Muting audio elements during recording allows for DSP use of microphone input to be processed independently of any additional effect audio, flexible, high quality processing options and creates audio quality on the same level as standard HD videos.

Post-Capture

  • Audio elements are re-added to the final video and can be heard in full. This allows full spectrum, high-quality audio to accompany a clean microphone input recording
  • Ambient loops will restart and play from the beginning of the recorded capture
  • Only audio that is triggered during recording will be added to the final video. DSP effects will be applied to the microphone input capture and will be audible for the user to review