Skip to main content

Sound

Intro

Playback audio and drive deformation or values.

info

Dragging an audio file directly from the Assets Window into the Scene Window or Viewport will create a Sound Behaviour and connect the audio file.

info
  • In order to hear audio in playback, Audio Playback must be enabled in the settings at the bottom of the Viewport.
  • Embedded audio (e.g. in a .mov) is not currently supported. Please see Assets Window for supported audio formats.
  • Audio export is a Professional feature.

UI

Common Attributes +

File - Drag in an audio file from the Asset Window.

Frequency Scale - Choose a model to sample the audio file's frequencies with:

  • Logarithmic - Mirror the structure of musical octaves, where each octave represents a doubling of frequency similar to the way musical scales are organised.
  • Mel - Mirror the non-linear way humans perceive pitch differences making it useful for speech.
  • Bark - Mirror how humans perceive sound, incorporating the concept of auditory masking and bandwidths.

Equalizer - Preview the sound file and isolate Frequency Bands. Use the cursor to remove/add bands to be omitted/included. The buttons to the right will select or deselect all bands.

Frequency Bands - Set the number of bands to sample.

Volume Clipping - Values that fall below this threshold will be ignored (represented by a red line in the equalizer).

Value Offset - Add/remove a value to the input.

Frame Offset - Offset audio playback in the timeline.

Sub Steps - Smooth the sound signal by averaging the values within sub-steps. With a value of 0 the audio is sampled on each frame whereas a value of 1 will result in an average of the samples from frames 0.5, 1 and 1.5.

Smoothing Frames - Smooth the sound signal by increasing the number of frames used to create a sample. For example, a value of 2 will sample the current frame and the one before and average out those values.

Performance

When using Sub Steps and Smoothing Frames expect a performance hit of (smoothingFrames+1)subSteps(smoothingFrames+1)*subSteps

e.g. Smoothing Frames = 2 and Sub Steps = 4 will create a (2 + 1) * 4 = 12x time penalty on the Layer.

Maximum dB - (Output) The maximum dB value found within the asset connected to the File attribute.

File Length - (Output) The duration of the asset connected to the File attribute (in frames).

Volume Adjustment - Increase/decrease the volume of the audio track.

Pan - Bias audio towards the left (negative) or right (positive) stereo channels.

Example
  1. Import an audio asset.
  2. Drag the asset into the Scene Window or Viewport to create a Sound Behaviour.
  3. Create a Shape.
  4. Connect sound.idshape.position.y.
  5. Increase the Sound Behaviour's Strength (depending on the audio asset).
  6. Play

The audio will drive the vertical movement of the Shape.

info

The Sound Behaviour outputs in dB (decibels) which can differ depending on the audio asset.