Audio-reactive controls
An audio Source can drive a visual while playing quietly, muted, or with microphone listening off. Its Outputs describe the captured sound; Volume controls what you hear.
Connect a source
Section titled “Connect a source”- Open a Source card in Rack and click its current-source field.
- Choose an audio file, video with audio, microphone, system audio, or Network URL. For Live Capture, use Connect capture and choose an audio-carrying tab/window when your browser offers it.
- Allow the requested capture permission and watch the source state. Audio ready means analysis is receiving sound; Starting audio and Waiting for audio mean it is still connecting. An unavailable or interrupted source shows an explanation.
- For a microphone, start with Listen off. Level and bands still react. Use Listen only when you want to hear the capture through your output. Hosts that cannot monitor it show Listening unavailable on this host.
If nothing reacts, check the selected device, source Enabled state, file Play state, and permission message. A connected source can be silent; Listening for beat means the tempo is uncertain, and Level or Attack can still respond.
Read the outputs
Section titled “Read the outputs”| Output | Try it on |
|---|---|
| Level | Scale, brightness, or glow amount. This is audio strength from 0 to 1 with an adapting loudness reference, so quiet and loud recordings become useful over time. |
| Low / Mid / High | Bass movement, vocal body, and treble shimmer. |
| Beat | Short flashes and accents on observed rhythmic hits. It stops when the hits stop. |
| Phase | Repeating sweeps through a confidently detected beat period. It stays at zero while listening for tempo. |
| Bright / Noise / Attack | Color, texture, and sharp changes in the sound. These work without a tempo lock. |
| Pitch confidence | Gate a melodic effect when a clear note is present. For the actual note frequency, choose Pitch (Hz) in the binding explorer. |
Use the Choose visible outputs button beside Outputs to reveal more meters. Click an output label for its explanation. An unavailable source shows a dash instead of an apparently valid zero measurement.
Level is measured before Volume. Turning Volume down keeps the visual response. Level is an adapting control rather than a calibrated studio loudness meter; two equally loud readings need not represent equal physical sound pressure.
Make a visual react
Section titled “Make a visual react”- Play the source and reveal Level or Beat in Outputs.
- Press W to reveal binding pins, then drag the output pin onto a visual parameter such as Glow amount or Scale.
- Adjust the target range in the binding controls to keep the movement useful. Try Level for flowing changes and Beat for accents.
- Save, reopen, and check the same source and binding. The connection belongs to the Source identity, so replacing its file preserves the binding.
Global audio controls combine unique active sources. Global Level and bands use their means. Global BPM and Phase follow one valid source; Pitch and confidence follow one valid pitched source. A stronger source takes over after remaining at least 25% stronger for one second. Global Beat responds to the strongest observed hit, including while tempo is unknown.
Preview and export
Section titled “Preview and export”Expose the source or visual controls you want people to use in Player. File/video audio analysis uses the same signal processing during live playback and offline export, so matching audio positions produce matching reactive values. Use imported audio for a repeatable export; live devices and live network streams depend on what they capture at that moment and the export host’s source support.
The analysis continues on its audio clock when display FPS changes. Pause, disable, or disconnect makes its outputs inactive. Seeking, replacing, or replaying a source starts fresh detector history; tempo may take several beats to settle. Sustained notes, silence, and irregular noise can have no meaningful tempo. Older hosts with Limited audio analysis still expose available level/band information and report tempo as unavailable.
Try the Audio-Reactive Glow example for a ready-made Level binding, or read Sources and Project Inputs and Parameter bindings for the surrounding workflow.