ARCHITECTURE
The network is built around a central video mixer/index selector that randomly selects from a library of 8–12 short loops. These feeds are routed simultaneously into 10 different BASE COMP (5 with a predominantly white colour scheme and 5 black ones) — each a self-contained effect module with its own internal logic and audio-reactive parameters.
first folder select created
second selector module created w/ more control on individual colorimetry / levels parameters
Audio Analysis & Triggering
The audio signal is split into different frequency bands with peak detection and adjustable gates. Each band feeds two parallel systems : the internal reactivity of each patch (driving parameters from within), and a trigger/selector that switches between patches and video mixer track. Gate / Lag are heavily used to create organic, non-mechanical transitions — peaks, tension and release — and attempting to translate this into the movement of particles and visuals. Full manual override is also available for real-time control on set if needed. Patches with a predominantly black colour are triggered on very fast peaks, in order to create a short, intense strobe effect.
Timecode & Sequencing
One FX patch and a fade a out are locked to specific moments in the track via timecode (TIMELINE CHOP > Constant CHOP > Logic CHOP) — a deliberate structure layered over the generative system. This creates a form of compositional arc that follows the song while preserving randomness in the rest of the performance.
3D Instancing / 2D visuals
Several iterations explore instancing of 3D forms driven by a 2D image source (in TOP) — generating volumetric fields that react to the audio input and shift with the video mixer — and experimentation with UV mapping.
Live Camera Iteration & Optical Flow
A second network iteration introduced a live camera feed from the studio floor, retransmitted in real time as a background layer. The main challenge : avoiding feedback artifacts on the LED wall. Solution : Optical Flow combined with Cache / Cache Select and Composite in Difference mode — isolating movement and applying effects selectively on the performer in the foreground, using multiple keying approaches.
Constraints & Deliverables
Black and white output. Visuals designed to surround and enhance the performer without 'competing' too much with him — a compositional constraint that shaped every patch. Delivered as both a real-time system for the shoot and final rendered output.
