AVCLVB

Project
Current Workflow

AVCLVB Launch Guide

Overview

AVCLVB is a live datamoshing instrument powered by a custom codec engine, with robust shader support for an audio-reactive visual performance.

Workspace

  • Layers: Build the visual stack with GIF, image, webcam, capture, and ISF sources.
  • Inspector: Shape timing, motion, output, and advanced engine settings per layer.
  • Macros: Use sliders, control surfaces, and presets for fast performance control.
  • Mod Sources: Envelope, LFO, MIDI, gamepad, and MIDI file can drive destinations.
  • Matrix: Route sources to parameters, offsets, and engine controls.
  • Timeline: Switch between live play and song-mode automation.

Control Panel sections: Use Layers for sources, Modulation Sources for slot setup, Macros for performance control and presets, Codec Settings for engine/cartridge tuning, and Save/Export for project and render workflows.

Getting Started

  1. Load a source: Start with Layer 1 and confirm it is the active layer.
  2. Choose a look: Pick a datamosh profile or macro preset, then refine engine settings only if needed.
  3. Map control: Use macros and control surfaces for the big moves you want on hand.
  4. Add modulation: Assign a source slot, then route it in the matrix to the parameter you want to animate.
  5. Refine per layer: Use the inspector to dial timing, motion, and output behavior.
  6. Save the state: Use Project Save once the scene and control setup feel right.

Example Workflows

  • Profile-first: Load a datamosh profile, then ride macros and control surfaces live.
  • Audio-reactive: Envelope to codec intensity, drift, brightness, or distortion.
  • Tempo-locked: Sync LFOs, layer timing, and motion to BPM.
  • Layer collage: Use one layer for texture and another for motion transfer or effects.

Notes

Macros are for fast performance moves. The matrix is for deeper routing. Profiles and macro presets should get you close before manual fine-tuning.

▼ Preset Manager
→
▼ Control Surfaces
Control Surface A
Link
Control Surface B
Link
▼ Macro Controls
▼

Timeline Scheduler

Tempo & Beat Sync Set the BPM the song grid follows.
Main Audio Preview Preview the main track and keep looped analysis aligned.
Quick start: Set tempo and main audio above, choose the song grid below, then paint clips and automation on the timeline.
Timeline editing is off in Live session. Switch Session to Song to arrange clips and automation.
Range & Loop Mark an edit range or loop part of the song.
In -- Out --
Playback Loop From -- To --
Song Grid Define length, rhythm, and snapping.
sec
/
View & Sync Show time the way you think and line visuals up with audio.
-- BPM
ms
1.00x
Song Playback Run the arrangement you painted on the timeline.
Playhead 00:00 / 00:00
Timeline File Save or reload this timeline without touching the full project.
▼

Modulation Sources

Slots 1–5
BPM --
S1 --
S2 --
S3 --
S4 --
S5 --
Modulation Sources Guide
Overview
Slots 1–5 are modulation sources. Each slot can drive any parameter via the Modulation Matrix.
Slot Visualizers
The small scopes show the live output of each slot. Labels show the current source type.
Slot Panels
Pick a source type, adjust its controls, and toggle the slot on/off.
Destinations
Use the Dest button in a slot header to see what it currently affects.
VCA Source
Lets one slot scale another, useful for gating or sidechain-style control.
Offset
Offset isn’t a source. It’s a baseline value in the Modulation Matrix that gets added to the destination before sources are applied.
Tempo
Set a manual BPM or tap tempo to sync LFOs and timing-sensitive motion.
Audio-Reactive Accents
Use an Envelope follower to push brightness or distortion on hits.
Tempo Movement
Use an LFO synced to BPM for pulsing or breathing effects.
Performance Control
Use MIDI or Gamepad slots for hands-on control during a set.
Tempo
Effective Loop: -- BPM | --ms/loop
▼

Audio Source Manager

If multiple files are selected, the first becomes Main Audio and the rest become analysis sources. Uncheck to keep the current main audio.
00:00 / 00:00
▼

Audio Source Management

Use Upload Audio Files above to add file-based sources.
Available Sources:

Visualization Layers

Image sources, motion vectors, and post FX
Motion Sources
0 sources
Motion Preview Select a motion source to inspect its path.
No motion source selected
The preview stage will show the generated transport path and current transform.
Ingredients
Select a generated motion source to inspect displacement, phase, event, and bias ingredients.
Codec Bridge
Focus a destination layer using this source to inspect live codec bridge deltas.
Destinations
Bind this motion source to a destination layer to inspect routing and compatibility.
Viewer overlay is off. Use Mirror to Viewer to project the selected motion overlay onto the main viewer.
Layer Source Type Status Motion Source Tab Settings
Tip: click a preview tile to focus it. Use Add/Replace Source on the tile (or Shift+click tile) to load media. Drag/drop GIF onto a tile or row (Shift+drop = background prewarm).
Layer Sources Guide
Overview
Layers are independent visual sources. The active layer drives playback and output.
Source Type
Choose GIF, webcam, capture, or ISF for each layer.
Motion Source
Pick which layer provides motion vectors for warping.
Tab
Each layer can map to a modulation tab so your settings follow the layer.
Settings
Open per-layer settings to adjust resize, motion, and playback behavior.
Layer Count
Increase or reduce the number of layers and click Apply.
A/B Visuals
Keep two layers loaded and switch the active layer for quick swaps.
Motion Retargeting
Drive the active layer’s warping with a different layer’s motion. Great for applying bold motion from a high‑contrast source onto softer imagery.
Live Collage
Mix GIFs, webcam, or capture across layers for multi-source scenes.

ISF FX

No file loaded
Audio input: --
Gain is modulatable via isfAudioGain
Image filters only. ISF inputs become modulation destinations.
⚡ Performance Monitor ▼

Video Export

bars
Estimated size: --

Codec Settings

▼

GIF Playback Controls

Visual/Motion Decoupling

With Visual Lock on, switching layers only changes motion; visuals stay on the locked layer.

Layer Routing

Choose the layer feeding each column. “Modulate” uses the layer ref parameters (image/motion/residual/block).

DJ Mode

Controls how textures blend when switching between layers with different GIFs.

Commit / Switching

Use Frame Boundary + Atomic for stability. Use After Warp for intentional cut/partial frames.
Use Cases
Visual/Motion Decoupling
With Visual Lock on, changing the active layer only swaps motion; the image stays on the locked visual layer. Use this to audition motion without changing the picture.
DJ Mode
With DJ Mode on, AVCLVB crossfades between outgoing and incoming layer textures instead of hard cuts. Frame Mapping decides how frame indices line up across loops; Size Handling decides how mismatched sizes are reconciled.
Performance: crossfades and any scaling/cropping cost GPU. Identity + Reject is lightest; Phase/Modulo with Scale/Crop/Letterbox is heavier.
Commit / Switching
Commit Policy controls when AVCLVB considers a frame stable enough to show (Atomic waits for a full frame; After Warp/Progressive allow partial frames). Switch Timing decides if a switch waits for a frame boundary or happens mid-frame.
Performance: Atomic + Frame Boundary avoids mid-frame churn and is most stable. After Warp/Immediate can raise GPU pressure and artifacting, but switches feel snappier.
▼

Compressure Settings

Compressure changes how AVCLVB chooses frame indices by grouping frames into superframes and traversing them on a separate timeline. It affects which frames are sampled for playback and datamosh references, not the GPU warp itself.
Master toggle for the compression timeline. Off = AVCLVB uses the normal linear timeline everywhere.
▶

Visual Playback

▶

Datamoshing Reference

▶

Offset Reference

▶

Corruption Reference

▶

Timeline Settings

Info
Visual Playback
AVCLVB samples the visible frame from superframe steps for a stuttered, stepped look. Performance is similar to normal playback.
Datamosh / Corruption References
Reference frames come from the compression timeline, so glitches pull from different moments in the loop.
Performance: changing timeline settings can trigger regeneration when these toggles are on.
Offset Reference
Frame offsets jump by superframes for rhythmic shifts. Minimal runtime cost.
Timeline Settings
Bigger Superframe Size = chunkier jumps. Mode/Frequency shape the traversal rate and pattern.
▼

Datamosh Presets & Engine

Load a profile to apply macro templates and engine settings. Macros and matrix stay editable.
Engine path
Auto-adapt keeps the requested codec when it can, adapts image or motion inputs when needed, and falls back honestly when it must.
Select an engine, choose a path, then use macro presets for engine-specific looks.
Select an engine, choose a path, then use macro presets for engine-specific looks.
Optical flow
Engine: Initializing...
Computing...
Flow settings (settings-only)
Changing these recomputes motion vectors. Use Recompute after edits.
16
16
8
2
0.50
0.30
0.00
Import settings
16
16
8
1.0
Extraction quality
Small block = fine detail
Large search = fast motion
Small grid = dense vectors
CPU/GPU load
Small block = slower
Large search = slower
Small grid = slower
Low resolution = faster
Settings apply to next GIF import. Use Recompute to update current GIF.
Unchecked = artifacts accumulate endlessly (real-time).
Checked = batch regenerate when GIF loops (cleaner).
Batch regen
Settings-only changes wait here until applied.
Runaway
Deterministic regen cadence (respects Accumulation/Contam/Decay).
Codec
QP/intra/ref control residual; stride controls how often image and motion update.
Packet ring
Packet mode only. Ring buffer depth and reference selection.
Pipeline
Film-grain noise (all cartridges).
Info
Profiles
Load macro templates and engine settings. Macros and matrix stay editable.
Engine path
Warp = motion only. Packet = GPU ring. Bitstream = buffer + slot decode.
Recipes
Runaway: Display, Stride 1, QP 25–40. Stable: GIF, Scale 0.5–0.75, Deblock on.
Engine detail
At a Glance
The Predictive Codec re-uses motion vectors to predict the next frame, then stores only the leftover “difference” (residual). QP controls how coarse that residual is, and Update Mode/Stride control how often it recalculates.
Engines (Residual Types)
Pixel: stores raw RGB differences. Fast, chunky, very direct.
RGB Separate: pixel residual with independent R/G/B quantization scales for chromatic artifacts.
YCbCr: stores brightness and color separately. Feels more like real video compression (color smears, luma holds).
DCT: stores 8x8 frequency blocks. Most codec-like, but heaviest on GPU.
Core Controls
  • Codec Mode: Warp disables codec, Packet uses GPU ring, Bitstream uses byte buffer.
  • Quantization (QP): higher = chunkier residuals and more breakup.
  • Intra Probability: forces refresh blocks (I‑blocks) to prevent total melt.
  • Reference Offset: predicts from older frames for wrong-reference smears.
  • Codec Block Size: base macroblock grid (settings-only, reallocates textures).
Performance & Cadence
  • Resolution Scale: lower = faster and blockier.
  • Update Mode: GIF = stable timing, Display = aggressive per‑frame updates.
  • Update Stride: recompute codec every N frames.
  • Deblock: smooths macroblock edges.
  • Residual Precision: 8‑bit/16‑bit storage (auto prefers 16‑bit).
Settings‑Only (Not Modulation Destinations)
  • Optical Flow Engine: Flow Engine, Block Size, Search Range, Grid Step, Search Step, Resolution, Temporal Smooth, Confidence. Changing these recomputes motion vectors.
  • Predictive Codec: Codec Engine, Codec Block Size, DCT Block Size, Resolution Scale, Update Stride, Stream Depth, Residual Precision. Changing these recompiles or reallocates codec textures.
Destination Dependencies
  • GIF Block Size: warp‑only. Codec block size is separate (Codec Block Size), so you can modulate warp without forcing codec rebuilds.
Packet Stream (Temporal Memory)
  • GPU Packet Stream: stores packets in a ring buffer for temporal artifacts.
  • Stream Depth: how many packets are remembered.
  • Packet Stride: advance packet index every N codec frames.
  • Packet Retain: chance to hold the current packet index.
  • Packet Jitter: randomizes reference selection within the stream depth.
  • Stream Debug Logs: prints stream decisions.
Advanced Quantization Controls (DCT + RGB Separate)
  • DCT Block Size: override transform size (default 8).
  • DCT Scale: coefficient scale (higher = stronger artifacts).
  • DCT QP Scale R/G/B: per‑channel quantization.
Recipes
Runaway: Display, Stride 1, QP 25–40. Stable: GIF, Scale 0.5–0.75, Deblock on.
▼

Modulation Matrix

S0 = base, S1–S5 = slots. Macros (above) drive any column.
- / -
0 / 0 Mode: glitchImage

Macros (above) can drive any column. S0 = base value, S1–S5 = slot amount. Use Bake Macro Pose to freeze the current live macro state into this tab.