Authors
- Sungho Lee*
- Marco A. Martínez-Ramírez
- Wei-Hsiang Liao
- Stefan Uhlich*
- Giorgio Fabbro*
- Kyogu Lee*
- Yuki Mitsufuji
* External authors
Venue
- DAFx-24
Date
- 2024
Share
SEARCHING FOR MUSIC MIXING GRAPHS: A PRUNING APPROACH
Sungho Lee*
Marco A. Martínez-Ramírez
Stefan Uhlich*
Giorgio Fabbro*
Kyogu Lee*
* External authors
DAFx-24
2024
Abstract
Music mixing is compositional -- experts combine multiple audio processors to achieve a cohesive mix from dry source tracks. We propose a method to reverse engineer this process from the input and output audio. First, we create a mixing console that applies all available processors to every chain. Then, after the initial console parameter optimization, we alternate between removing redundant processors and fine-tuning. We achieve this through differentiable implementation of both processors and pruning. Consequently, we find a sparse mixing graph that achieves nearly identical matching quality of the full mixing console. We apply this procedure to dry-mix pairs from various datasets and collect graphs that also can be used to train neural networks for music mixing applications.
Related Publications
Parameter-Efficient Fine-Tuning (PEFT) of text-to-image models has become an increasingly popular technique with many applications. Among the various PEFT methods, Low-Rank Adaptation (LoRA) and its variants have gained significant attention due to their effectiveness, enabl…
We introduce the Robust Audio Watermarking Benchmark (RAW-Bench), a benchmark for evaluating deep learning-based audio watermarking methods with standardized and systematic comparisons. To simulate real-world usage, we introduce a comprehensive audio attack pipeline with var…
Consistency Training (CT) has recently emerged as a promising alternative to diffusion models, achieving competitive performance in image generation tasks. However, non-distillation consistency training often suffers from high variance and instability, and analyzing and impr…
JOIN US
Shape the Future of AI with Sony AI
We want to hear from those of you who have a strong desire
to shape the future of AI.
