AuraLuxMuse is a system that automates aesthetic stage lighting design by integrating expert knowledge, representation learning, and preference-adaptive modeling. It encodes music and professional cue sequences into a shared retrieval space, estimates cue-event density, and retargets fixture commands to the stage, providing editable cues for designers. The system features Lighting‑Aligned Music Pretraining (LAMP) for audio‑lighting alignment and Preference‑Adaptive Mixture of Experts (PAMoE) for designer‑intent‑driven cue adaptation, and is evaluated using the new Musilux dataset and both virtual and professional labs.
By Junyu Deng, Jiale Cao, Mengtian Li, Zhongxia Ji, Ruhua Chen, Yiyi He, Guangnan Ye, Zuo Hu
arXiv:2606. 30642v1 Announce Type: cross Abstract: Full-length song generation must preserve coherence and musicality, render detailed vocal and accompaniment acoustics, and follow lyrics and prompts.
By Shun Lei, Huaicheng Zhang, Dapeng Wu, Yaoxun Xu, Lishi Zuo, Wei Tan, Hangting Chen, Guangzheng Li, Jianwei Yu, Zhiyong Wu, Dong Yu
arXiv:2608. 06751v1 Announce Type: cross Abstract: Artist-grounded image generation requires more than appending an artist name to a prompt.
By Kuan Xing, Ye Wang, Changyi Gan, Yuheng Li, Thao Nguyen, Yi Chang, Yilin Wang
arXiv:2502. 00023v2 Announce Type: replace-cross Abstract: Our research explores the development and application of musical agents, human-in-the-loop generative AI systems designed to support music performance and improvisation within co-creative spaces.
By Keon Ju M. Lee, Philippe Pasquier
Music-driven dance video generation aims to synthesize expressive human motion that is temporally aligned with music while maintaining high visual fidelity. Despite recent progress, existing methods still face two key limitations: the lack of large-scale, high-quality dance video datasets, and the absence of principled frameworks for integrating music as a complementary conditioning signal into Video Generation Foundation Models.
arXiv:2606. 00629v1 Announce Type: cross Abstract: Sound design workflows frequently oscillate between time-consuming library searches and the complexity of procedural synthesis, with practitioners typically relying on disconnected tools to address each challenge separately.
By Nelly Garcia, Aditya Bhattacharjee, Gabryel Mason-Williams, Israel Mason-Williams, Emmanouil Benetos, Joshua Reiss
arXiv:2512. 02652v2 Announce Type: replace-cross Abstract: Existing methods for expressive music performance rendering, a conditional generation task that aims to generate a human-like performance from a symbolic score, rely on supervised learning over small labeled datasets, which limits scaling of both data volume and model size, despite the availability of vast unlabeled music, as in vision and language.
By Hong-Jie You, Jie-Jing Shao, Xiao-Wen Yang, Lin-Han Jia, Lan-Zhe Guo, Yu-Feng Li
arXiv:2606. 22726v2 Announce Type: replace Abstract: Choreographic motion generation poses unique challenges for AI, demanding precise semantic control over complex, temporally structured, and expressive full-body dynamics.
By Seong Jong Yoo, Siyuan Peng, Felix Gu, Stratis Aloimonos, Cornelia Ferm\"uller
arXiv:2606. 24307v1 Announce Type: cross Abstract: Interactive music and live performance relies on real-time human expression, but modern generative music AI remains largely absent from this domain due to its prohibitive inference latency and offline rendering paradigm.
By Baisen Wang, Chenxi Bao, Qisong Han
The paper introduces MixAgent, an agentic pipeline for music post‑production that emulates audio engineers’ workflow to create interpretable and editable mixing plans guided by a reference song. It employs a grouping agent to cluster related tracks, a planning agent to select and order audio effects, and a detector‑critic pair to refine the mix by identifying needed corrections and proposing parameter adjustments. The authors also present MixCritic, a dataset of 45,657 repair critiques, and demonstrate that supervised fine‑tuning followed by preference optimization improves mix quality, achieving a 19% error reduction on MedleyDB and outperforming several large language models in human listening tests.
By Jaywon Koo, Junghyun Koo, Marco A. Martinez-Ramirez, Wei-Hsiang Liao, Seungheon Doh, Qiyu Wu, Vicente Ordonez, Yuki Mitsufuji
arXiv:2606. 01703v1 Announce Type: cross Abstract: We address the challenge of generating high-fidelity, long-form soundtracks that remain coherent across scene transitions.
By Jiashuo Yu, Yao Yao, Boyu Chen, Alex Wang
arXiv:2608. 03742v1 Announce Type: cross Abstract: Sound effects play a crucial role in conveying actions, events, and environmental cues across digital applications, often requiring a high degree of variation and contextual adaptability.
By Sandy Abdo, Bill Kapralos, Priyamvada Tripathi, KC Collins, Adam Dubrowski