ChoreoStudio is a music‑driven group choreography system that explicitly plans what formations dancers should adopt, when to transition between them, and which dancers execute each transition. It uses a music disentangler to extract rhythmic and structural features, a frozen omni‑modal model to generate a global semantic script, and a Director module that outputs centroid‑relative formation points, transition gates, and mobility allocations. These high‑level plans guide a diffusion generator that produces beat‑aligned body motion, resulting in state‑of‑the‑art motion quality, group organization, and formation dynamics on the AIOZ‑GDance benchmark.
arXiv:2607. 13978v1 Announce Type: cross Abstract: Music-driven dance generation aims to produce human motion that is both rhythmically synchronized and semantically consistent with music.
arXiv:2606. 22726v2 Announce Type: replace Abstract: Choreographic motion generation poses unique challenges for AI, demanding precise semantic control over complex, temporally structured, and expressive full-body dynamics.
Music-driven dance video generation aims to synthesize expressive human motion that is temporally aligned with music while maintaining high visual fidelity. Despite recent progress, existing methods still face two key limitations: the lack of large-scale, high-quality dance video datasets, and the absence of principled frameworks for integrating music as a complementary conditioning signal into Video Generation Foundation Models.
ChainDance is a scalable framework for generating coordinated group dance choreography from music, overcoming the fixed‑size limitation of prior transformer‑based methods. It reformulates the task as a Chain‑of‑Dancers, using a frozen single‑dancer diffusion backbone plus two lightweight modules—Role‑Aware Text Encoder (RATE) and Group‑Aware Motion Encoder (GAME)—to condition on per‑dancer semantics and aggregate previously generated dancers. Experiments on AIOZ‑GDance show that ChainDance delivers state‑of‑the‑art motion quality and group coordination while preserving individual identities, using 3–4× fewer parameters and 3–6× less training time than existing approaches.
The paper introduces Frequency-Factorized Multi-Rate Tokenization (FFMT) for music-to-dance generation, separating root-relative motion into a low-frequency choreographic scaffold and a high-frequency residual. FFMT assigns a lower token rate and smaller codebook to the low-frequency component, while using a higher token rate and larger codebook for the high-frequency part, enabling a plan-then-articulate autoregressive factorization. Experiments on AIST++ and FineDance demonstrate strong distributional fidelity, realistic diversity, and music–motion synchronization, with ablations confirming the benefits of frequency factorization, asymmetric temporal allocation, and low-to-high conditioning.
arXiv:2606. 19914v1 Announce Type: cross Abstract: Art has long stood as a pivotal expression of human creativity.
arXiv:2606. 03169v1 Announce Type: cross Abstract: Recent song generation systems can synthesize realistic audio, yet generating complete songs remains challenging for two reasons.
SalsaAgent is a multimodal embodied language model that generates expressive, full‑body salsa follower motions in response to a human leader and music. The approach treats partner interaction as nonverbal token passing, extending a large language model’s vocabulary to include discrete motion, pairwise relation, and audio tokens. A two‑stage token‑to‑diffusion pipeline, combined with full‑body and pairwise‑relation tokenizers and alignment with automatically derived text descriptions of skeleton dynamics, yields improved motion quality, spatial coordination, and music‑partner synchrony compared to prior baselines.
arXiv:2609.37400v1 Announce Type: new Abstract: Generating realistic 3D dance from music is a challenging task that requires accurate synchronization with musical rhythms while capturing the spatial...
InterSing is a framework that generates realistic 3D head animations for duet singing by modeling the sparse, rhythm‑dependent interactions between performers. It introduces interaction logits—a weakly supervised, interpretable latent representation of cross‑performer engagement—and uses them to condition an interaction‑aware diffusion model driven by audio and interaction dynamics. The approach enables unified multi‑mode generation, producing coordinated behavior, independent motion, and smooth transitions, and it generalizes to multi‑singer performances with intuitive control over engagement.
In recent years, advancements in deep learning and generative models have revolutionized music-driven dance generation. This paper introduces a novel platform, namely DanceDuo, leveraging diffusion models to generate AI-choreographed dance sequences synchronized with a variety of music genres, to encourage dancing practice.
arXiv:2606. 24307v1 Announce Type: cross Abstract: Interactive music and live performance relies on real-time human expression, but modern generative music AI remains largely absent from this domain due to its prohibitive inference latency and offline rendering paradigm.