arXiv Machine Learning
Oct 2

SeqLoRA: Bilevel Orthogonal Adaptation for Continual Multi-Concept Generation

SeqLoRA introduces a bilevel optimization framework for continual learning of text‑to‑image diffusion models, jointly optimizing LoRA factors while enforcing orthogonality between new and existing concept bases. The method achieves monotone descent, convergence guarantees, and a high‑probability bound on catastrophic forgetting that depends on residual interference energy. Experiments on Stable Diffusion with up to 101 concepts demonstrate improved identity preservation, minimal cross‑concept leakage, no need for a fusion step, and scalability beyond memory limits of fusion‑based approaches.

By Javad Parsa, Enis Simsar, Amir Joudaki, Thomas Hofmann, Andr\'e M. H. Teixeira
arXiv Computer Vision
Sep 30

Weeding Out Bad Seeds: Initial-Noise-Robust Unlearning for Text-to-Image Diffusion Models

arXiv:2609.37537v1 Announce Type: new Abstract: Machine unlearning has emerged as a critical post-hoc safety measure to erase sensitive concepts from Text-to-Image (T2I) models without prohibitive re...

By Arian Komaei Koma, Seyed Amir Kasaei, Aida Aryafar, Matin Ghiasi, Ali Aghayari, Amirhossein Souri, Mohammad Mosayyebi, AmirMahdi Sadeghzadeh, Mohammad Hossein Rohban