arXiv Computer Vision

CLASP: Continual Low-rank Adapters for Spatially Placed Concepts from One Hypernetwork

arXiv AI
Sep 24

Parameter Importance-Driven Continual Learning for Foundation Models

The paper introduces PIECE, a Parameter Importance-Driven Continual Learning method that selectively updates only 0.1% of core parameters to preserve general abilities while learning new domain knowledge. PIECE employs two importance estimators—PIECE‑F using Fisher Information and PIECE‑S combining gradient and curvature information—to guide updates. Experiments on three language models and two multimodal models demonstrate that PIECE maintains general capabilities and achieves state‑of‑the‑art continual learning performance without accessing prior training data or adding parameter overhead.

By Lingxiang Wang, Hainan Zhang, Zhiming Zheng
arXiv Computer Vision
Sep 7

SEAL: Semantic-aware Single-image Sticker Personalization with a Large-scale Sticker-tag Dataset

The paper introduces SEAL, a plug‑and‑play module that enhances single‑image sticker personalization in diffusion models by adding a semantic‑guided spatial attention loss, a split‑merge token strategy, and structure‑aware layer restriction. SEAL integrates without altering the U‑Net backbone and addresses overfitting issues such as visual entanglement and structural rigidity. Alongside SEAL, the authors release StickerBench, a large sticker dataset with six attribute tags to enable systematic evaluation of identity preservation and contextual controllability.

By Changhyun Roh, Yonghyun Jeong, Jonghyun Lee, Chanho Eom, Jihyong Oh