arXiv Computation and Language
ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv Machine Learning
Jun 2
OP-LoRA: The Blessing of Dimensionality
arXiv:2412. 10362v2 Announce Type: replace Abstract: Low-rank adapters (LoRA) enable finetuning of large models with only a small number of parameters.
arXiv Computer Vision
Aug 24
Prompt2Effect: Training-Free Image-to-Video Model Specialization via LoRA Generation
arXiv:2606.13971v3 Announce Type: replace Abstract: While personalizing Image-to-Video (I2V) diffusion models with specific visual effects is increasingly demanded for high-end generation, current pr...
arXiv AI
1d ago
After a Decade: Bringing Shadow Removal into the Real World with Agentic Training Data
The paper introduces AgenticShadow, a new dataset of 17,138 image‑mask‑target triplets created through an offline agentic workflow that combines physics‑motivated generation, failure detection, feedback‑driven retry, candidate selection, and deterministic correction. This approach addresses the long‑standing lack of diverse paired shadow‑free training data by leveraging existing shadow detection datasets and producing realistic shadow‑free targets. Models trained on AgenticShadow show significant improvements, reducing color distribution differences by 50.5% and cross‑domain LAB RMSE by 19.7‑37.5% compared to prior work.
arXiv Computer Vision
Sep 17
FlashAR: Efficient Post-Training Acceleration for Autoregressive Image Generation
FlashAR is a lightweight post‑training adaptation framework that converts a pre‑trained raster‑scan autoregressive image model into a highly parallel generator using two‑way next‑token prediction. It preserves the original training objective by keeping the horizontal head for row‑wise prediction and adding a lightweight vertical head for column‑wise prediction, with a learnable fusion gate to combine the two predictions. A two‑stage adaptation pipeline—first initializing the vertical head from the pre‑trained model and then jointly fine‑tuning—yields up to a 22.9× speedup for 512×512 image generation while using only 0.05% of the original training data.
arXiv AI
Jun 16
Scaling Adaptive Depth with Norm-Agnostic Residual Networks
arXiv:2606. 16112v1 Announce Type: cross Abstract: Residual architectures are ubiquitous in deep learning, but they suffer from a subtle structural limitation: the norm of the residual stream can grow rapidly with depth.
arXiv Computer Vision
Aug 27
CrossMambaTuning: Synergistic Spatial and Cross-Layer Adaptation for Machine Vision Compression
CrossMambaTuning is a new framework that adapts pretrained learned image compression models to machine vision tasks with minimal retraining. It combines State Space Models with cross‑layer interaction, featuring a Mamba adapter that uses task‑specific prompts and multi‑scale branching, and a Scale‑Invariant Cross‑Layer Adapter (SICA) that shares parameters across scales to reduce redundancy. Experiments show that this approach achieves state‑of‑the‑art performance while cutting parameter overhead by 72% compared to existing methods.