arXiv Computer Vision August 28, 2026 By Yibo Feng

Geo-LoRA: Geometry-Aware Subspace Evolution for Low-Rank Adaptation in Continual Learning

Read the original on arXiv Computer Vision →

Geo-LoRA introduces a geometry‑aware framework for low‑rank adaptation in rehearsal‑free class‑incremental learning. It regulates the evolution of shared and task‑specific LoRA subspaces using Subspace Projection Preservation, Adaptive Core‑Slack Alignment, and Median‑Calibrated Block Overlap, ensuring smooth trajectories on the Grassmann manifold and balanced stability‑plasticity trade‑offs. The method achieves state‑of‑the‑art performance across multiple benchmarks without adding new adapter types.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI

Aug 3

GeoRA: Geometry-Aware Low-Rank Adaptation for RLVR

arXiv:2601. 09361v4 Announce Type: replace-cross Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) is a key paradigm for improving large-scale reasoning models.

By Jiaying Zhang, Lei Shi, Jiguo Li, Jun Xu, Jiuchong Gao, Jinghua Hao, Renqing He

llms reinforcement-learning fine-tuning

arXiv AI

Aug 25

TASSO: TAsk-Specific Subspace Optimization for Continual Learning of Vision-Language Models

arXiv:2608.21487v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) exhibit strong zero-shot capabilities, making them an attractive solution for continual learning across diverse tasks....

By Chang Sun, Francesco Barbato, Matteo Caligiuri, Pietro Zanuttigh

llms rag diffusion efficiency multimodal benchmarks

arXiv AI

Aug 13

GCPO: Diagnosing and Constraining Subspace Geometry in Rollout RL for LLMs

arXiv:2608. 11674v1 Announce Type: cross Abstract: On-policy rollout methods such as GRPO are central to post-training of large language models, yet they frequently suffer from training instabilities, cross-task capability degradation, and response-length inflation.

By Kai Yang, Jingwei Xu, Wanyu Wang, Kai-Yuan Guo, Zhenbo Yu, Yi Wang, Yu Qiao

llms reinforcement-learning

arXiv Machine Learning

Jun 29

When One Adapter Speaks for Many: Discovering Low-Rank Redundancy in Continual Fine-Tuning

arXiv:2606. 28117v1 Announce Type: new Abstract: Low-Rank Adaptation (LoRA) has become the standard tool for parameter-efficient fine-tuning of large pretrained models.

By Tanguy Dieudonn\'e, Giulia Lanzillotta, Enis Simsar, Louis Barinka, Thomas Hofmann

fine-tuning benchmarks

arXiv AI

Jul 14

RSLoRA: Training-free Rank Allocation for LoRA via Representational Sensitivity Probing

arXiv:2607. 09757v1 Announce Type: cross Abstract: Low-Rank Adaptation (LoRA) has become a cornerstone of parameter-efficient fine-tuning (PEFT); however, the conventional practice of uniform rank assignment ignores the functional heterogeneity of neural layers.

By Jiaqi Liu, Haidong Kang, Qihui Zhao, Guo Yu

fine-tuning benchmarks

arXiv Statistics ML

2d ago

ChainLoRA: Geometry-Preserving Task Vector Merging for Continual Learning in LLMs

arXiv:2610.00431v1 Announce Type: new Abstract: Continual parameter-efficient fine-tuning for large language models (LLMs) must balance retention of previously acquired knowledge, adaptation to new t...

By Hang Yin, Haozhe Wang, Yuhua Luo, Zhangqi Pan, Xiaoxing Wang, Junchi Yan

llms fine-tuning benchmarks

One email a morning, machine-written

Related stories

GeoRA: Geometry-Aware Low-Rank Adaptation for RLVR

TASSO: TAsk-Specific Subspace Optimization for Continual Learning of Vision-Language Models

GCPO: Diagnosing and Constraining Subspace Geometry in Rollout RL for LLMs

When One Adapter Speaks for Many: Discovering Low-Rank Redundancy in Continual Fine-Tuning

RSLoRA: Training-free Rank Allocation for LoRA via Representational Sensitivity Probing

ChainLoRA: Geometry-Preserving Task Vector Merging for Continual Learning in LLMs