arXiv Computer Vision
Low-Rank Prompt Learning for Vision-Language Models with Fixed-Token Bases
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv AI
Aug 11
Rethinking Factor Sharing in Federated LoRA: A Rank-Aware Adaptive Approach
arXiv:2608. 09742v1 Announce Type: cross Abstract: Low-rank adaptation (LoRA) represents large language model (LLM) updates with two compact matrix factors, i.
Hugging Face Trending Papers
Sep 23
Task-Induced Riemannian Metrics for Vision Transformer Feature Spaces
Methods operating on Vision Transformer (ViT) feature spaces typically rely on Euclidean distance or cosine similarity. This assumes that every direction is equally meaningful, but there is no reason...
arXiv Machine Learning
5d ago
A Positional Realizability Theory of Length Generalization in Single-Head Attention
arXiv:2610. 41218v1 Announce Type: new Abstract: Why does length generalization (LG) depend so sharply on the positional encoding (PE)?
arXiv Machine Learning
Sep 24
Task-Induced Riemannian Metrics for Vision Transformer Feature Spaces
arXiv:2609.27988v1 Announce Type: cross Abstract: Methods operating on Vision Transformer (ViT) feature spaces typically rely on Euclidean distance or cosine similarity. This assumes that every direc...
arXiv Machine Learning
Aug 4
Not the Dimension, the Norm: What Matters in Gradient-Free Weight Perturbation of Language Models
arXiv:2608. 01624v1 Announce Type: cross Abstract: Adapting a language model to a task no longer requires training all of its weights, and a line of parameter-efficient methods has driven the trainable count from billions down to a handful of scalars.
arXiv Machine Learning
Sep 10
MpSub: A Momentum $p$-Dimensional Subspace Trust-Region Method for Derivative-Free Fine-Tuning of Large Language Models
arXiv:2609.07666v1 Announce Type: new Abstract: Full-parameter fine-tuning of large language models has substantial memory costs because backpropagation stores activations and gradients. Zeroth-order...