🤗 PEFT welcomes new merging methods

The N Implementation Details of RLHF with PPO

Operational Identity: A Finite Audit of Declared and Implemented Rules of Sameness

arXiv:2607. 20729v1 Announce Type: cross Abstract: A record system declares when two records refer to the same entity, occurrence, scope, or rule.

CORAM: Coherent Orthogonal Rotation for Model Merging

arXiv:2608. 17366v1 Announce Type: new Abstract: Merging finetuned models combines specialized capabilities without joint training or access to the original data.

Case study: solving P-99 with LPTP and an LLM

arXiv:2607. 21196v1 Announce Type: cross Abstract: Ninety-Nine Prolog Problems (P-99) is a famous set of Prolog exercises.

When Model Merging Rivals Joint Multi-Task Reinforcement Learning: A Task-Vector Geometry Analysis

arXiv:2607. 16062v1 Announce Type: cross Abstract: Model merging is promoted as a substitute for joint multi-task training, yet in the reinforcement-learning setting this substitution is essentially never tested against the baseline it claims to replace: methods merge independently released agents precisely because a joint model is unavailable.

CORAM: Coherent Orthogonal Rotation for Model Merging

Merging finetuned models combines specialized capabilities without joint training or access to the original data. Most methods operate by linear arithmetic in Euclidean weight space, which cannot carry the geometry of the update.