Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

8,201 stories · RSS feed

arXiv AI
Oct 27

HARP-LoRA: Hierarchy-Conditioned Rank Projection for Low-Rank Adaptation in Scientific Table Understanding

arXiv:2610.34589v1 Announce Type: cross Abstract: Tabular data is widely used in scientific applications, where complex layouts, including multi-level headers, merged cells, captions, and footnotes,...

By Hossein Sholehrasa, Mohammadhossein Amini, Doina Caragea, Remya Ampadi Ramachandran, Dan Wu, Zihang Shi, Zelin Li, Lindsey Hulbert, Eder Martinez, Xuan Xu, Majid Jaberi-Douraki
arXiv AI
Oct 27

EF-LLM: A Continual Learning-Based Framework for AI-Assisted Automation, Enhanced Sparse Prediction, and Hallucination Detection

EF-LLM is a continual learning framework that combines domain knowledge, temporal data, and multimodal inputs to forecast energy demand and generation. It uses updatable Low‑Rank Adaptation and a multi‑channel architecture to continuously adapt to new data, improving accuracy especially under sparse‑data conditions. The model also uniquely detects and quantifies hallucinations through multi‑task learning and semantic similarity analysis.

By Zihang Qiu, Jayashri Ravishankar, Anam Malik, Zhongju Wang, Renyou Xie