arXiv Machine Learning July 8, 2026 By Phat Tran, Artin Lahni, Pranav Kulkarni, Yaolun Zhang

Is Domain Adaptation Always Helpful? A Frozen-Backbone Study of Cross-Domain Sentiment Transfer

Read the original on arXiv Machine Learning →

arXiv:2607. 05937v1 Announce Type: cross Abstract: Sentiment analysis with frozen pre-trained language model (PLM) backbones has become a common paradigm, yet the practical benefit of explicit domain adaptation remains unclear, particularly when backbones encode varying degrees of target-domain knowledge.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers

Jul 7

Is Domain Adaptation Always Helpful? A Frozen-Backbone Study of Cross-Domain Sentiment Transfer

Sentiment analysis with frozen pre-trained language model (PLM) backbones has become a common paradigm, yet the practical benefit of explicit domain adaptation remains unclear, particularly when backbones encode varying degrees of target-domain knowledge. We present a preliminary case study evaluating a controlled family of frozen embedding backbones (Qwen3-Embedding 0.

llms rag nlp fine-tuning safety

arXiv Machine Learning

Jun 19

Group-Sparse Matrix Factorization for Transfer Learning of Word Embeddings

arXiv:2104. 08928v4 Announce Type: replace-cross Abstract: Unstructured text provides decision-makers with a rich data source in many domains, ranging from product reviews in retail to nursing notes in healthcare.

By Kan Xu, Xuanyi Zhao, Hamsa Bastani, Osbert Bastani

rag nlp fine-tuning benchmarks

arXiv AI

Jun 10

Instruction Finetuning DeepSeek-R1-8B Model Using LoRA and NEFTune

arXiv:2606. 10392v1 Announce Type: new Abstract: Financial named-entity recognition (NER) is essential for translating unstructured financial reports and news into structured knowledge graphs.

By Wu Yuerong, Mingni Luo

llms rag fine-tuning

Hugging Face Trending Papers

Jun 21

Sub-Billion, Super-Frontier: Small Language Models Rival Zero-Shot Frontier LLMs on General and Literary Relation Extraction

Large language models (LLMs) achieve strong relation extraction (RE), but their computational demands and reliance on proprietary APIs limit deployment in resource-constrained or privacy-sensitive settings. We investigate how far small language models (SLMs) can close this gap across general-domain and literary text.

llms fine-tuning benchmarks safety

arXiv Machine Learning

Aug 11

RA-FinBERT: Rule-aware LoRA adaptation for low-resource financial sentiment classification

arXiv:2608. 09834v1 Announce Type: cross Abstract: Financial sentiment analysis converts unstructured financial news into quantitative signals that can support market analysis and decision-making.

By Fan Zhang, Jiaming Li

llms nlp fine-tuning

arXiv AI

Aug 10

Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probes

arXiv:2608. 07208v1 Announce Type: cross Abstract: Existing measures of how much a text is about a concept read the surface of the text: dictionary word shares, topic proportions, embedding similarities.

By Luc Hazenoot, Zhaochun Ren, Amirhossein Zohrehvand

llms rag fine-tuning

Related stories

Is Domain Adaptation Always Helpful? A Frozen-Backbone Study of Cross-Domain Sentiment Transfer

Group-Sparse Matrix Factorization for Transfer Learning of Word Embeddings

Instruction Finetuning DeepSeek-R1-8B Model Using LoRA and NEFTune

Sub-Billion, Super-Frontier: Small Language Models Rival Zero-Shot Frontier LLMs on General and Literary Relation Extraction

RA-FinBERT: Rule-aware LoRA adaptation for low-resource financial sentiment classification

Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probes