Project Qualia investigates whether experiential similarity between songs can be extracted from listening behavior. Using 1.29 billion scrobbles from 9,396 users, the authors trained a Word2Vec model (Song2Vec) on session data, then applied an artist‑residual procedure to isolate artist‑independent signals. The residual embeddings still contained strong cross‑artist similarity, forming coherent genre and era clusters, demonstrating that experiential structure exists beyond artist identity.
By Nizam Mohammed, Abu B. S. Rahman, Dimuthu D. K. Arachchige
The paper evaluates two training‑time data poisoning attacks—label flipping and backdoor poisoning—on MNIST and Fashion‑MNIST using Logistic Regression, Linear SVM, and Random Forest classifiers. Label flipping degrades performance most for Logistic Regression and Linear SVM, while Random Forest remains relatively stable. Backdoor poisoning achieves near‑perfect attack success rates across all models while largely preserving clean‑test accuracy, highlighting the stealthy nature of targeted backdoors.
By Toshif Khan (Minot State University), Muhammad Abusaqer (Minot State University)
The paper introduces a framework for learning feature transformations on tabular data that addresses three limitations of prior generative methods: neglect of hierarchical feature relationships, bias from order-sensitive embeddings, and reliance on gradient-based search. It combines a permutation‑invariant hierarchical module using self‑attention pooling to capture interactions across features, operations, and abstraction levels, with a policy‑guided multi‑objective reinforcement learning strategy that starts from strong seeds and optimizes both predictive accuracy and transformation efficiency. Experiments on diverse tabular benchmarks show the approach outperforms strong baselines, and the authors provide public code and data.
By Rui Liu, Tao Zhe, Yanyong Huang, Sankha Narayan Guria, Xiao Luo, Wei Fan, Yanjie Fu, Dongjie Wang
Xiaomi-CocktailASR-1 is an LLM-based end‑to‑end target‑speaker ASR architecture that uses reference speech as voiceprint prompts to transcribe a target speaker directly from mixed audio, eliminating the need for speech separation. It retains competitive single‑speaker performance comparable to mainstream ASR models and introduces a negative sample rejection capability, outputting empty text when the target speaker is absent. The system also supports a Chain‑of‑Thought reasoning mode and achieves state‑of‑the‑art performance on synthetic and real‑world multispeaker benchmarks, effectively addressing the cocktail party problem with a unified architecture.
By Yiru Zhang, Hang Su, Lichun Fan, Ying Zeng, Chang Liu, Yifeng Wang, Yuquan Liang, Tao Li, Lian Li, Wenhao Yang, Jian Luan, Cong Zou, Heng Qu
uFlowCSP is a MeanFlow-based crystal structure prediction model that learns the average probability‑flow velocity, enabling it to generate complete crystal structures in one to five network evaluations. It achieves inference speeds 5×–58× faster than diffusion and flow‑matching methods while matching or surpassing their performance, with a chemistry‑ and symmetry‑aware Transformer that uses canonical atom ordering and per‑token chemistry embeddings. On the MP‑20 benchmark, uFlowCSP attains comparable or higher accuracy with far fewer evaluations and significantly lower wall‑clock time, demonstrating improved accuracy per network evaluation.
By Sourin Dey, Dipannoy Das Gupta, Lai Wei, Sadman Sadeed Omee, Jianjun Hu
FastMap is a lightweight two‑stage framework that completes top‑down categorical semantic maps in real time. It first compresses map patches into compact bitwise tokens using a lookup‑free BitVAE, producing a 0.41 GB model that is 3.7× smaller than prior masked‑modeling baselines. A Masked AutoEncoder transformer then reconstructs missing tokens in a single forward pass (0.011 s per map), and an object‑aware masking strategy enables goal‑conditioned generation without extra inference cost. On the Gibson benchmark, FastMap attains 34.10 % mIoU and 45.84 % semantic Success Rate, more than doubling the previous best, and achieves an 83.8 % Success Rate on downstream ObjectNav, the highest among compared navigation methods.
By Yijie Deng, Shuaihang Yuan, Congcong Wen, Hao Huang, Anthony Tzes
The paper revisits the continuous diffusion language model Plaid and introduces RePlaid, aligning its architecture with modern discrete diffusion models. RePlaid achieves a compute gap of only 20× compared to autoregressive models, surpasses Duo with fewer parameters, and outperforms MDLM in over‑trained settings. On OpenWebText, RePlaid sets a new state‑of‑the‑art continuous diffusion perplexity of 22.1 and demonstrates superior generation quality, while theoretical analysis links likelihood‑based training to linear cross‑entropy over time and structured embedding geometries.
By Zhihan Yang, Wei Guo, Shuibai Zhang, Subham Sekhar Sahoo, Yongxin Chen, Arash Vahdat, Morteza Mardani, John Thickstun
The paper introduces DF-LLM, a Dynamic Fusion Large Language Model designed for traffic flow prediction. It combines a spatiotemporal embedding module, a fusion module that uses graph convolution to capture spatial topology and dynamic dependencies, and an LLM backbone with differentiated parameter adaptation and context aggregation attention. Experiments on four datasets demonstrate that DF-LLM outperforms existing methods in predictive accuracy.
By Xue Qiu, Jianli Xiao
CMNIE is a new benchmark for extracting structured information from Chinese military news, covering event triggers, arguments, named entities, and entity relations under a unified schema. The dataset contains 13,000 manually annotated instances with 7 event types, 10 argument roles, 7 entity types, and 8 relation types. Experiments show that current supervised models, zero‑shot LLMs, and fine‑tuned LLMs struggle with relation extraction and exact span matching, highlighting the challenge of joint structured extraction in this domain.
By Yan Yu, Mengna Zhu, Zhenyu Song, Hao Yang, Haiwen Chen, Mao Wang
The paper introduces SIRGE, a sequence-informed geometric evaluator for RNA 3D structures that integrates nucleotide embeddings from a pretrained RNA language model into structural representations. SIRGE demonstrates superior performance over existing evaluators in Kendall–τ alignment, Top‑1 selection, and Top‑3 ranking. Controlled experiments reveal that sequence conditioning corrects errors of a purely geometric model and enhances target‑level ranking, suggesting that pretrained sequence representations provide complementary ranking information to geometric reasoning.
By Andrea Zerio, Yighua Yao, Alessandro Micheli, Roland G. Huber, Mile Sikic, Samir Bhatt, Andres R. Masegosa, Yuangang Pan
The paper explores using a large language model (LLM) to generate background context for social media posts and tests four ways to integrate this context into a Sentence-BERT (SBERT) hate‑speech detection classifier. The methods include text concatenation, embedding concatenation, hierarchical transformer fusion, and LLM‑driven text enhancement. Experiments on the Latent Hatred dataset of implicitly hateful tweets and the MAMI dataset of misogynous memes show that adding generated context can raise F1 scores by up to 3 points in textual and 6 points in multimodal settings compared to a zero‑context baseline, with embedding concatenation yielding the best results.
By Joshua Wolfe Brook, Ilia Markov
IndicTriMix presents a new benchmark and models for token‑level language identification in tri‑language code‑mixed text involving Hindi, Gujarati, and Bengali. The authors reformulate the task as sequence labeling and fine‑tune transformer models MuRIL and XLM‑RoBERTa, evaluating them on manually annotated test sets. They also introduce two code‑mixing generation methods using parallel sentences and release the datasets and fine‑tuned models for public use.
By Pruthwik Mishra, Rudra Trivedi, Avi Patel, Ashok Urlana, Shrikant Malviya
The paper demonstrates that textual descriptors alone can predict early‑stage startup exits, using a dataset of 7,419 startups over 20 years. By extracting 850 text‑based features and applying supervised learning, the best model (LightGBM) achieved an F1 score of 0.48, while text alone reached 0.30, confirming the predictive power of founder narratives. Feature analysis identified hyping markers—adjectives, jargon, buzzwords—as positively correlated with exit probability, and introduced a quantifiable Hyping Score for venture capital applications.
By Alberto M. G. Saruggia, Sebastien Germano
The paper introduces LLM-Anchored Paralinguistic Enrichment (LAPE), a method that enhances language model representations with speech-based paralinguistic cues such as pauses and word elongations. LAPE incorporates three innovations: prosodic event textualization, lexico-prosodic unitization and chunking, and text-anchored paralinguistic fusion using NormGate. Evaluations on the ADReSS and ADReSSo datasets show that LAPE achieves state‑of‑the‑art performance in detecting Alzheimer’s disease from speech.
By Xiao Wei, Yuqin Lin, Yaru Cao, Jinyu Li, Bin Wen, Kai Li, Yueying Chen, Longbiao Wang, Jianwu Dang
The paper introduces an experiment where a small masked language model (DeBERTa) is initialized with visual embeddings for tokens that correspond to image regions, following St. Augustine’s ostensive definition of word learning. The visual initialization leaves a measurable imprint that persists through training, yet it does not improve performance on most BabyLM benchmarks that test abstract grammatical knowledge. However, the seeded models show a consistent advantage in zero‑shot object‑property tasks and in a custom Visual‑Property Swap benchmark that probes color, material, size, and shape knowledge, with the advantage confined to the seeded words and transferable to newly seeded words.
By Lisa Bylinina
The study examined whether brain-language model alignment reflects shared computational mechanisms or merely stable lexical‑semantic correspondences. Using whole‑brain encoding across Mandarin, English, and French, transformer representations predicted activity in a distributed network that overlapped across languages and remained stable across layers. Contextual embeddings and measures of prediction or compression did not outperform static lexical embeddings, suggesting that alignment is robust but not informative about shared computational processes.
By Ni Yang, Rui He, Philipp Homan, Iris Sommer, Davide Staub, Wolfram Hinzen
The paper "Query Brand Entity Linking in E-Commerce Search" addresses the challenge of matching short, unstructured user search queries to the correct brand entities in large e‑commerce catalogs. It proposes two scalable solutions: a cascaded pipeline that first detects brand mentions and then disambiguates them, and a single‑stage extreme multiclass classifier that directly maps queries to brand identifiers. Extensive multilingual evaluation and an online experiment show that both methods significantly improve brand recall while preserving high precision, resulting in measurable gains in customer engagement.
By Dong Liu, Sreyashi Nag
MisEdu‑RAG is a dual‑hypergraph retrieval‑augmented generation framework designed to help novice math teachers diagnose and remediate student misconceptions. It structures pedagogical knowledge as a concept hypergraph and real student mistake cases as an instance hypergraph, performing two‑stage retrieval to ground responses in both layers. On the MisstepMath dataset, MisEdu‑RAG outperforms baseline models, improving token‑F1 by 10.95% and achieving up to 15.3% higher quality across five dimensions, especially in diversity and empowerment.
By Zhihan Guo, Yuting Lu, Jionghao Lin
SegKAN is a new model for high‑resolution medical image segmentation that tackles fragmentation and noise in hepatic vessel CT scans. It replaces the standard embedding module with a novel convolutional network to smooth noise and avoid gradient explosion, and reinterprets spatial relationships between Patch blocks as temporal relationships to better capture positional dependencies. Experiments on a hepatic vessel dataset show a 1.78% improvement in Dice score over the current state‑of‑the‑art model, indicating that the new structure enhances segmentation performance for extended objects.
By Shengbo Tan, Rundong Xue, Shipeng Luo, Zeyu Zhang, Xinran Wang, Lei Zhang, Daji Ergu, Zhang Yi, Yang Zhao, Ying Cai
The paper introduces kernel‑managed shared memory, a system‑level abstraction that lets specialized agents write structured, tagged memories while the agent‑system kernel controls retrieval, privacy, and prompt injection. Implemented on AIOS, this design outperforms unmanaged external memory, standard retrieval‑augmented injection, and full context concatenation across GPT‑4o, Llama‑3.1:8B, and Qwen‑2.5:7B, improving personalization scores by 2.4‑4.0 points on a 5‑point scale and reducing latency and token usage by 15‑61%. The results show that centralizing memory management in the kernel delivers most personalization benefits at a fraction of the cost.
By Ryan Lum, Yongfeng Zhang