arXiv Machine Learning July 7, 2026 By Matteo Spanio, Antonio Rod\`a

Taste-aware music retrieval from audio embeddings

Read the original on arXiv Machine Learning →

arXiv:2607. 03296v1 Announce Type: cross Abstract: Crossmodal correspondences between sound and taste are well established in psychology and neuroscience, but largely absent from content-based multimedia retrieval.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Sep 16

MUUNRiver-Bench: Diagnosing Relation-Dependent Music Retrieval with Multimodal Instructions

MUUNRiver-Bench is a diagnostic benchmark for music retrieval that uses natural‑language instructions to define relevance for reference‑audio queries. It contains 3,440 tracks across 13 genres and 116 sub‑genres and covers seven tasks such as similar‑music, style‑preserving lyric‑rewriting, cover, and segment retrieval. Experiments with six models in eight configurations show that acoustic encoders favor local identity while text‑aligned encoders favor semantic relations, and that instruction‑aware and audio‑text fusion systems do not consistently outperform their backbones.

By Zhancheng Guo, Congren Dai, Shangda Wu, Jianhuai Hu, Danni Zhao, Xiaobing Li, Maosong Sun

llms multimodal benchmarks

arXiv Machine Learning

Sep 15

Multimodal Dataset Normalization and Perceptual Validation for Music-Taste Correspondences

arXiv:2604.10632v2 Announce Type: replace-cross Abstract: Music and food traditions are both intangible cultural heritage, and the links between them, how a sound can make a taste seem sweeter or mor...

By Matteo Spanio, Valentina Frezzato, Antonio Rod\`a

llms fine-tuning multimodal

Hugging Face Trending Papers

Aug 3

Can Foundation Models Hear What Made That Sound? A Tiered Benchmark of Audio-Language Models and Traditional Classifiers for Closed-Set Sound Source Identification

We benchmark eleven audio classification methods: five task-aware closed-set LLMs (four Gemini models plus open-weight Kimi-Audio-7B-Instruct), four fixed-vocabulary taggers (YAMNet, PANNs, Whisper-AT, and SSLAM), a zero-shot audio-text model (CLAP), and an audio-grounded LLM (BAT). We evaluate them on a closed-set sound-source identification task over 2,242 clips spanning 23 fine-grained classes and 11 categories.

llms multimodal benchmarks

Hugging Face Trending Papers

Aug 24

Multi-Modal Semantic Expansion with Constrained LLM Reranking for Conversational Music Recommendation

We present Team Semiintelligencn's solution for the ACM RecSys 2026 TalkPlayData Challenge, addressing conversational music recommendation through a multi-modal and personalized conversational recomme...

llms rag multimodal

arXiv Machine Learning

Aug 11

Assessing Factual Music Comprehension in Large Audio Language Models

arXiv:2511. 05550v3 Announce Type: replace-cross Abstract: Large audio language models (LALMs) leverage multimodal representations to generate open-ended answers to natural language queries about audio.

By Daniel Chenyu Lin, Michael Freeman, John Thickstun

llms multimodal benchmarks

arXiv AI

Aug 25

Multi-Modal Semantic Expansion with Constrained LLM Reranking for Conversational Music Recommendation

arXiv:2608.23484v1 Announce Type: new Abstract: We present Team Semiintelligencn's solution for the ACM RecSys 2026 TalkPlayData Challenge, addressing conversational music recommendation through a mu...

By Naman Garg, Sarika Jain, George Fazekas

llms rag multimodal

One email a morning, machine-written

Related stories

MUUNRiver-Bench: Diagnosing Relation-Dependent Music Retrieval with Multimodal Instructions

Multimodal Dataset Normalization and Perceptual Validation for Music-Taste Correspondences

Can Foundation Models Hear What Made That Sound? A Tiered Benchmark of Audio-Language Models and Traditional Classifiers for Closed-Set Sound Source Identification

Multi-Modal Semantic Expansion with Constrained LLM Reranking for Conversational Music Recommendation

Assessing Factual Music Comprehension in Large Audio Language Models

Multi-Modal Semantic Expansion with Constrained LLM Reranking for Conversational Music Recommendation