Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

26,872 stories · RSS feed

arXiv AI
Oct 2

Federated Learning for LLMs over Mobile Networks: Issues and Solutions in the RAN Transport

Federated fine‑tuning of large language models (LLMs) over mobile radio access networks (RANs) creates recurring, deadline‑sensitive communication workloads that are currently treated as independent device‑originated flows by transport networks. This mismatch hinders efficient resource provisioning, especially for optical circuit switching and all‑photonics transport that require predictable traffic. The paper proposes that future RANs act as learning‑aware traffic shapers, aggregating asynchronous user‑equipment updates at the gNB to produce fewer, bounded‑size transfers that can be scheduled on dynamically provisioned optical links, thereby combining packet‑based access flexibility with programmable transport capacity.

By Emilio Paolini, Andrea Pinto, Flavio Esposito, Luca Valcarenghi
arXiv Machine Learning
Oct 2

OpenTSLM TeeMoE: A Unified Time-Series Language Model for Forecasting, Contextual Prediction, and Reasoning

arXiv:2609.40265v1 Announce Type: new Abstract: Real-world time-series applications increasingly require models that can handle time series forecasting, context-conditioned prediction, and language-b...

By Tony Chen, Timo Stoffregen, Maxwell Xu, Thomas Kaar, Martin Maritsch, Geremia Pompei, Nicolas Zumarraga, Robert Jakob, Paul Schmiedmayer, Patrick Langer, Juncheng Liu
arXiv Machine Learning
Oct 2

STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction

arXiv:2609.40245v2 Announce Type: cross Abstract: Robot navigation in dynamic, human-centered environments requires socially-compliant decisions grounded in robust scene understanding. Recent Vision-...

By Nathan Tsoi, Michael J. Munje, Tejas Oberoi, Rishab Maheshwari, Pengen Zheng, Tanush Chauhan, Peter Stone, Joydeep Biswas
arXiv AI
Oct 2

Screw Attention: Rigid-Body Algebra Inside a Transformer

Screw Attention introduces a transformer layer that treats the relation between two bodies as a spatial transform rather than a graph edge, enabling each token to represent a body with a pose and its relative pose or joint screw. This design ensures equivariance to independent frame changes and allows a single layer to capture rigid‑body velocity recursion. Experiments on simulated manipulation tasks show that Screw Attention matches or outperforms other network architectures, achieving high success rates on LIBERO‑Spatial with far fewer parameters and maintaining performance under frame convention changes and pose noise.

By Aly Magassouba
Simon Willison
Oct 1

pwasm 0.2a0

Release: pwasm 0.2a0 pwasm is one of my folly projects - an entirely vibe-coded pure Python WebAssembly engine that I built in January during my first bout of AI mania. I hadn't touched it sin...