arXiv AI
Recovering Temporal and Geographic Signals from Language Model Embeddings
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computation and Language
Sep 2
Location-Aware Language Models via Secondary Embeddings
arXiv:2609.00454v1 Announce Type: new Abstract: Pretrained transformer-based language models achieve strong performance across a wide range of NLP tasks but remain limited in encoding geo-locational...
arXiv Machine Learning
Jun 25
What's in an Earth Embedding? An Explainability Analysis of Location Encoders
arXiv:2606. 24997v1 Announce Type: new Abstract: Geographic implicit neural representations (INRs) learn to map any coordinate on Earth to a location embedding, implicitly encoding geospatial data into the weights of a neural network.
arXiv Machine Learning
Aug 5
Geo-Embed: Towards Unified Multimodal Embeddings for Urban Understanding
arXiv:2608. 03826v1 Announce Type: cross Abstract: Geospatial and urban applications increasingly require models to compare heterogeneous evidence across street-view imagery, remote-sensing observations, text descriptions, region proposals, and temporal change cues.
arXiv AI
Jun 9
Mobility-Embedded POIs: Learning What A Place Is and How It Is Used from Human Movement
arXiv:2601. 21149v3 Announce Type: replace-cross Abstract: Recent progress in geospatial foundation models highlights the importance of learning general-purpose representations for real-world locations, particularly points-of-interest (POIs) where human activity concentrates.
arXiv Machine Learning
Jul 1
Symmetry in language statistics shapes the geometry of model representations
arXiv:2602. 15029v3 Announce Type: replace Abstract: The internal representations learned by language models consistently exhibit striking geometric structure: calendar months organize into a circle, historical years form a smooth one-dimensional manifold, and cities' latitudes and longitudes can be decoded using a linear probe.
arXiv AI
Aug 18
Adapting LLMs to Time Series Forecasting via Temporal Heterogeneity Modeling and Representation Alignment
arXiv:2508. 07195v2 Announce Type: replace-cross Abstract: Recent advances have demonstrated that Large Language Models (LLMs) can be effectively adapted for time series forecasting, revealing strong potential beyond natural language tasks.