Building Blocks for Foundation Model Training and Inference on AWS
Read the original on Hugging Face Blog →The Flow has not summarised this story yet — read it at Hugging Face Blog.
The Flow has not summarised this story yet — read it at Hugging Face Blog.
arXiv:2608.30392v1 Announce Type: new Abstract: Global food security and sustainable climate action increasingly rely on robust, scalable agricultural monitoring. Earth observation foundation models...
The paper introduces PaCTS, a method that generates instance‑adaptive latent prompts—continuous embedding tokens—to provide compact contextual information for frozen time‑series foundation models (TSFMs). These prompts are constructed from instance‑specific global statistics and refined with segment‑level temporal data, enabling the model to capture both global characteristics and local temporal variations. Experiments show that PaCTS improves forecasting performance across various context lengths and model architectures, often outperforming the same backbone with double the context while reducing inference computation, and it also offers stronger improvements and better out‑of‑distribution generalization compared to weight‑space adaptation methods.
The paper "No One Knows the State of the Art in Geospatial Foundation Models" critiques the current lack of standardization in geospatial foundation model (GFM) research, highlighting inconsistencies in evaluation, training, and model release practices across 152 papers. It reports significant discrepancies—46 cross-paper disagreements of at least 10 points for the same model and benchmark, 94 out of 126 papers using unique pretraining configurations, and 39% of papers releasing no model weights. The authors propose six concrete expectations, including named-license weight release, shared core evaluations, and a unified evaluation harness, to address these coordination failures and foster a clearer, comparable understanding of GFM progress.
arXiv:2607. 07758v1 Announce Type: new Abstract: Foundation models (FMs) have transformed machine learning from isolated task-specific model development toward general-purpose models pretrained on broad data and adapted to multiple downstream tasks.
arXiv:2609.07956v1 Announce Type: new Abstract: Tabular Foundation Models (TFMs) have recently demonstrated strong predictive performance through in-context learning, but their deployment in high-thr...