arXiv:2607. 22806v1 Announce Type: new Abstract: Modern cloud deployments distribute applications across multiple geographic regions, yet standard routing mechanisms prioritize latency while ignoring the fluctuating carbon intensity of local power grids.
arXiv:2608. 12915v1 Announce Type: cross Abstract: The rapid growth of LLM inference is shifting sustainability concerns from one-time training to continuous serving, where infrastructure decisions shape energy use, carbon emissions, water consumption, and service quality.
arXiv:2606. 14707v1 Announce Type: cross Abstract: AI training and deployment consume substantial electricity, but carbon outcomes remain weakly integrated into routine model development decisions.
The paper presents a carbon‑aware routing framework for function‑calling in large language models that distributes queries across a three‑tier edge‑cloud architecture. A lightweight k‑NN predictor estimates accuracy, delay, and power for each edge tier, and real‑time grid carbon intensity is used to route queries to the lowest‑emission tier that can execute them. Experiments on state‑of‑the‑art benchmarks show the framework matches cloud‑level accuracy while cutting operational carbon emissions by an average of four times.
arXiv:2605. 23348v2 Announce Type: replace-cross Abstract: AI power demand is growing at an unprecedented rate while power grids are often ailing and struggle to keep up.
arXiv:2609.33965v2 Announce Type: replace-cross Abstract: We describe a methodology for estimating the per-token energy cost of cloud-hosted large language model (LLM) inference, separating between i...
arXiv:2606. 30919v1 Announce Type: cross Abstract: Edge-cloud inference collaborations are often designed with a routing estimator that decides whether to offload each frame from weak models at the edge to stronger models in the cloud.
arXiv:2604. 07472v2 Announce Type: replace Abstract: Serving large language model (LLM) inference in cloud environments requires jointly optimizing model selection, GPU provisioning, parallelism configuration, and workload routing under latency, accuracy, memory, and budget constraints.
arXiv:2509. 04827v3 Announce Type: replace-cross Abstract: The energy cost of Large Language Model (LLM) inference is rapidly becoming a barrier to sustainable and scalable deployment.
The paper introduces EqGrid, a closed‑loop simulation that uses a low‑frequency, open‑weight LLM policy agent to set price, carbon limits, and subsidies for a community of empirically‑grounded household personas, while high‑frequency multi‑agent RL traders clear a continuous double auction on a physically constrained IEEE‑33‑bus grid. It demonstrates that the LLM can reduce energy‑poverty inequality—lowering the Gini of energy burden from 0.351 to 0.305 and mean burden by 28%—without increasing net grid cost, and that a compressed sub‑1B model retains 92–95% of this benefit at dramatically lower inference energy. The study also establishes a compute‑efficiency frontier and a decoupled‑safety design that eliminates grid violations. whyItMatters":"By showing that a lightweight LLM can effectively manage energy markets to reduce poverty and inequality while staying energy‑efficient, the work offers a practical, low‑carbon AI solution for humanitarian energy‑poverty interventions."
arXiv:2608.28726v1 Announce Type: new Abstract: The remarkable performance of multimodal large language models (MLLMs) comes at the cost of substantial computational overhead, posing significant chal...
arXiv:2609.15389v1 Announce Type: cross Abstract: As artificial intelligence systems increasingly rely on distributed and collaborative training, the energy footprint of these processes becomes a sha...
arXiv:2608. 14557v1 Announce Type: cross Abstract: Low Earth Orbit (LEO) computing is emerging for low-latency, globally distributed AI services, enabled by advances in satellite constellations and reusable launch systems.