Satellite-based distributed learning promises to train machine-learning models directly in orbit using massive, globally dispersed sensor data, thereby avoiding large-scale data downloads to ground se...
arXiv:2608. 09687v1 Announce Type: new Abstract: Federated learning (FL) in Low Earth Orbit (LEO) satellite constellations is affected by non-IID data and irregular ground-station visibility, both driven by orbital geometry.
Satellite mega-constellations are emerging as large-scale sensing, communication, and computation fabrics, yet their learning architectures remain largely inherited from terrestrial federated learning...
The paper introduces a heterogeneous federated learning approach using the FractalNet architecture tailored for satellite mega‑constellations. It formalizes contact‑window‑constrained, depth‑heterogeneous optimization and proposes a distributed path scheduler that assigns model depth based on satellite SWAP‑C constraints, predicted contacts, and training statistics. The framework includes periodic update pooling and a three‑tier agentic control plane, and is validated through a wildfire detection case study across LEO, MEO, and GEO/HEO shells, demonstrating improvements in convergence, communication efficiency, energy adaptation, and robustness.
arXiv:2602. 06932v5 Announce Type: replace Abstract: Speculative decoding can significantly accelerate LLM serving, yet most deployments today disentangle speculator training from serving, treating speculator training as a standalone offline modeling problem.
Ampere is a new split federated learning system that reduces both on‑device computation and device‑server communication while improving accuracy. It trains device and server blocks sequentially with local losses, eliminating gradient transfers, and uses a lightweight auxiliary network to consolidate activations into a single transfer. Experiments on CNNs and Transformers show up to 11.70 pp accuracy gains, 18.6× faster training, 911× less communication, and 14.5× less computation compared to state‑of‑the‑art SFL baselines.
The paper introduces OrbitALIF, a federated learning framework that performs cloud removal on low‑earth‑orbit satellites. It uses a compact 2.30 M‑parameter spiking neural network with adaptive gated fusion and spectral‑spatial hybrid attention modules, enabling both training and inference onboard. The approach achieves competitive cloud‑removal quality while consuming only 0.287 mJ per inference on neuromorphic hardware, a 72.3‑fold energy reduction compared to an equivalent ANN.
arXiv:2608. 15639v1 Announce Type: cross Abstract: \textit{Split Federated Learning} (SFL) enables distributed model training by splitting networks between the server and clients.
arXiv:2608. 09250v1 Announce Type: new Abstract: Federated learning (FL) must serve devices with varying computational capabilities.
arXiv:2608. 14654v1 Announce Type: cross Abstract: Federated Learning (FL) is a collaborative paradigm that enables multiple devices to train a global model while preserving local data privacy.
arXiv:2607. 02391v1 Announce Type: cross Abstract: Large Language Model (LLM) inference workloads are a rapidly growing contributor to data center energy consumption.
Large Language Model (LLM) inference workloads are a rapidly growing contributor to data center energy consumption. Optimizing these deployments requires matching specific LLMs to the most efficient GPUs, but operators currently lack the tools to do so without exhaustively profiling each combination.