arXiv Computer Vision

RingMoClaw: An Experience-Inspired Multi-Agent Framework for Self-Evolving Research in Remote Sensing

arXiv Machine Learning
Sep 15

Running the Gauntlet: Challenging Agentic Tasks

arXiv:2606.14397v4 Announce Type: replace Abstract: As agentic systems continue to evolve and are widely deployed in real-world scenarios, there is a growing demand to faithfully evaluate their capab...

By Mykola Vysotskyi, Runqi Lin, Grzegorz Biziel, Michal Zakrzewski, Sebastian Montagna, Damian Rynczak, Shreyansh Padarha, Kumail Alhamoud, Zihao Fu, William Lugoloobi, Kai Rawal, Hanna Yershova, Taras Rumezhak, Guohao Li, Fazl Barez, Baoyuan Wu, Arkadiusz Drohomirecki, Yarin Gal, Chris Russell, Christopher Summerfield, Adam Mahdi, Volodymyr Karpiv, Philip Torr, Adel Bibi
arXiv Computation and Language
3d ago

The Last Remote Sensing Model Built by Humans? Casting Any Earth Observation Task as Recursive Self-Improvement

The paper proposes a new paradigm for Earth observation (EO) modeling in which a general-purpose coding agent automatically builds and recursively improves models by interacting with a harness and a verifier. Any verifiable EO task can be framed with a harness that defines permissible operations and a verifier that assesses success, enabling the agent to learn from labeled benchmarks, independent sensors, physical models, or repeated observations. On six diverse EO benchmarks—including optical, SAR, and multispectral time-series imagery—the agent-built models outperform state‑of‑the‑art methods on every task, achieving superior land‑cover mapping using only 11% of the training labels.

By Sijie Zhao, Zeqi Zhou, Heli Qi, Xuanchao Fu, Zhuo Zheng, Junshi Xia, Junjue Wang, Weihao Xuan, Naoto Yokoya
arXiv Machine Learning
Jun 15

Running the Gauntlet: Re-evaluating the Capabilities of Agents Beyond Familiar Environments

arXiv:2606. 14397v1 Announce Type: new Abstract: As agentic systems continue to evolve and are widely deployed in real-world scenarios, there is a growing demand to faithfully evaluate their capabilities.

By Mykola Vysotskyi, Runqi Lin, Grzegorz Biziel, Michal Zakrzewski, Sebastian Montagna, Damian Rynczak, Shreyansh Padarha, Kumail Alhamoud, Zihao Fu, William Lugoloobi, Kai Rawal, Hanna Yershova, Xander Davies, Taras Rumezhak, Guohao Li, Fazl Barez, Baoyuan Wu, Arkadiusz Drohomirecki, Yarin Gal, Chris Russell, Christopher Summerfield, Adam Mahdi, Volodymyr Karpiv, Philip Torr, Adel Bibi
Hugging Face Trending Papers
6d ago

The Last Remote Sensing Model Built by Humans? Casting Any Earth Observation Task as Recursive Self-Improvement

The paper demonstrates that Earth observation (EO) models can be automatically constructed and refined by a general-purpose coding agent when provided with a harness (defining permissible tools) and a verifier (defining success criteria). By casting any verifiable EO task—using labeled benchmarks, independent sensors, physical models, or repeated observations—as such a harness-verifier pair, the agent recursively improves its own outputs. On four EO benchmarks covering optical, SAR, and multispectral time-series imagery, the agent-built models outperform state‑of‑the‑art methods while retaining most accuracy with only about 1 % of the training labels.

arXiv Machine Learning
Jul 20

More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe

arXiv:2607. 15942v1 Announce Type: cross Abstract: Remote sensing vision-language models are increasingly expected to support open-ended reasoning over Earth Observation data and a variety of tasks.

By Stefan Maria Ailuro (INSAIT, Sofia University "St. Kliment Ohridski"), Mario Markov (INSAIT, Sofia University "St. Kliment Ohridski"), Mohammad Mahdi (INSAIT, Sofia University "St. Kliment Ohridski"), Luc Van Gool (INSAIT, Sofia University "St. Kliment Ohridski"), Danda Pani Paudel (INSAIT, Sofia University "St. Kliment Ohridski")
arXiv Machine Learning
Sep 22

RS-Claw-Evolution: Environment-Feedback-Driven Evolution for Lightweight Remote Sensing Agents in Long-Horizon Tasks

RS-Claw-Evolution is an environment-feedback-driven framework designed to enhance lightweight remote sensing agents for long-horizon tasks. It improves agents through three stages—interaction evolution, experience evolution, and decision evolution—using executable code, failure-aware trajectory generation, and reinforcement learning with multi-dimensional rewards. On Earth-Bench, a Qwen3-4B agent trained with this framework reaches 65.9% accuracy, surpassing larger baselines and approaching GPT-5 performance.

By Kai Ouyang, Dongyang Hou, Liangtian Liu, Zeyuan Wang, Ziyu Li, Chengfu Liu, Zichao Tang, Xuezhi Cui, Shengwu Ouyang, Wentao Yang, Hanwen Yu, Haifeng Li
arXiv Computation and Language
Sep 15

ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement

arXiv:2609.14857v1 Announce Type: new Abstract: Recent work extends recursive self-improvement (RSI) to agent harnesses for long-horizon coding and terminal tasks, enabling agents to improve executio...

By Siwei Wu, Jincheng Ren, Yizhi Li, Haau-Sing Li, Chengran Yang, Yuxuan Zhang, Weicheng Gu, Jian Yang, Riza Batista-Navarro, Chuanyi Zhang, Xianglong Liu, Ming Zhou, Bryan Dai, Chenghua Lin
arXiv Computer Vision
Sep 30

Beacon: Knowing When and How to Perform Agentic Visual Reasoning

Beacon is a new agentic visual reasoning model that improves multimodal large language models (MLLMs) by better deciding when to use tools and how to use them. It introduces two key concepts—Mode Adaptiveness, which ensures tools are invoked only when necessary, and Tool Effect, which measures the net benefit of tool use— and trains the model with supervised fine‑tuning and reinforcement learning that rewards necessity-aware decisions and expands capability through expert hints. Across 13 benchmarks, Beacon outperforms other open‑source models, achieving the highest average score and the largest net tool‑gain on diagnostic tests.

By Qixun Wang, Yang Shi, Letian Cheng, Zhuoran Zhang, Yan He, Yuqi Tang, Qi Zhang, Xinlei Yu, Ruizhe Chen, Tianrun Xu, Yuanxing Zhang, Pengfei Wan, Haotian Wang, Xianghua Ying
arXiv AI
Sep 1

SimCRAFT: Distilling Remote Sensing Agents via Synthetic Trajectories and Contextual Retrieval-Augmented Fine-Tuning

SimCRAFT is a model‑agnostic framework that distills remote sensing orchestration into a compact 7B‑scale model. It creates a large, constraint‑validated workflow planning corpus (SimRS‑14k) using a multi‑agent synthesis engine and a Mock Execution Engine, then fine‑tunes the model with Contextual Retrieval‑Augmented Fine‑Tuning (CRAFT) to reason analogically. Experiments show SimCRAFT‑7B outperforms open‑weight LLMs and rivals advanced closed‑source models, providing a lightweight, efficient baseline for autonomous remote sensing deployment.

By Haoran Wang, Jing Yao, Xu Yang, Zeqing Wang, Yang Zhang, Pedram Ghamisi, Zhengchao Chen