arXiv AI

A Swarm-Coordinated Multi-Robot System for Early Stress Detection in Agricultural Rows Using Multimodal Leaf Sensing

arXiv Computer Vision
Oct 19

ADA 2025: A Multimodal Dataset for Water-Deficit Stress Detection in Sugar Beets

ADA 2025 is a publicly released multimodal dataset exceeding 500 GB, featuring young sugar beet plants under healthy and water‑deficit conditions. It combines thermal, hyperspectral, RGB, and depth imagery with environmental metadata, relative water content, and leaf thickness as ground‑truth labels. The dataset addresses gaps in current AI/ML crop‑management research by providing diverse modalities, accurate metadata, and frequent data points for early stress detection.

By Piper Powell, Robert Franz, Amos Smith, Isaak Ihorst, Joachim Hertzberg, Martin Atzmueller
arXiv Machine Learning
6d ago

AgriDefend: A $205 Offline Edge Device that Detects Crop Stress Before Visible Symptoms via Multimodal AI Fusion

AgriDefend is a $205 consumer‑grade edge device that fuses canopy imagery and soil probe data to detect crop stress before visible symptoms appear. It uses a MobileNetV2 CNN for image analysis, a Random Forest for soil trend features, and a logistic‑regression meta‑learner to produce a five‑class crop‑health prediction, all running on a Raspberry Pi 5 without cloud connectivity. In a greenhouse drought trial with wild radish, the fused model achieved 87 % accuracy and its soil signals predicted wilting about four days earlier than visual signs.

By George Xu, Nikhil Vincent, Elizabeth S. Forbes
arXiv Computer Vision
Sep 14

RoMu4o: A Robotic Manipulation Unit For Orchard Operations Automating Proximal Hyperspectral Leaf Sensing

RoMu4o is a ground robot equipped with a 6‑DOF arm and a vision system that performs real‑time deep‑learning image processing and motion planning for proximal hyperspectral leaf sensing in orchards. The system uses robust perception and manipulation pipelines to identify leaf 3D structure, propose 6‑D poses, and generate collision‑free, constraint‑aware paths for precise leaf grasping and spectroscopy. In lab trials the robot achieved a 95 % success rate for 1‑LPB hyperspectral sampling, while field trials in a pistachio orchard reached 70 % success for autonomous leaf grasping and measurement. whyItMatters":"The system demonstrates a viable robotic solution to automate leaf‑level hyperspectral sensing, addressing labor shortages and enabling precise crop health monitoring in precision agriculture."

By Mehrad Mortazavi, David J. Cappelleri, Reza Ehsani
arXiv Machine Learning
Jul 28

Farm-LightSeek: An Edge-centric Multimodal Agricultural IoT Data Analytics Framework with Lightweight LLMs

arXiv:2506. 03168v2 Announce Type: replace-cross Abstract: Amid the challenges posed by global population growth and climate change, traditional agricultural Internet of Things (IoT) systems is currently undergoing a significant digital transformation to facilitate efficient big data processing.

By Dawen Jiang, Zhishu Shen, Qiushi Zheng, Tiehua Zhang, Wei Xiang, Jiong Jin
arXiv AI
Aug 28

Active sensing to characterize the heterogeneity of plant stress

The paper introduces an autonomous robotic platform that performs targeted chlorophyll fluorescence measurements on plant leaves. It integrates 3D plant reconstruction, geometric analysis, and motion planning to identify suitable leaf surfaces and generate collision‑free trajectories for a robotic manipulator. This system enables automated, repeatable, and spatially resolved physiological measurements that extend beyond passive imaging.

By Ayman Laaroussi, Peter Hanappe, David Colliaux
arXiv Computer Vision
Aug 27

Fusing Perceptual Vision Experts with Multimodal Large Language Models for Explainable Plant Disease Diagnosis: From Benchmark Imagery to Real-World Robotic Field Validation

The paper introduces the Hybrid Hierarchical Multi-Agent Framework (H$^{2}$MAF), which fuses decision-level outputs from EfficientNet-B3 and ConvNeXt-Tiny with semantic arbitration by multimodal large language models Gemma 4 E4B and Qwen3.5 4B to produce explainable plant disease diagnoses. Evaluated on 14,364 images from PlantDoc and two Cornell robotic field datasets, the framework achieves up to 99.3% accuracy, with Gemma improving PlantDoc accuracy from 63.9% to 68.5% and demonstrating low critical‑risk error. The results highlight the potential of MLLM arbitration for reliable, explainable agricultural AI under real‑world field conditions.

By Ranjan Sapkota, Konstantinos I. Roumeliotis, Pengyao Xie, Nikolaos D. Tselikas, Lirong Xiang, Manoj Karkee
arXiv Computer Vision
Sep 4

Concept of a Sensor Test Environment for Dusty Agricultural Conditions

The paper introduces a concept for a sensor test environment tailored to dusty agricultural conditions, featuring both indoor and outdoor proving grounds. The indoor area includes a laboratory test bench with a closed dust circulation system and a test hall for life‑size objects, while the outdoor area offers dedicated setups that allow reproducible data collection with and without dust during real‑world agricultural tasks. The design and setups are visualized in 3D to aid understanding and implementation.

By Peter Buckel, Johannes Hermann, Jonas Wollmann, Thomas Dietmueller, Timo Oksanen
arXiv Machine Learning
Sep 17

MCLC-NET: Multimodal Continual Learning for Leaf Counting

The paper introduces MCLC‑NET, a multimodal continual learning framework for leaf counting that sequentially learns tasks using a memory buffer to retain key samples. It also presents MMLC, a new real‑world dataset containing RGB, depth, and thermal images across different crops and environmental conditions, organized in crop‑wise, time‑wise, and mixed orderings. Experiments show that MCLC‑NET outperforms existing methods on all three task orderings, achieving the lowest average mean squared errors.

By Ruchi Bhatt, Pratibha Kumari, Shreya Bansal, Vedant Agnihotri, Dwarikanath Mahapatra, Mukesh Saini