arXiv AI

Lightweight Vision Transformer Compression for On-Device Plant Disease Detection in Resource-Constrained Agricultural Field Conditions

The paper presents a unified compression framework for Vision Transformers aimed at on‑device plant disease detection in resource‑constrained agricultural settings. It combines Hessian‑Balanced Adaptive Block Pruning, quantization, and attention‑based knowledge distillation, evaluating each component separately before integrating the best performers into a deployment pipeline. On a chilli disease dataset, the compressed models achieve accuracy comparable to the FP32 baseline while reducing model size by 74‑98 %, and the full pipeline attains a 54.5× size reduction to 6.01 MB with 95.13 % accuracy.

arXiv Computer Vision
Oct 19

A100: A Hybrid Vision Foundation Model for Agricultural Plant Image Analysis

A100 is a hybrid CNN‑Transformer vision foundation model trained on 3 million unlabeled agricultural images using self‑supervised techniques (DINO, iBOT, KoLeo). It achieves superior crop classification (95.37 % with a frozen backbone) and phenotyping accuracy, and after fine‑tuning reaches 99.90 % on 32‑class crop identification and 99.02 % on 44‑class disease detection. With only 1 % of labeled data, A100 attains 98.01 % plant classification accuracy, outperforming existing baselines and other agricultural foundation models by significant margins.

By Mayur Pratim Das, Ajai Dubey, Aksshay Mathew P, Sana Afreen, Rishi Kumar Soni, Deepak Meena, Pratibha Kumari, Mukesh Saini
arXiv Machine Learning
Sep 18

TinyCNN: A 193K-Parameter Network for On-Device Plant Disease Detection, with a Cross-Dataset Robustness Diagnosis

TinyCNN is a lightweight convolutional neural network with only 193,190 trainable parameters designed for on‑device plant disease classification. It achieves 98.88% test accuracy on the 38‑class PlantVillage benchmark, outperforming larger models while consuming far less energy, memory, and cost. The study also explores knowledge distillation to further compress the model and evaluates cross‑dataset robustness, finding a significant performance drop when moving from PlantVillage to PlantDoc due to background‑driven shortcut learning.

By Ngoc-Bao Ho-Lam, Thai-Anh Nguyen
arXiv Computer Vision
Aug 28

Cross-Architecture Knowledge Distillation from a Vision Foundation Model to a Lightweight Visual State Space Model for Tea Leaf Disease Classification

The paper presents a method for cross‑architecture knowledge distillation from a fine‑tuned DINOv2 Vision Transformer teacher to a lightweight bidirectional Visual State Space Model (LVSSM) student for tea leaf disease classification. By addressing training‑stability issues with a progressive convolutional stem and gated selective‑scan block, the 4.45 M‑parameter student achieves a mean test accuracy of 95.41%—a 3.09‑point improvement over the teacher’s 92.32%—while using only one‑fifth of the teacher’s parameters. Ablation studies show that simple logit‑level distillation outperforms intermediate feature alignment, and the gains are specific to students that start below the teacher’s performance.

By Zibo Zhou, Zongsen Qiu, Rui Chen, Yujie Yao, Yue Zhou, Jianjun Wang
arXiv Computer Vision
Oct 22

Enhancing Cross-Grade Generalization in Banana Variety Classification via Hybrid CNN-Transformers and Knowledge Self-Distillation

The paper introduces a dual‑stream Swin ResNet hybrid architecture that combines CNN and Transformer streams for cross‑grade banana variety classification. It employs KL‑divergence‑based self‑distillation to align the probabilistic outputs of the two streams, achieving a mean accuracy of 81.25% on a dataset of 31,678 images across three varieties and three quality grades. Experiments show the hybrid model outperforms both CNN and Transformer baselines, improving feature transferability, attention localization, and optimization stability.

By Khush Kataruka, Mohammad Muzammila, Zahid Akhtar, Raghavendra Ramachandra, Praveen Kumar Chandaliya
arXiv AI
Jun 2

Attention mechanisms and transfer learning for robust peach leaf damage classification under domain shift

arXiv:2606. 02045v1 Announce Type: cross Abstract: Artificial intelligence provides a practical framework for crop damage assessment from imagery data, supporting early decision-making in agricultural management.

By Adri\'an C\'anovas-Rodriguez, Miguel A. Gonz\'alez-Ill\'an, Maria Fernanda Garc\'ia-Cruz, Pedro Nortes Tortosa, Jos\'e Salvador Rubio-Asensio, Miguel A. Zamora Izquierdo, Juan Antonio Mart\'inez Navarro, Antonio F. Skarmeta
arXiv Machine Learning
Aug 27

CropCop: An Auditable 120-Class Plant-Health Model from Benchmark Reconstruction to a Quantised Runtime Artifact

CropCop is a closed‑set plant‑health recognition system covering 120 operational classes, built from a rigorously audited dataset of 109,107 images after removing 3,233 duplicate relationships. The model, based on a fine‑tuned DINOv3 ConvNeXt‑Tiny, achieves 98.51% accuracy and 96.87% macro‑F1 on a locked internal test, while a quantised MobileNetV4 variant reaches 98.46% accuracy and 96.23% macro‑F1 in a 22.60 MiB runtime artifact. Validation‑only post‑training quantisation and a compact ExecuTorch/XNNPACK PTE ensure high fidelity between the trained model and its deployed form, with minimal decision changes between the INT8 graph and the final artifact.

By Rana Muhammad Ahmed, Sabahat Abbas
arXiv Computer Vision
Sep 17

CoAtNet-DeepMoE: A Convolution-Attention Hybrid with DeepSeek Mixture-of-Experts for Parameter-Efficient Tomato Disease Classification

CoAtNet-DeepMoE is a lightweight Convolution‑Attention hybrid architecture that incorporates a DeepSeek Mixture‑of‑Experts to reduce parameters while maintaining high accuracy for tomato disease classification. The model achieves state‑of‑the‑art performance on Kaggle and PlantVillage datasets, reporting 99.80% accuracy on Kaggle and 99.83% accuracy on PlantVillage, all with only 2.47 million parameters. The source code will be released on GitHub.

By Md Nadim Mahamood, Md Arif Shahriar, Md Shafi Ud Doula, Kamrul Hasan