arXiv:2609.07915v1 Announce Type: cross
Abstract: Large vision models provide useful representations for remote-sensing segmentation but are often too expensive for deployment at the satellite or fie...
By Kishor Kumar Bhaumik, Nicolas Roque dos Santos, Jia Chen, Evangelos E. Papalexakis
Dyna‑DINO introduces a curriculum for Vision Transformer (ViT) knowledge distillation that uses the teacher’s intermediate feature maps as progressively harder targets, enabling a student to build foundational representations before tackling higher‑level abstractions. The approach accelerates convergence and improves performance across multiple tasks: on ImageNet‑100 the distilled ViT‑S reaches 90.1% accuracy (+12.24% over baseline), while on ImageNet‑1K it yields +3.9% and +6.09% gains on Oxford and Paris retrieval, +1.93% on semantic segmentation, and notable classification improvements. Additionally, the curriculum reduces training FLOPs by 25.1% and training time by 21% on ImageNet‑100 through early‑stopping of teacher inference.
By Jiaqi Zhang, Ashton Lee, Anthony Wong, John Zou, Sami BuGhanem, Randall Balestriero
arXiv:2610.32512v1 Announce Type: new
Abstract: Distilled text-to-image models generate images quickly, but classifiers trained on those images can perform substantially worse than classifiers traine...
By Patryk Bartkowiak, Dominik Michels, S\"oren Pirk, Wojciech Pa{\l}ubicki
A100 is a hybrid CNN‑Transformer vision foundation model trained on 3 million unlabeled agricultural images using self‑supervised techniques (DINO, iBOT, KoLeo). It achieves superior crop classification (95.37 % with a frozen backbone) and phenotyping accuracy, and after fine‑tuning reaches 99.90 % on 32‑class crop identification and 99.02 % on 44‑class disease detection. With only 1 % of labeled data, A100 attains 98.01 % plant classification accuracy, outperforming existing baselines and other agricultural foundation models by significant margins.
By Mayur Pratim Das, Ajai Dubey, Aksshay Mathew P, Sana Afreen, Rishi Kumar Soni, Deepak Meena, Pratibha Kumari, Mukesh Saini
TinyCNN is a lightweight convolutional neural network with only 193,190 trainable parameters designed for on‑device plant disease classification. It achieves 98.88% test accuracy on the 38‑class PlantVillage benchmark, outperforming larger models while consuming far less energy, memory, and cost. The study also explores knowledge distillation to further compress the model and evaluates cross‑dataset robustness, finding a significant performance drop when moving from PlantVillage to PlantDoc due to background‑driven shortcut learning.
By Ngoc-Bao Ho-Lam, Thai-Anh Nguyen
arXiv:2606. 14684v1 Announce Type: cross Abstract: Real-time fire classification systems require models that are simultaneously accurate, computationally efficient, and deployable on resource-constrained hardware.
By Mohammed Arif Mainuddin, Najifa Tabassum, Omar Ibne Shahid, Riasat Khan