arXiv AI By Arundhuti Sur, Abhiroop Chatterjee, Susmita Ghosh, Emmett Ientilucci

Improved Knowledge Distillation for Land-Use Image Classification

Read the original on arXiv AI →

arXiv:2606. 14886v1 Announce Type: cross Abstract: In the present article, an improved Knowledge Distillation (KD) framework has been proposed for efficient compression of deep convolutional neural networks for land-use image classification task.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 18

TinyCNN: A 193K-Parameter Network for On-Device Plant Disease Detection, with a Cross-Dataset Robustness Diagnosis

TinyCNN is a lightweight convolutional neural network with only 193,190 trainable parameters designed for on‑device plant disease classification. It achieves 98.88% test accuracy on the 38‑class PlantVillage benchmark, outperforming larger models while consuming far less energy, memory, and cost. The study also explores knowledge distillation to further compress the model and evaluates cross‑dataset robustness, finding a significant performance drop when moving from PlantVillage to PlantDoc due to background‑driven shortcut learning.

By Ngoc-Bao Ho-Lam, Thai-Anh Nguyen
Hugging Face Trending Papers
Aug 11

Grid-Preserving Knowledge Distillation: Transferring Convolutional Inductive Bias to Vision Transformers under Data Scarcity

Vision Transformers underperform convolutional networks when training data is scarce, and distilling convolutional inductive biases from a CNN teacher is an effective remedy that leaves the deployed model unchanged. General-purpose feature distillation, however, transfers little in this setting.

arXiv AI
Sep 17

Tabular Deep Learning vs Classical Machine Learning for Urban Land Cover Classification

The paper compares classical machine learning algorithms—such as Logistic Regression, SVM, Random Forest, XGBoost, and CatBoost—with Tabular Deep Learning models (TabNet, FT-Transformer, TabTransformer, TabSeq, and 1D CNNs) for urban land cover classification using a UCI dataset derived from high‑resolution aerial imagery. It evaluates performance across nine land cover classes, addressing challenges like high dimensionality, heterogeneous features, and class imbalance by applying weighted cross‑entropy loss for deep models and measuring accuracy, macro‑precision, macro‑recall, macro‑F1, AUC‑ROC, and confusion matrices. Results indicate that while tree ensembles remain strong baselines, Tabular Deep Learning can match or surpass them when non‑linear interactions are prominent and imbalance handling is effective.

By Muntasir Tabasum, Tanpia Tasnim, Md. Ekramul Islam, Al Zadid Sultan Bin Habib