Hugging Face Trending Papers

STEMGym: Benchmarking Sequential Decision-Making under Dose Budgets in Autonomous Electron Microscopy

A central premise of autonomous scientific imaging is that smarter navigation, whether Bayesian, RL-based, or otherwise adaptive, is the principal lever for sample-efficient acquisition. We present evidence to the contrary in scanning transmission electron microscopy (STEM), an atomic-resolution imaging modality whose every measurement deposits damaging electron dose.

arXiv AI
Jun 9

Context-Aware Deep Learning for Defect Classification in Atomic-Resolution STEM

arXiv:2606. 09419v1 Announce Type: cross Abstract: Artificial intelligence is rapidly advancing materials characterization, yet most applications in electron microscopy rely solely on image contrast, overlooking the chemical and experimental context that shapes image formation.

By Jiadong Dan, Cheng Zhang, Leyi Loh, Ivan Verzhbitskiy, Yuan Chen, Goki Eda, Michel Bosman, N. Duane Loh
arXiv Computer Vision
Sep 23

Real-Time Atomic-Resolution Electron Phase Imaging without Probe Calibration via Ptychography-Supervised Learning

The paper introduces a ptychography‑supervised learning framework that transforms 4D‑STEM data into real‑time atomic‑resolution phase images. By training a compact model on physics‑constrained reference phase maps from a single AuPd dataset, the method predicts local phase patches directly from diffraction patterns without probe calibration or iterative optimization. The resulting workflow achieves an online latency of ~0.27 ms per probe position, a 1,000‑fold speed‑up over GPU‑accelerated ePIE, and maintains atomic‑scale lattice contrast while generalizing across materials, defocus conditions, and instruments.

By H. Yue, C. -C. Chen, C. -N. Hsiao, J. Cheng, Y. Liu, X. Z. Liao, Steve F. Shu
arXiv Machine Learning
Sep 3

Scalable Bayesian Optimization of Composite Functions for Image-Based Inverse Problems in Materials Characterization

The paper introduces Scalable Bayesian Optimization of Composite Functions (SBOCF) for efficiently estimating physical parameters from scientific images, specifically targeting electron microscopy PACBED patterns. SBOCF leverages the composite structure of the image-matching objective, reducing modeled outputs from 24,649 to 11 by using patch-level summaries and correction terms. With only 50 simulator evaluations, SBOCF outperformed standard Bayesian optimization, achieving up to 290× lower median SSE on synthetic SrTiO3 benchmarks and producing accurate parameter estimates on experimental data without task-specific pretraining.

By Dasol Yoon, Poompol Buathong, Chia-Hao Lee, Yujia Zhang, David A. Muller, Peter I. Frazier
arXiv AI
Jul 28

AutoMat: Enabling Automated Crystal Structure Reconstruction from Microscopy via Agentic Tool Use

arXiv:2505. 12650v2 Announce Type: replace-cross Abstract: Reconstructing atomistic crystal structures from a single noisy STEM projection is an ill-posed inverse problem: multiple lattices can explain similar contrast, and purely feed-forward models cannot verify physical validity.

By Yaotian Yang, Yiwen Tang, Yizhe Chen, Xiao Chen, Jiangjie Qiu, Hao Xiong, Haoyu Yin, Zhiyao Luo, Yifei Zhang, Sijia Tao, Wentao Li, Qinghua Zhang, Yuqiang Li, Wanli Ouyang, Bin Zhao, Xiaonan Wang, Fei Wei
arXiv Machine Learning
Jun 10

Unsupervised Deep Learning for Limited-Angle STEM-EDX Tomography -- Application to 3D Chemical Analysis of Phase-Change Memory Devices

arXiv:2606. 10547v1 Announce Type: cross Abstract: Energy Dispersive X-ray (EDX) tomography in Scanning Transmission Electron Microscopy (STEM) enables 3D compositional and elemental mapping at the nanoscale, but its use is limited by restricted tilt ranges and low-dose conditions required to avoid beam damage.

By Daniel del Pozo Bueno, Serge Brosset, Theo Monniez, Gabriele Navarro, Philippe Ciuciu, Zineb Saghi
arXiv Computer Vision
Sep 7

BEAM3R: Beam's-eye-view architecture with Mamba-3 for implicit dose reconstruction

BEAM3R is a dose estimation framework that operates in beam’s-eye-view (BEV) for both photon and proton beamlet calculations. It uses a Mamba‑3 state‑space depth‑sequence core combined with physics‑based transport conditioning, sharing a 2D CNN encoder‑decoder architecture to process per‑plane BEV slices. The system achieves high accuracy on the DoseRAD2026 challenge, with local gamma pass rates above 96% for CT‑based models and runtimes under 25 s for photon and 18 s for proton predictions.

By Chen Cheng, Michael Ferraro, James Grover, David E J Waddington, Emily Hewson
arXiv AI
Aug 28

Agentic AI for operating scientific instruments for nanoscale characterization

The paper introduces an agentic-AI framework that autonomously operates an atomic force microscope (AFM) by integrating a large language model with instrument functions via the Model Context Protocol. Three MCP-based agents—AFM Messenger, AFM Pilot, and AFM Doctor—translate natural‑language instructions into commands, assess and adjust image quality, and diagnose artifacts with transparent post‑processing, respectively. Benchmarking shows that the guarded execution layer eliminates wrong‑command execution, and live experiments demonstrate that the AI matches expert operators in image quality and efficiency.

By Zahra Ayar, Marcos Penedo, Mahdi Mehdikhani, Nahid Hosseini, Prabhu Prasad Swain, Georg E. Fantner
Hugging Face Trending Papers
Aug 27

Dose-PlanNet: Physics Based Radiotherapy Dose Prediction with Deep Learning

Dose-PlanNet is a physics-guided 3D deep learning model that predicts radiotherapy dose distributions for prostate cancer, aiming to automate complex treatment planning. In a prospective trial, the model achieved comparable target coverage while slightly reducing target homogeneity, yet it significantly improved high-dose organ‑at‑risk sparing. Automated plans met clinical acceptance criteria in most cases across both moderate hypofraction and stereotactic body radiation therapy arms.