arXiv Computer Vision

High-Fidelity Synthetic Transmission Electron Microscopy Image Generation Using Diffusion Probabilistic Models for Data-Limited Semiconductor Metrology

arXiv AI
Jun 9

Context-Aware Deep Learning for Defect Classification in Atomic-Resolution STEM

arXiv:2606. 09419v1 Announce Type: cross Abstract: Artificial intelligence is rapidly advancing materials characterization, yet most applications in electron microscopy rely solely on image contrast, overlooking the chemical and experimental context that shapes image formation.

By Jiadong Dan, Cheng Zhang, Leyi Loh, Ivan Verzhbitskiy, Yuan Chen, Goki Eda, Michel Bosman, N. Duane Loh
arXiv Machine Learning
Oct 23

SciFusion: Physics-Guided Compositional Diffusion for Multimodal 3D Scientific Image Generation

SciFusion is a multimodal framework that uses a latent diffusion backbone to generate unified 3D scientific images. It introduces a compositional conditioning scheme that separates each modality into domain, object, and contrast representations, allowing knowledge transfer and zero‑shot synthesis of unseen compositions. The model also incorporates physics‑informed objectives specific to MRI, CT, and electron microscopy to ensure generated images respect modality‑dependent image formation processes, and demonstrates improved fidelity and cross‑domain generalization across 15 imaging modalities.

By Luoxi Wang, Alessio Quercia, Hanno Scharr, Arya Bangun
Hugging Face Trending Papers
Jun 28

STEMGym: Benchmarking Sequential Decision-Making under Dose Budgets in Autonomous Electron Microscopy

A central premise of autonomous scientific imaging is that smarter navigation, whether Bayesian, RL-based, or otherwise adaptive, is the principal lever for sample-efficient acquisition. We present evidence to the contrary in scanning transmission electron microscopy (STEM), an atomic-resolution imaging modality whose every measurement deposits damaging electron dose.

arXiv AI
Oct 7

D3S2: Diffusion-Guided Dataset Distillation for Semantic Segmentation

The paper introduces D3S2, a diffusion‑guided dataset distillation framework tailored for semantic segmentation. It tackles long‑tailed class imbalance, pixel‑wise alignment, and high computational cost by first selecting class‑balanced masks and then synthesizing images with a pretrained diffusion model conditioned on those masks. Guided diffusion sampling further refines the data with segmentation‑consistency and class‑wise feature matching losses, achieving superior performance at a 1% compression rate on ADE20K and COCO‑Stuff.

By Wenjie Zheng, Haoji Hu, Jiali Lu, Xingze Zou, Jing Wang
arXiv Computer Vision
Oct 28

Spatial-Frequency Learning for Scanning Transmission Electron Microscopy Image Enhancement

The paper introduces a spatial-frequency learning framework for enhancing Scanning Transmission Electron Microscopy (STEM) images. It employs a spatial-frequency fusion network that separately enhances features in the spatial and frequency domains before fusing them, leveraging periodic atomic arrangements in the frequency domain and local atomic details in the spatial domain. Additionally, the authors present a STEM noise calibration method to synthesize realistic images, creating a diverse dataset that improves performance on synthetic and real advanced material images, including better atomic localization accuracy.

By Hesong Li, Ying Fu, Ziqi Wu, Ruiwen Shao, Tao Zhang