← Back to all news
arXiv Machine Learning By Bogdan Toader, Kiarash Jamali, Tanmay A. M. Bharat, Sjors H. W. Scheres

The microscope is the mask: privileged views and labels from a cryo-ET forward model

Read the original on arXiv Machine Learning →

The paper introduces CARNIVAL, a model for protein annotation in cryo-electron tomography (cryo-ET) volumes that leverages simulated data and a forward model to generate domain‑specific augmented paired views for self‑supervised training. By incorporating simulation‑derived protein positions and identities into the architecture and loss function, the model localises semantic information at protein locations. CARNIVAL is evaluated on real tomograms without finetuning and outperforms a state‑of‑the‑art contrastive model that lacks forward‑model paired views or privileged information.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Machine Learning
Jun 10

POPSICLE: Benchmark Datasets for Segmentation and Localization in CryoET

arXiv:2606. 10255v1 Announce Type: cross Abstract: Cryo-electron tomography (cryoET) has emerged as a powerful tool in structural and cellular biology by enabling direct visualization of macromolecular structures within intact cells, thereby linking molecular architecture to cellular organization in a native context.

By Jonathan Schwartz, Utz Heinrich Ermel, C. Braxton Owens, Zhuowen Zhao, Ariana Peck, Gus L. W. Hart, Grant J. Jensen, Bridget Carragher, Dari Kimanius
computer-visionbenchmarks
More like this →
arXiv AI
4d ago

Atelier: Learning Local Self-Supervised Features for CryoEM Volumes via Hypernetworks

Atelier is a self‑supervised framework that uses a transformer‑based hypernetwork to generate implicit neural representations (INRs) for cryo‑EM maps, enabling efficient, scale‑agnostic, coordinate‑conditioned feature extraction. Trained on 5,439 maps from the Electron Microscopy Data Bank, the pretrained INR provides continuous local feature fields that can be used as auxiliary channels for a 3D nested U‑Net, improving voxel‑level property prediction across eight tasks compared to a volume‑only baseline. The approach demonstrates that amortized INRs can serve as a geometry‑aware primitive for large‑scale cryo‑EM analysis.

By Phillip Lo, Sudarshan Babu, Dari Kimanius, Aly A. Khan
llmsnlp
More like this →