arXiv Machine Learning

Photonic convolutional neural network with pre-trained in situ training

arXiv:2604. 02429v2 Announce Type: replace-cross Abstract: Convolutional neural networks (CNNs) have transformed image processing, but the energy consumption and inference latency of electronic based implementations remain fundamental bottlenecks.

arXiv AI
Jul 23

Opto-ViT-v2: Noise-Resilient On-Chip Fine-Tuning for Photonic Near-Sensor Vision Transformer Accelerators

arXiv:2607. 19421v1 Announce Type: cross Abstract: Silicon-photonic (SiPh) accelerators have emerged as a promising platform for Vision Transformer (ViT) inference by performing matrix multiplications on microring-resonator (MRR) banks with high throughput and energy efficiency.

By Xuming Chen, Deniz Najafi, Mehrdad Morsali, Chengwei Zhou, Zahra Ghanaatianjobzari, Mahdi Nikdast, Shaahin Angizi, Gourav Datta
arXiv Computer Vision
Sep 14

Adaptive AI: Energy Efficient Multi-exit TinyML on Intelligent Vision Systems at the Edge

The paper presents a novel multi‑exit computational scheme for TinyML on an ultra‑low‑power GAP9 SoC, adding confidence‑based gating points to a MobileNetV2 CNN for ImageNet‑100. By allowing inference to stop early, the approach cuts average MAC operations by 41 % (from 313 MMAC to 185 MMAC), reduces inference time by 29 % (49 ms to 35 ms), and saves 24 % in energy (2.1 mJ to 1.6 mJ per frame) with only a ~1 % drop in accuracy. Compared to a state‑of‑the‑art adaptive CNN on the same hardware, the method more than doubles computational efficiency, raising MAC/cycle from 8.1 to 17.2.

By Luca Crupi, Lorenzo Lamberti, Alessandro Giusti, Daniele Palossi
arXiv Machine Learning
Jul 23

Q-PhotoNAS: Hybrid Quantum Neural Architecture Search Framework on Photonic Devices

arXiv:2605. 22097v2 Announce Type: replace-cross Abstract: Photonic quantum computing is a promising platform for scalable quantum machine learning, but designing effective hybrid architectures remains challenging under hardware and optimization constraints.

By Farah Elnakhal, Alberto Marchisio, Nouhaila Innan, Gabriel Falcao, Muhammad Shafique
arXiv AI
Jun 9

Optimizing Energy-based Neural Network Training with Coherent Ising Machine

arXiv:2606. 09117v1 Announce Type: cross Abstract: While Ising machines serve as advanced physical solvers for the Ising model,enabling applications in combinatorial optimization and neural network training,their scalability for large-scale neural networks remains constrained by hardware connectivity limitations and suboptimal training methodologies.

By Chen-Rui Fan, Bo Lu, Zhi-Hong Zhang, Run-Qing Zhang, Jing-Wei Wen, Chuan Wang
arXiv AI
Aug 25

MOCLIP: A Foundation Model for Large-Scale Nanophotonic Inverse Design

MOCLIP (Metasurface Optics Contrastive Learning Pretrained) is a nanophotonic foundation model that unifies metasurface geometry and spectra in a shared latent space using contrastive learning on an ImageNet‑1K–sized experimental dataset. It enables high‑throughput zero‑shot inverse design, predicting 0.2 million samples per second and allowing the design of a full 4‑inch wafer of high‑density metasurfaces in minutes. The model also supports generative latent‑space optimization with 97 % accuracy and demonstrates an optical information storage concept achieving 0.1 Gbit/mm², six times higher than commercial optical media.

By S. Rodionov, A. Burguete-Lopez, M. Makarenko, Q. Wang, F. Getman, A. Fratalocchi