arXiv Machine Learning June 9, 2026 By Jiechen Huang, Hector R. Rodriguez, Dingcheng Yang, Zuochang Ye, Yibo Lin, Wenjian Yu

AttentionCap: Transformer Based Capacitance Matrix Learning Toward Full-Chip Extraction

Read the original on arXiv Machine Learning →

arXiv:2606. 08161v1 Announce Type: new Abstract: As capacitance extraction accuracy of rule-based pattern matching becomes difficult to sustain at advanced nodes, a growing trend emerges to develop deep-learning-based 2D capacitance models.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jul 28

Flash-CNNCap: Capacitance Extraction via Image Mapping

arXiv:2607. 23877v1 Announce Type: new Abstract: We present Flash-CNNCap, a CNN-based capacitance extractor that reformulates full-matrix capacitance prediction as image-to-image regression over spatial contribution maps.

By Hector R. Rodriguez, Jiechen Huang, Wenjian Yu

benchmarks

arXiv Machine Learning

Jun 5

Exact Linear Attention

arXiv:2605. 18848v3 Announce Type: replace Abstract: This paper introduces Exact Linear Attention (ELA), a mechanism that achieves linear computational complexity for Transformer attention by exploiting the exact decomposition property of kernel functions, thereby eliminating approximation error.

By Weinuo Ou

llms computer-vision reinforcement-learning efficiency safety

arXiv Machine Learning

Aug 5

Sparse Weight Decomposition for Efficient Circuit Extraction

arXiv:2608. 03913v1 Announce Type: new Abstract: Dense pretrained transformers do not naturally expose interpretable units for circuit extraction.

By Chuanhao Yan, Xuhan Huang, Yawen Duan, Zhenfei Yin, Hang Zhao, Bryan Dai, Jie Fu

llms fine-tuning benchmarks safety

arXiv Machine Learning

Jun 4

Breaking the Scale Barrier: One-Shot Knowledge Transfer via Frequency Transform

arXiv:2603. 07523v3 Announce Type: replace Abstract: Transferring knowledge by fine-tuning large-scale pre-trained networks has become a standard paradigm for downstream tasks, yet the knowledge of a pre-trained model is tightly coupled with monolithic architecture, which restricts flexible reuse across models of varying scales.

By Jianlu Shen, Fu Feng, Yucheng Xie, Jiaqi Lv, Xin Geng

fine-tuning benchmarks

arXiv AI

Jun 19

ITNet: A Learnable Integral Transform That Subsumes Convolution, Attention, and Recurrence

arXiv:2606. 19538v1 Announce Type: new Abstract: Convolutional networks, recurrent networks, and transformers each encode different inductive biases -- locality, sequential memory, and content-dependent pairwise interaction -- and have remained mathematically distinct since their inception.

By Ashim Dhor, Rasel Mondal, Pin Yu Chen

llms

arXiv AI

Jun 30

Emergence of Minimal Circuits for Indirect Object Identification in Attention-Only Transformers

arXiv:2510. 25013v2 Announce Type: replace-cross Abstract: Mechanistic interpretability aims to reverse-engineer large language models (LLMs) into human-understandable computational circuits.

By Rabin Adhikari

llms rag benchmarks safety

Related stories

Flash-CNNCap: Capacitance Extraction via Image Mapping

Exact Linear Attention

Sparse Weight Decomposition for Efficient Circuit Extraction

Breaking the Scale Barrier: One-Shot Knowledge Transfer via Frequency Transform

ITNet: A Learnable Integral Transform That Subsumes Convolution, Attention, and Recurrence

Emergence of Minimal Circuits for Indirect Object Identification in Attention-Only Transformers