arXiv:2511.23120v2 Announce Type: replace
Abstract: Pretrained transformers provide rich, general-purpose embeddings, which are transferred to downstream tasks. However, current transfer strategies:...
By Pankhil Gawade, Adam Izdebski, Myriam Lizotte, Kevin R. Moon, Jake S. Rhodes, Guy Wolf, Ewa Szczurek
arXiv:2608. 08182v1 Announce Type: cross Abstract: Machine learning models for MALDI-TOF mass spectrometry have shown considerable promise for clinical microbiology tasks such as microbial identification and antimicrobial resistance prediction.
By Alejandro L. Garc\'ia-Navarro, Carlos Sevilla-Salcedo, Bel\'en Rodr\'iguez-S\'anchez, Vanessa G\'omez-Verdejo
FLaG (Frequency‑Domain Latent‑attention Gated Pooling) is a plug‑in token‑aggregation module that transforms encoder outputs into the Fourier domain, summarizes spectral tokens with learnable latent queries, applies a sample‑conditioned channel gate, and reconstructs modulated token representations for downstream pooling. The method is evaluated on antimicrobial peptide activity prediction, CIFAR‑10/100 image classification, and several RoBERTa language tasks, achieving state‑of‑the‑art performance on most metrics. Analyses show that FLaG emphasizes low‑frequency components while selectively amplifying high‑frequency signals in later layers, providing a transferable frequency‑domain bias across protein, visual, and textual representations.
By Kewei Li, Rongying Zhang, Xueli Wang, Xiwen Gong, Zhongjian Wang, Qiuchen Zhao, Lan Huang, Ruochi Zhang, Fengfeng Zhou
arXiv:2504. 17247v3 Announce Type: replace Abstract: Deep learning-based antimicrobial peptide (AMP) discovery faces critical challenges such as limited controllability, lack of representations that efficiently model antimicrobial properties, and low experimental hit rates.
By Diogo Soares, Leon Hetzel, Paulina Szymczak, Marcelo Der Torossian Torres, Johanna Sommer, Cesar de la Fuente-Nunez, Fabian Theis, Stephan G\"unnemann, Ewa Szczurek
arXiv:2606. 08191v1 Announce Type: cross Abstract: Token aggregation is a common bottleneck in models that map token representations to sample-level predictions, yet most pooling methods operate only in the original token domain.
By Kewei Li, Rongying Zhang, Xueli Wang, Xiwen Gong, Zhongjian Wang, Lan Huang, Ruochi Zhang, Fengfeng Zhou
Target-specific peptide design requires sequence and structure co-design under full atom geometric constraints. Latent generative frameworks offer an effective route for this problem by compressing fine grained atomic structures into block level latent representations and performing conditional generation in a compact latent space.