arXiv AI
Aug 6
MemFly: On-the-Fly Memory Optimization via Information Bottleneck
arXiv:2602. 07885v2 Announce Type: replace Abstract: Long-term memory enables large language model agents to tackle complex tasks through historical interactions.
Large language models
Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.
arXiv AI
Aug 6
Mamba with Hierarchical Memory: Solving Representation Bottleneck in Long Sequence Modeling
arXiv:2608. 02347v2 Announce Type: replace Abstract: Recurrent linear attention models (RLAs) such as Mamba offer efficient linear-time sequence modeling as an alternative to Transformers, yet their fixed-capacity recurrent states limit long-sequence modeling.
arXiv AI
Aug 6
Topology-Aware Reasoning over Incomplete Knowledge Graph with Graph-Based Soft Prompting
arXiv:2604. 12503v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have shown remarkable capabilities across various tasks but remain prone to hallucinations in knowledge-intensive scenarios.
arXiv AI
Aug 6
Seeking Physics in Diffusion Noise
arXiv:2603. 14294v3 Announce Type: replace-cross Abstract: Do video diffusion models encode signals predictive of physical plausibility?
arXiv AI
Aug 6
DeepImagine: Clinical Trial Outcome Prediction via Stepwise Local Counterfactual Imaginations
arXiv:2604. 23054v2 Announce Type: replace-cross Abstract: Predicting the outcomes of prospective clinical trials remains a major challenge.
arXiv AI
Aug 6
VibeSearchBench: Benchmarking Long-horizon Proactive Search in the Wild
arXiv:2605. 27882v2 Announce Type: replace-cross Abstract: LLM-based agents score well on search benchmarks, yet real users consistently find results unsatisfying, revealing a persistent evaluation-experience gap.
arXiv AI
Aug 6
OneDayAgent: Towards a Long-Horizon Harness for Autonomous Agents
arXiv:2608. 05013v1 Announce Type: cross Abstract: LLM agents are increasingly applied to open-ended everyday requests that span work, study, and life.
arXiv Machine Learning
Aug 6
MALT: Lightweight Curvature-Aware Muon via Diagonal Preconditioning
arXiv:2608. 05088v1 Announce Type: new Abstract: Muon has recently emerged as a promising alternative to AdamW for language model pretraining by orthogonalizing momentum matrices using Newton-Schulz iterations.
arXiv AI
Aug 6
What We Observe as LLM Behavior Can Be a Side-effect of Inference Backend
arXiv:2608. 04714v1 Announce Type: cross Abstract: Benchmark scores are reported as properties of a model, yet the inference framework used to produce them, such as HuggingFace, vLLM, or Ollama, are considered non-influential and their names and versions are almost never disclosed.
arXiv AI
Aug 6
Protoreasoning in Tiny Transformers
arXiv:2608. 04980v1 Announce Type: cross Abstract: We show that tiny transformers can profitably employ a simple form of Chain of Thought, which we call protoreasoning, allowing us to study step-by-step reasoning on ~1M-parameter models and opening up opportunities for much more detailed experimentation and analysis than is feasible for larger models.
arXiv AI
Aug 6
RepairFormer: Automated Repair of Structured Inputs Using Transformers
arXiv:2608. 05060v1 Announce Type: cross Abstract: Structured input files such as JSON, DOT, OBJ, INI, S-expression, and TinyC are widely used in software systems, but small corruptions can cause parsers to reject otherwise useful data.
arXiv AI
Aug 6
Instruction-Conditioned Exploration for Reinforcement Learning with Self-Distillation to an Unconditioned Policy
arXiv:2608. 02087v2 Announce Type: replace Abstract: Post-training Large Language Models (LLMs) with Reinforcement Learning (RL) has become an important tool for improving model capabilities, but the LLM action-space structure introduces challenges distinct from classical RL, with implications for inducing exploration.
arXiv AI
Aug 6
Large-Small Model Collaboration for Enhancing Edge-Deployed Small Models
arXiv:2503. 10367v2 Announce Type: replace-cross Abstract: Edge devices host domain-specific small language models (SLMs) with limited resources, while private clouds offer larger LLMs.
arXiv AI
Aug 6
COMPAS: Difficulty-Aware Joint Search for Optimizing Code Generation
arXiv:2608. 04336v1 Announce Type: cross Abstract: Code generation systems make each LLM call with a model, a prompt, and decoding settings.
arXiv AI
Aug 6
Can Post-Training Transform LLMs into Causal Reasoners?
arXiv:2602. 06337v2 Announce Type: replace-cross Abstract: Causal inference is essential for decision-making but remains challenging for non-experts.
arXiv AI
Aug 6
CIDR: A Large-Scale Industrial Source Code Dataset for Software Engineering Research
arXiv:2605. 12153v2 Announce Type: replace-cross Abstract: We present the Curated Industrial Developer Repository (CIDR), a large-scale dataset of real-world software repositories collected from industrial partners.
arXiv Machine Learning
Aug 6
Attention-Only White-Box Transformer via LeJEPA-Based Self-Supervised Pretraining
arXiv:2608. 04213v1 Announce Type: new Abstract: Existing studies on self-supervised learning for white-box networks typically decouple the derivation of white-box networks via optimization algorithms from self-supervised learning paradigms.
arXiv AI
Aug 6
Patients-like-me: A Variational LM--GNN Framework for Explainable Clinical Prediction
arXiv:2608. 04193v1 Announce Type: cross Abstract: Language models (LMs) offer strong textual representations for electronic health records (EHRs), but they encode patient sequences in isolation and provide limited explainability.
arXiv Machine Learning
Aug 6
Attention, Anomalies! Handling Attention Layers in Unsupervised Federated Outlier Detection
arXiv:2608. 04753v1 Announce Type: new Abstract: Attention layers are the backbone of today's most powerful and impactful models.
arXiv AI
Aug 6
MERaLiON-GR: Speech Gender Recognition Model for English and SEA Languages
arXiv:2608. 04433v1 Announce Type: cross Abstract: We present MERaLiON-GR, a speech gender recognition system that performs binary classification (female / male) on English and Southeast Asian (SEA) languages.