Berkeley AI Research
May 8
Adaptive Parallel Reasoning: The Next Paradigm in Efficient Inference Scaling
apr-fig { text-align: center; margin: 1. 35em 0; line-height: 1.
Teaching LLMs to Update Beliefs for Efficient Long-Horizon Interaction
abbel-fig { display: block; text-align: center; margin: 2. 4em 0; line-height: 1.
Related stories
Berkeley AI Research
Apr 20
Gradient-based Planning for World Models at Longer Horizons
grasp-results-table table { font-size: 0. 875rem; line-height: 1.
arXiv Computer Vision
Aug 31
Doc-CoB: Enhancing Document Understanding with Visual Chain-of-Boxes Reasoning
Doc‑CoB introduces a Chain‑of‑Boxes framework that enhances document understanding by progressively focusing on query‑relevant layout regions while preserving global context. It selects key layout boxes and then applies visual prompting for deeper analysis, supported by two new reasoning tasks and an automatic pipeline that generates 249k training samples with intermediate visual supervision. Experiments across seven benchmarks and four popular models demonstrate significant performance gains, underscoring the method’s effectiveness and broad applicability.
arXiv AI
Aug 11
What to Edit Next: Visually Aligned Image-Editing Follow-Up Suggestions in Conversational Systems
arXiv:2608. 07565v1 Announce Type: cross Abstract: Conversational assistants increasingly recommend follow-up edits to help users continue a task.
Google AI Blog
Mar 14, 2024
Cappy: Outperforming and boosting large multi-task language models with a small scorer
Posted by Yun Zhu and Lijuan Liu, Software Engineers, Google Research Large language model (LLM) advancements have led to a new paradigm that unifies various natural language processing (NLP) tasks within an instruction-following framework. This paradigm is exemplified by recent multi-task LLMs, such as T0 , FLAN , and OPT-IML .
Simon Willison
Aug 29
Introducing Hy4 Preview
Simon Willison introduces Hy4 Preview, a new large language model from Tencent featuring 770 B total parameters, 49 B active parameters, a 1 M token context window, and 1.56 TB of storage on Hugging Face. The release marks a significant increase over Hy3, which had 295 B total parameters, 21 B active parameters, a 256 k token context window, and 598 GB of storage. Willison also shares the model’s chat template, highlighting two reasoning effort levels—‘high’ (default) and ‘no_think’—and demonstrates a sample prompt that showcases the model’s reasoning trace. whyItMatters":"The article provides concrete details on Hy4’s scale and configuration, illustrating Tencent’s advancement in large‑language‑model capabilities and offering practical insights into its usage through the chat template and reasoning settings."
arXiv Machine Learning
Jun 3
Training-Free Multi-Concept LoRA Composition with Prompt-Aware Weighting
arXiv:2606. 03792v1 Announce Type: cross Abstract: Low-Rank Adaptation (LoRA) successfully enables personalization in text-to-image generation by adapting pre-trained diffusion models to specific visual concepts and styles.
arXiv Computer Vision
Sep 28
Preserve-and-Compose Training for Composed Image Retrieval
The paper introduces Preserve-and-Compose Training (PACT) for composed image retrieval, a task where a query image is modified by a textual instruction while preserving visual content from a reference image. PACT learns from image–text–text triplets, using target captions for supervision and visual evidence from the source image to maintain relevant details, without requiring target images or gallery updates. The authors also propose Chord scoring, which blends target similarity with source-relative directional agreement in a frozen image space, and demonstrate that this combined approach yields strong retrieval performance across multiple zero-shot CIR benchmarks and various backbones.
arXiv AI
6d ago
FigAct: Turning Scientific Figures into Active Canvases for Explanation
FigAct transforms static scientific figures into question‑conditioned visual presentations by acting directly on existing graphical elements. The framework generates short narrations, grounds each narration in visual evidence, and applies visual actions to guide viewer attention, mimicking a human presenter. A hierarchical search strategy reduces token usage by about 40×, and FigAct‑8B is trained with rewards for grounding accuracy, search efficiency, and rendering quality, evaluated on a human‑verified benchmark of real‑world scientific figures.
arXiv AI
Aug 7
CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generation
arXiv:2603. 08652v2 Announce Type: replace Abstract: Recent advancements in Unified Multimodal Models (UMMs) have significantly advanced text-to-image (T2I) generation, particularly through the integration of Chain-of-Thought (CoT) reasoning.
arXiv AI
Jun 19
GLARE: A Natural Language Interface for Querying Global Explanations
arXiv:2606. 19735v1 Announce Type: new Abstract: While global explanations are crucial for understanding vision models across datasets, classes, and decision contexts, their complex and monolithic nature often hinders practical exploration.
Hugging Face Trending Papers
Aug 5
CoCo-IR: Contextual Composed Image Retrieval
Current instruction-based image retrieval systems are powerful but limited to single-turn interactions, failing to capture the iterative nature of complex, real-world visual searches. To overcome this limitation, we introduce Contextual Composed Image Retrieval (CoCo-IR), a novel task that enables users to progressively refine search results through interactions.