Towards Data Science

Jigsaw Jeeves: Building a Puzzle Assistant using Computer Vision

The article titled "Jigsaw Jeeves: Building a Puzzle Assistant using Computer Vision" provides a conceptual overview and a step‑by‑step walkthrough of a solution approach implemented in Python. It explains how computer vision techniques can be applied to assist users in solving jigsaw puzzles, detailing the design and implementation choices made in the project. The post serves as a practical guide for developers interested in combining vision algorithms with puzzle‑solving applications.

arXiv AI
Aug 5

JigShape: Evaluating Visual-Geometric Reasoning in VLMs through Jigsaw Puzzles

arXiv:2607. 27670v2 Announce Type: replace-cross Abstract: Jigsaw puzzle solving requires jointly reasoning about visual content and geometric constraints, yet existing benchmarks use rectangular cuts that create ambiguous ground truth in texture-repeated regions.

By Shawn Li, Wei Yang, Jike Zhong, Jiate Li, Jiawei Yang, You Qin, Ryan Rossi, Franck Dernoncourt, Roger Zimmermann, Yue Wang, Zhengzhong Tu, Vicente Ordonez, Mohit Bansal, Yue Zhao
arXiv AI
Aug 11

Self-Evolving Neuro-Symbolic Skills for Tool-Augmented Spatial Reasoning

arXiv:2608. 07955v1 Announce Type: new Abstract: Large vision-language models have achieved strong performance in multimodal reasoning, but they remain unreliable on fine-grained spatial tasks that demand both precise spatial perception and fine-grained geometric computation beyond end-to-end generation.

By Shi-Yu Tian, Zhuo-Xia Wang, Xuan-Yi Zhu, Zhi Zhou, Xinwei Yang, Kun-Yang Yu, Ming Yang, Yang Chen, Yu-Feng Li
Google AI Blog
Mar 18, 2024

MELON: Reconstructing 3D objects from images with unknown poses

Posted by Mark Matthews, Senior Software Engineer, and Dmitry Lagun, Research Scientist, Google Research A person's prior experience and understanding of the world generally enables them to easily infer what an object looks like in whole, even if only looking at a few 2D pictures of it. Yet the capacity for a computer to reconstruct the shape of an object in 3D given only a few images has remained a difficult algorithmic problem for years.

By Google AI
arXiv AI
Jul 29

Visual prompt engineering for video models

arXiv:2607. 25537v1 Announce Type: cross Abstract: In the age of foundation models, a model is only as good as its prompt.

By Robert Geirhos, Yuxuan Li, Thadd\"aus Wiedemer, Neha Kalibhat, Zi Wang, Mani Malek, Oyvind Tafjord, Kevin Swersky, Been Kim, Priyank Jaini
Simon Willison
Sep 5

Using Blender with coding agents on macOS

Simon Willison demonstrates how to use Blender with coding agents on macOS by installing the full Mac application from blender.org and issuing prompts to ChatGPT Codex. He shows a step-by-step example where the agent renders a scene of a pelican riding a bicycle, then adds background flair and improves the image. The resulting image is generated via Blender's Python API.

Google AI Blog
Mar 19, 2024

ScreenAI: A visual language model for UI and visually-situated language understanding

Posted by Srinivas Sunkara and Gilles Baechler, Software Engineers, Google Research Screen user interfaces (UIs) and infographics, such as charts, diagrams and tables, play important roles in human communication and human-machine interaction as they facilitate rich and interactive user experiences. UIs and infographics share similar design principles and visual language (e.

By Google AI