Towards Data Science

The Power and Pitfalls of Vector-Based Image Search

A hands-on guide to setting up image similarity search in Milvus, and why visual replication isn't always enough. The post The Power and Pitfalls of Vector-Based Image Search appeared first on Towards Data Science .

Google AI Blog
Feb 23, 2024

VideoPrism: A foundational visual encoder for video understanding

Posted by Long Zhao, Senior Research Scientist, and Ting Liu, Senior Staff Software Engineer, Google Research An astounding number of videos are available on the Web, covering a variety of content from everyday moments people share to historical moments to scientific observations, each of which contains a unique record of the world. The right tools could help researchers analyze these videos, transforming how we understand the world around us.

By Google AI
arXiv AI
Jul 21

ColGraphRAG: Late-Interaction Evidence Retrieval for Multimodal GraphRAG

arXiv:2607. 16208v1 Announce Type: new Abstract: Graph-grounded multimodal question answering organizes text, tables, and images in a structured evidence graph, yet end-to-end accuracy depends on which multimodal assets are ranked highly enough to enter downstream reasoning; for graph-linked images, single-vector bi-encoder similarity can discard patch- and token-level structure needed for fine-grained alignment.

By Seonok Kim
Google AI Blog
Mar 13, 2024

Health-specific embedding tools for dermatology and pathology

Posted by Dave Steiner, Clinical Research Scientist, Google Health, and Rory Pilgrim, Product Manager, Google Research There’s a worldwide shortage of access to medical imaging expert interpretation across specialties including radiology , dermatology and pathology . Machine learning (ML) technology can help ease this burden by powering tools that enable doctors to interpret these images more accurately and efficiently.

By Google AI
Hugging Face Trending Papers
Jul 6

Do All Visual Tokens Matter Equally? Object-Evidence Preserving Token Merging for Vision-Language Retrieval

Multi-vector vision-language retrieval preserves fine-grained visual evidence through maximum-similarity late interaction, but dense image-side tokens make storage and scoring expensive. Existing token compression methods reduce this cost, yet they can remove or collapse object- and region-level evidence that future query tokens may need to select.

arXiv Machine Learning
Aug 4

DODA: A Database of Datasets for Aesthetics Research

arXiv:2608. 00089v1 Announce Type: cross Abstract: With rapid growth in the fields of empirical and computational aesthetics we have seen a vast increase in large image datasets annotated for aesthetics.

By Lisa Ko{\ss}mann, Ralf Bartho, Christoph Redies, Johan Wagemans
Google AI Blog
Mar 19, 2024

SCIN: A new resource for representative dermatology images

Posted by Pooja Rao, Research Scientist, Google Research Health datasets play a crucial role in research and medical education, but it can be challenging to create a dataset that represents the real world. For example, dermatology conditions are diverse in their appearance and severity and manifest differently across skin tones.

By Google AI