arXiv AI
Text-Driven Artistic Staging: Pose, Lighting, and Camera References from Paintings
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Sep 16
Text-Driven Artistic Staging: 3D Posing, Lighting, and Camera References from Paintings
The paper presents a method for generating 3D staging—human poses, lighting, and camera setup—directly from affective textual descriptions. It builds a dataset of 11,911 text–staging pairs derived from 2,328 figurative paintings, reconstructing SMPL bodies, estimating illumination, and recovering camera parameters. A flow‑matching transformer is trained to produce variable‑size scenes and multiple staging alternatives, achieving a 32.2% retrieval R@1 on held‑out prompts, outperforming a CLIP‑based baseline.
arXiv Computer Vision
Aug 25
ReART: Reference-Guided Retrieval and Refinement for Emotion-Aware Art Generation
arXiv:2608.22329v1 Announce Type: cross Abstract: Emotion-aware artistic image generation requires a model to satisfy semantic content, artistic style, and target emotion simultaneously. The key chal...
arXiv AI
Jun 10
CANVAS: Captioning Art with Narrative Visual-Audio AI Systems
arXiv:2606. 09846v1 Announce Type: cross Abstract: Visual art remains largely inaccessible to blind and low-vision (BLV) audiences due to brief or absent alt-text, which rarely conveys the sensory, spatial, or emotional qualities of an artwork.
arXiv Computer Vision
Sep 22
Beyond Emotion Prompts: Fine-Grained Text-to-Image Generation Driven by Valence-Arousal-Dominance
arXiv:2609.24215v1 Announce Type: new Abstract: Although text-to-image models can accurately depict subjects and scenes, creators still struggle to specify the fine-grained emotions an image should c...
arXiv Computer Vision
Aug 24
CogCanvas: A Benchmark for Evaluating Multi-Subject Reference-Based Image Generation
CogCanvas is a new benchmark for multi-subject reference-based image generation, featuring 1,952 curated reference images of 100 celebrities, 115 objects/fashion items, and 29 real-world backgrounds. It generates 1,361 compositional prompts with 2–5 people, using a pipeline that includes DINOv2 deduplication, aesthetic filtering, and automated graph derivation for interaction and positioning. The benchmark evaluates three tasks—reference-based multi-human-object generation, text-to-image compositional generation, and reference retrieval—under a six-axis protocol, and introduces BG‑Sim and Attr‑VQA metrics to assess background fidelity and attribute binding.
Hugging Face Trending Papers
Jul 14
DiTailed: Ensuring Visual Object Consistency in Text-Image-to-Image Flow Matching Models
Despite remarkable progress in text-guided image editing, generative models frequently fail to preserve visual object consistency, defined as the preservation of a subject's key attributes throughout the editing process. We address this limitation through three contributions.