arXiv Computer Vision By Jagadish Kashinath Kamble, Jayanta Mukhopadhyay, Debaditya Roy, Partha Pratim Das

Mudragen: Geometrically Supervised Generation of Interacting Two-Hand Mudras for Preserving Indian Classical Dance Heritage

Read the original on arXiv Computer Vision →

MudraGen is a conditional diffusion framework that generates realistic RGB images of Samyukta Hasta mudras, the two‑hand gestures used in Bharatanatyam. It introduces geometry‑aware supervision through three objectives—Keypoint Loss, Joint Offset Loss, and Shape Consistency—to ensure anatomical validity, inter‑hand coordination, and cultural nuance. The model outperforms existing generative approaches in visual realism, anatomical correctness, and fine hand‑pose structure, enabling faithful reproduction of complex mudras.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Aug 31

SignRR: Retrieve and Refine Real Motion for Sign Language Production

SignRR is a new sign language production framework that combines retrieval of real sign motion segments with a learned refinement step to produce globally coherent signing sequences. It starts from a dictionary of authentic sign segments and refines them using a part-aware Residual VQ‑VAE, preserving fine hand articulation while handling temporal length differences in latent space. Experiments on PHOENIX14T and CSL‑Daily demonstrate state‑of‑the‑art back‑translation performance and competitive pose quality.

By Fidel Omar Tito Cruz, Angie Sanchez Marquina, Summy Farfan, Gissella Bejarano
arXiv Computer Vision
Sep 15

SignMimic: Robust High-Quality Sign Language Motion Generation via Human-Shape-Oblivious Pose Transfer Guidance

arXiv:2609.14122v1 Announce Type: new Abstract: We study the challenge of sign language video mimicking: given a driving video and a single reference frame, synthesize a video where the target signer...

By Zhewen He (New York University Abu Dhabi), Junyi Yu (New York University Abu Dhabi), Haomian Huang (New York University Abu Dhabi), Zhenhua Li (ChatSign Technology), Yi Fang (New York University Abu Dhabi, ChatSign Technology)