← Back to all news
arXiv Computation and Language By Thapelo Sindane, Unarine Netshifhefhe, Vukosi Marivate, Abiodun Modupe, Herkulaas Combrink, Ketro Sithole

Maswao: An automatically collected, prepared, and benchmarked dataset for South African Sign Language

Read the original on arXiv Computation and Language →

The paper introduces Maswao, a dataset of South African Sign Language (SASL) created through automated collection and preparation of video content from public sources, minimal human labor, and weak sentence alignment using audio-to-text ASR and motion analysis. The authors benchmark the dataset on sign‑to‑text translation, showing Transformer models outperform recurrent baselines with BLEU‑1 to BLEU‑4 scores ranging from 13.78 to 1.54. The study highlights the potential of automated dataset creation for under‑represented sign languages and demonstrates promising translation results that encourage further research.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

Related stories

arXiv Computation and Language
Nov 4

Maswao: An automatically collected, prepared, and benchmarked dataset for the South African Sign language

The paper introduces Maswao, a new dataset for South African Sign Language (SASL) created through automated collection and preparation of video content from public sources. The authors convert accompanying audio to text, crop sign regions, and use gradient descent to segment sentences, producing weakly sentence-aligned parallel corpora. They benchmark this dataset on sign-to-text translation, showing Transformer models outperform recurrent baselines with BLEU-1 to BLEU-4 scores up to 13.78, 5.21, 2.52, and 1.54, respectively.

By Thapelo Sindane, Unarine Netshifhefhe, Vukosi Marivate, Abiodun Modupe, Herkulaas Combrink, Ketro Sithole
llmscomputer-visionmultimodalbenchmarks
More like this →
arXiv Machine Learning
Jun 11

Corpus Augmentation for Sign Language Translation via LLM-Guided Video Stitching

arXiv:2606. 11925v1 Announce Type: cross Abstract: Sign language translation (SLT) converts sign language video into spoken language text and holds significant promise for improving accessibility and enabling communication between signing and non-signing communities.

By Zsolt Robotka, \'Ad\'am R\'ak, Jalal Al-Afandi, Andr\'as Horv\'ath, Gy\"orgy Cserey
llmsfine-tuningmultimodalsafety
More like this →
arXiv Computer Vision
Sep 4

SignSeek: Learning Transferable Representations for Sign Dictionary Retrieval

SignSeek is a new method for learning transferable sign representations that enables efficient retrieval of signs from dictionaries using only a query video. It employs contrastive learning with saliency‑guided articulator masking, aligning same‑gloss signs across signers while focusing on the single most critical articulator per sign. Trained on 266K samples from multiple sign languages, SignSeek achieves state‑of‑the‑art cross‑corpus retrieval performance and zero‑shot generalisation to unseen British Sign Language, also improving isolated sign recognition and subtitle alignment.

By Sobhan Asasi, Ozge Mercanoglu Sincan, Richard Bowden
ragdiffusionfine-tuningbenchmarkssafety
More like this →