ChildSafeAds is a shared task on commercial content in YouTube videos likely to reach children and teenagers. It contains 3,360 videos from 939 channels. Each instance begins with a segment submitted...
The paper presents a new taxonomy for online harm on video platforms, expanding existing frameworks to multimodal contexts and defining six content-based categories: Information, Hate and harassment, Addictive, Clickbait, Sexual, and Physical harms. It also evaluates multimodal large language models (MLLMs) as alternative annotators, comparing GPT‑4‑Turbo, non‑trained crowdworkers, and trained human annotators on a dataset of 19,422 potentially harmful YouTube videos. The study finds that MLLMs can perform comparably to human annotators in both binary and multi‑label classification tasks, suggesting potential applications in content moderation and social science research.
By Claire Wonjeong Jo, Miki Weso{\l}owska, Magdalena Wojcieszak
The paper presents a child-centered harm taxonomy for AI systems and analyzes 1,331 publicly reported child-related AI incidents. It finds that harms are concentrated in representational, dignity-related, and psychological categories, often linked to deployment-context, governance, and misuse failures rather than model defects. The study highlights that model-level evaluations alone cannot anticipate the harm pathways most frequently documented for children, and recommends broader mitigations such as age assurance, consent verification, safety-by-design UX constraints, incident disclosure norms, and targeted auditing regimes.
By Junfeng Jiao, Kevin Chen, Shrestha Mishra, Abhejay Murali, David Atkinson, Shriti Raj, Saleh Afroogh
The study examines how generative AI influences accuracy, efficiency, and confidence in retrieving information from videos. Across 900 participants and 8,000+ tasks, AI assistance improved accuracy by 3‑7% when the relevant video segment was viewed and by 27‑35% when it was not, while also boosting efficiency by 10‑25% depending on video length. However, participants over‑relied on AI, leading to accuracy drops of up to 32% with a deceiving assistant, and their confidence remained unchanged across conditions.
By Anders Giovanni M{\o}ller, Elisa Bassignana, Francesco Pierri, Luca Maria Aiello
arXiv:2403. 18957v3 Announce Type: replace-cross Abstract: Online user generated content games (UGCGs) are increasingly popular among children and adolescents for social interaction and more creative online entertainment.
By Keyan Guo, Ayush Utkarsh, Wenbo Ding, Isabelle Ondracek, Ziming Zhao, Guo Freeman, Nishant Vishwamitra, Hongxin Hu
The study audits Bluesky’s Moderation Service (BMS) using its 10.6 million public moderation labels from 2025. It finds that BMS operates as a human‑AI collaboration: sexual and graphic content is flagged automatically in seconds, while more nuanced or high‑stakes content requires human review that can take hours or days. The system shows high precision (0.837) but low recall (0.222), with annotators detecting 4.5 times more harmful content than the system, and clustering reveals harms ranging from hostility toward protected groups to the spread of explicit material.
By Pushpdeep Singh, Sayeh Jarollahi, Ayan Majumdar, Vabuk Pahari, Abhijnan Chakraborty, Krishna P. Gummadi, Ingmar Weber, Abhisek Dash