arXiv AI By Zhihao Xie, Hongye Yang, Shien Liu

SetEasy: A Multi-Modal Classroom Engagement Assessment and Seating Optimization Framework

Read the original on arXiv AI →

arXiv:2608. 07188v1 Announce Type: new Abstract: SetEasy optimizes classroom engagement in fixed seating grids.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Aug 26

Mind the Student: Behavioral and Contextual Cues for Automated Engagement Prediction in Online Learning

The paper tackles the challenge of predicting student engagement from online tutoring videos, noting that engagement is a complex, multidimensional construct influenced by behavioral, emotional, and cognitive states. By analyzing the CASED dataset, the authors highlight the difficulty posed by high inter‑person variability and subjective annotations. They propose a multimodal framework that fuses implicit spatiotemporal features from pretrained video, audio, and image encoders with structured behavioral cues such as head pose, gaze, facial action units, emotion, and wavelet‑based audio features, integrating them via a Perceiver IO bottleneck and modeling participant personalities with variational posteriors. The system employs evidential regression and spectral‑normalized Gaussian process classification heads to provide uncertainty‑aware predictions, achieving competitive performance on the CASED challenge test set while offering well‑calibrated uncertainty metrics.

By Alperen Kantarci, Visvanathan Ramesh, Gemma Roig
arXiv Machine Learning
Sep 18

Towards a Unified Modality-Agnostic Multimodal Framework for Cognitive Workload Assessment

The paper presents a modality‑agnostic, hierarchical Transformer framework for assessing cognitive workload using heterogeneous biosignals. In a pilot study, the authors evaluated all 31 combinations of five modalities (ECG, EDA, RESP, SpO₂, EEG) across three tasks (IQ, MATH, GAME) and found that EEG alone performed best, while adding more modalities did not consistently improve results. The full five‑modality model achieved the highest average accuracy (73.02% on IQ, 68.08% overall) and reduced model size by about 50% compared to late‑fusion approaches.

By Stefanos Gkikas, Christian Arzate Cruz, Calvin Joseph, Giorgos Giannakakis, Raul Fernandez Rojas
Hugging Face Trending Papers
Jun 20

Zero-Shot Vision-Language Models for Classroom Engagement Recognition: A Benchmark Study of Prompt Sensitivity and Cross-Dataset Generalization

Automated classroom engagement recognition holds substantial promise for scalable learning analytics, yet the suitability of modern Vision-Language Models (VLMs) for this task under zero-shot conditions remains largely unexplored. We present a systematic benchmark that evaluates five widely-used VLMs: CLIP, BLIP-VQA, GPT-4o, LLaVA-1.