arXiv AI

SetEasy: A Multi-Modal Classroom Engagement Assessment and Seating Optimization Framework

arXiv:2608. 07188v1 Announce Type: new Abstract: SetEasy optimizes classroom engagement in fixed seating grids.

arXiv AI
Aug 26

Mind the Student: Behavioral and Contextual Cues for Automated Engagement Prediction in Online Learning

The paper tackles the challenge of predicting student engagement from online tutoring videos, noting that engagement is a complex, multidimensional construct influenced by behavioral, emotional, and cognitive states. By analyzing the CASED dataset, the authors highlight the difficulty posed by high inter‑person variability and subjective annotations. They propose a multimodal framework that fuses implicit spatiotemporal features from pretrained video, audio, and image encoders with structured behavioral cues such as head pose, gaze, facial action units, emotion, and wavelet‑based audio features, integrating them via a Perceiver IO bottleneck and modeling participant personalities with variational posteriors. The system employs evidential regression and spectral‑normalized Gaussian process classification heads to provide uncertainty‑aware predictions, achieving competitive performance on the CASED challenge test set while offering well‑calibrated uncertainty metrics.

By Alperen Kantarci, Visvanathan Ramesh, Gemma Roig
arXiv Machine Learning
Sep 18

Towards a Unified Modality-Agnostic Multimodal Framework for Cognitive Workload Assessment

The paper presents a modality‑agnostic, hierarchical Transformer framework for assessing cognitive workload using heterogeneous biosignals. In a pilot study, the authors evaluated all 31 combinations of five modalities (ECG, EDA, RESP, SpO₂, EEG) across three tasks (IQ, MATH, GAME) and found that EEG alone performed best, while adding more modalities did not consistently improve results. The full five‑modality model achieved the highest average accuracy (73.02% on IQ, 68.08% overall) and reduced model size by about 50% compared to late‑fusion approaches.

By Stefanos Gkikas, Christian Arzate Cruz, Calvin Joseph, Giorgos Giannakakis, Raul Fernandez Rojas
Hugging Face Trending Papers
Jun 20

Zero-Shot Vision-Language Models for Classroom Engagement Recognition: A Benchmark Study of Prompt Sensitivity and Cross-Dataset Generalization

Automated classroom engagement recognition holds substantial promise for scalable learning analytics, yet the suitability of modern Vision-Language Models (VLMs) for this task under zero-shot conditions remains largely unexplored. We present a systematic benchmark that evaluates five widely-used VLMs: CLIP, BLIP-VQA, GPT-4o, LLaVA-1.

arXiv Computation and Language
Oct 9

A Formative Study of Brief Affective Text as a Complement to Wearable Sensing for Longitudinal Student Health Monitoring

The study examined whether ultra‑brief naturalistic concern text could complement wearable sensor data for monitoring student health. Over a year, 458 university students provided three‑word responses to a bi‑monthly prompt while wearing Oura rings, and the researchers compared different NLP methods to link these brief texts to nine sleep and physical activity outcomes. Findings indicated that weeks with academic‑concern framing correlated with lower physical activity, while emotional exhaustion language correlated with poorer sleep quality and lower heart rate variability, suggesting that affective content may add value to passive physiological monitoring.

By Tamunotonye Harry, Johanna Hidalgo, Matthew Price, Yuanyuan Feng, Kathryn Stanton, Connie Tompkins, Peter Sheridan Dodds, Mikaela Irene Fudolig, Laura Bloomfield, Christopher Danforth