arXiv Computation and Language By Samra Zafar, Shifa Yousaf

"I Wrote, I Paused, I Rewrote": A Mixed-Methods Study of Learner Perceptions of Process-Aware LLM Feedback

Read the original on arXiv Computation and Language →

The study examined how undergraduate English learners perceive feedback from large language models that incorporate process-aware data such as intermediate drafts and keystroke records. Forty‑three participants completed a timed essay, received LLM‑generated feedback based on the final draft, intermediate snapshots, and interaction logs, and then rated the feedback on six Likert items and answered open‑ended questions. Ratings were largely positive, with 74.4%–95.3% of participants giving 4 or 5 stars, and qualitative analysis revealed that most learners found the feedback accurate, though some noted misinterpretations or time constraints.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Sep 7

Who Should Grade My Work? Student Perspectives on Transparent AI-Assisted Writing Assessment in Higher Education

The study explores how undergraduate computing students in Saudi Arabia perceive AI‑generated writing feedback when they are explicitly told that ChatGPT, not a human instructor, produced the score and comments. Through qualitative reflections, four themes emerged: students found the feedback useful for surface‑level revisions, recognized AI’s contextual and pedagogical limits, trusted the feedback conditionally—separating its utility from its authority—and reaffirmed the human instructor’s role as the ultimate grading authority. The findings highlight a clear distinction students make between feedback usefulness and evaluative authority, treating them as separate judgments rather than opposing ends of a single approval scale.

By Rayed AlGhamdi
arXiv AI
Sep 21

How do LLMs Compute Verbal Confidence

arXiv:2603.17839v4 Announce Type: replace-cross Abstract: Verbal confidence -- prompting LLMs to state their confidence as a number or category -- is widely used to extract uncertainty estimates from...

By Dharshan Kumaran, Arthur Conmy, Federico Barbero, Simon Osindero, Viorica Patraucean, Petar Veli\v{c}kovi\'c
arXiv AI
Sep 24

Evaluating Feedback Focus and Pedagogical Adaptivity in LLM-Generated Feedback on Student Writing

The paper examines whether state‑of‑the‑art large language models (LLMs) produce feedback that aligns with expert teachers’ pedagogical practices, focusing on feedback type and adaptivity. Using a refined taxonomy of seven feedback focus types, the authors annotate and compare teacher and LLM‑generated feedback from three university writing courses, creating the FeedType benchmark. Their analysis shows that while most LLMs cover many feedback types, they do not match teachers’ distribution patterns or adaptive behavior across draft stages and student performance levels.

By Norah Almousa, Shayan Peyghambari Oskoui, Raquel Coelho, Gayle Rogers, Xiang Lorraine Li, Diane Litman
arXiv Computation and Language
Oct 26

Which Answer Did the Seventeen-Year-Old Write? A Behavioral Case Study of Author-Age Misattribution, Miscalibrated Confidence, and Non-Corrective Self-Explanation in Six Frontier Language Models

The paper reports a structured case study in which six frontier language models were asked to match handwritten exam answers to the ages of the writers. Three of the models performed at chance on the matching task while still reporting high confidence, and the youngest writer’s answer was misattributed to an adult in up to 90% of trials. Removing the multiple‑choice scaffold and changing institutional framing further degraded accuracy, while a single audience‑awareness instruction improved performance for one model but had no effect on the weakest models.

By Brianne Lee