arXiv:2606. 30549v1 Announce Type: cross Abstract: AI code completion tools, such as Github Copilot, provide students with code suggestions to help them write programs.
By Jessica Hutchison, Ian Tyler Applebaum, Kenneth Angelikas, Kush Rakesh Patel, Phuoc Nguyen, Antonio Lazaro, Nicholas Rucinski, Rahad Arman Nabid, Stephen MacNeil
Large Language Models (LLMs) often generate natural-language comments while writing code, and these comments become part of the context used to generate the code that follows. However, it remains uncl...
The study investigates how natural-language comments influence code generation by large language models. Observational and controlled experiments on LiveCodeBench reveal that comment frequency and general intent do not predict success, but comments derived from correct solutions significantly improve recipient model performance by an average of 17.2%. Conversely, comments from failed solutions or unrelated problems either offer no benefit or even reduce performance, and most models cannot fully recover the advantage of well‑crafted comments.
By Dangfeng Pan, Zhensu Sun, Cenyuan Zhang, David Lo, Xiaoning Du
arXiv:2601. 19072v3 Announce Type: replace-cross Abstract: Large Language models (LLMs) have shown strong capabilities in code review automation, such as review comment generation, yet they suffer from hallucinations -- where the generated review comments are ungrounded in the actual code -- poses a significant challenge to the adoption of LLMs in code review workflows.
By Kla Tantithamthavorn, Hong Yi Lin, Patanamon Thongtanunam, Wachiraphan Charoenwet, Minwoo Jeong, Ming Wu
arXiv:2608. 16318v1 Announce Type: cross Abstract: Recent advances in Generative Artificial Intelligence (GenAI) have substantially improved the ability of large language models (LLMs) to generate and explain source code.
By Marina Lepp, Joosep Kaimre
arXiv:2606. 28882v1 Announce Type: cross Abstract: Large Language Models (LLMs) have shown the potential to generate code explanations that surpass those of peers in quality, offering promising opportunities for computer science education.
By Seth Bernstein, Paul Denny, Juho Leinonen, Kush Patel, Rayhona Nasimova, Matt Littlefield, Stephen MacNeil
arXiv:2606. 08676v1 Announce Type: cross Abstract: AI coding assistants have significantly improved developer productivity by automatically suggesting code that aligns with user intent, and many of these tools are now integrated directly into Integrated Development Environments (IDEs).
By Shi Ying Chang, Chiok Yew Ho, Yichen Li, Yintong Huo
LLM-based agents excel at software engineering tasks where an existing codebase provides context, but constructing a program from scratch remains fundamentally harder. Recent benchmarks such as ProgramBench quantify this gap: given only natural-language documentation and an execute-only binary as a behavioral oracle, even frontier models solve fewer than 1% of instances.
arXiv:2606. 12425v1 Announce Type: cross Abstract: Active learning is widely recognized as an effective approach for improving learning outcomes in introductory programming courses.
By Muntasir Hoq, Griffin Pitts, Bradford Mott, Seung Lee, Jessica Vandenberg, Shuyin Jiao, Narges Norouzi, James Lester, Bita Akram
arXiv:2507.21831v2 Announce Type: replace-cross
Abstract: LLMs are seeing widespread use for task automation, including automated coding in the social sciences. However, even though researchers have...
By Andreas Reich, Claudia Thoms, Tobias Schrimpf
arXiv:2609.36073v1 Announce Type: cross
Abstract: The rapid proliferation of large language models (LLMs) in the context of education has introduced significant challenges in enforcement of academic...
By David Racovan, Ajay Rawat, Christopher K. May, Jeffrey A. Turkstra
arXiv:2511. 13271v2 Announce Type: replace-cross Abstract: The rise of Generative AI (GenAI) tools like ChatGPT has created new opportunities and challenges for computing education.
By Rufeng Chen, Shuaishuai Jiang, Jiyun Shen, AJung Moon, Lili Wei