arXiv: Computing & Higher Ed
Tuesday, October 6
Beyond Score Accuracy: Examining the Diagnostic Quality of LLM-Generated Structured Assessment in Higher Education
As Large Language Models (LLMs) are increasingly adopted for automated grading and feedback in higher education, their structured outputs, including multi-dimensional rubric scores, detailed feedback comments, and improvement suggestions, create an appearance of thorough analytic evaluation. This study examines…
arxiv.org
Monday, October 5
From Written Response to Dialogue with AI: How Activity Format, Interaction Modality, and Language Impact Student Learning and Engagement
The widespread availability of LLMs is challenging written learning activities, as students can increasingly generate responses without necessarily engaging with the learning content. Conversational AI creates an opportunity to redesign these activities as dialogue, while multilingual capabilities may make such…
arxiv.orgResponsible Institutional Analytics: Interpreting Bias with AI Support
Institutional Analytics (IA) dashboards inform decision-making in higher education, yet data limitations, constraints in analytical techniques, and missing contextual information often affect their interpretation. To support more responsible interpretation of IA, we introduce FACTRIA, a framework that organizes…
arxiv.orgAICoFe Demo: AI-based Collaborative Feedback System
Peer feedback promotes active learning, critical reflection, and skill development, but its effectiveness is often limited by the quality of feedback students provide. Recent advances in LLMs offer new opportunities to support peer feedback by generating more coherent and actionable feedback while preserving human…
arxiv.orgAISSA Demo: AI-based Student Slides Analysis Tool for Automated Grading and Feedback
We present an AI-based web-oriented tool designed to support formative feedback for oral presentation slides in higher education: AISSA. It allows students to upload their slides before presentation and automatically receive rubric-based quantitative scores and qualitative feedback generated by large language models…
arxiv.org
Sunday, October 4
When Does It Become Cheating? Exploring the Roles of Self-Efficacy and the Impostor Phenomenon in Computing Students' Perceptions of Academic Dishonesty
Academic dishonesty is an urgent problem in computer science (CS) education, compounded by the rise of artificial intelligence (AI) and the prevalence of online learning in a post-COVID world. Self-efficacy and the impostor phenomenon are psychological constructs linked to academic dishonesty, yet little research has…
arxiv.orgFrom Access to Realized Affordances: University Students' Generative AI Engagement across Linguistic and Sociotechnical Contexts
Generative artificial intelligence (GenAI) is increasingly embedded in university students' academic work, yet student engagement is often examined through adoption, frequency of use, or general perceptions, with less attention to how it is shaped by linguistic and sociotechnical conditions. This comparative…
arxiv.org
Thursday, October 1
ReLEAF: A Socio-Technical Framework Bridging Custodians and Researchers for Trustworthy Data Sharing
Growing volumes of educational real-world data (ERWD) are being collected across learning platforms and institutional systems. Sharing these data within the Learning Analytics community offers substantial research opportunities, yet access remains limited by ethical, regulatory and governance constraints. Prior work…
arxiv.orgCounterexample Generation via Per-Theorem Symbolic Verifiers: When Imitation Hurts and Reinforcement Repairs
Large language models often solve a theorem forward yet fail to disprove a closely related false one: a falsification gap that supervised fine-tuning does not close and can actively worsen. We frame counterexample generation as constrained witness emission against a deterministic per-theorem Python verifier, and…
arxiv.org
Wednesday, September 30
WIP: DBWorkout: A Gamified SQL Practice Platform to Support Formative Learning in Database Courses
This research WIP paper presents DBWorkout, a web-based platform that supports formative SQL learning through sandbox-based execution, automated result-based feedback, and session-based gamification. Learning Structured Query Language (SQL) remains challenging for undergraduate students due to limited opportunities…
arxiv.orgUnderstanding Student Use of Large Language Models Across Computer Science Subfields
This research full paper examines how undergraduate students use large language models (LLMs) across computer science subfields. As LLMs become increasingly integrated into computing education, understanding how their use varies across technical and pedagogical contexts is essential for designing effective,…
arxiv.orgVirtual Global Collaboration in Data Analytics and Machine Learning Education: A Mixed-Methods Study of Asynchronous Cross-Border Teamwork
This innovative practice full paper examines a structured Virtual Global Collaboration (VGC) activity between undergraduate computing courses in the United States and Pakistan. The project was designed to support technical and intercultural skill development through asynchronous international teamwork in data…
arxiv.orgLeanSide: A Formally Verified Co-Reasoning System for Natural-language Proofs
Large language models are increasingly used as collaborators on deductive-reasoning tasks, but their outputs can hallucinate or pull users away from intended reasoning. Formal proof assistants provide machine-checked verification, but have a steep learning curve and require more granular reasoning than human written…
arxiv.org
Tuesday, September 29
Fairness Theatre: Evaluating Post-Hoc Fairness Interventions in Vendor-Controlled Early Warning Systems
Public institutions increasingly procure AI systems whose design they cannot inspect or change. In higher education, proprietary Early Warning Systems (EWS) leave colleges with few options beyond adjusting model outputs to address inequity. This raises the question of how fairness work is coordinated among vendors,…
arxiv.orgCritical Thinking with Generative AI: A Constraint-First Design Pilot of a Thinking-Partner Intervention
Generative AI (GenAI) tools entered higher education classrooms faster than the field was able to study their effects on learning. One concern is that GenAI may displace the critical thinking and AI literacy that students will need after graduation. This paper reports a Design-Based Research pilot of a GenAI-assisted…
arxiv.orgThree Pathways of Student-AI Interaction: Constraint-First Design for Higher-Order Thinking
How students interact with artificial intelligence (AI) systems in educational settings may determine whether that interaction supports or displaces critical thinking. This paper introduces two contributions. The first is the Three Paths of Student-AI Interaction, a typological framework identifying three…
arxiv.orgEarly Prediction of AI-Assisted Cheating Risk in Online Exams Through Learning Analytics
AI-assisted cheating has become an important threat to the security of online exams. This study examines whether the risk of AI-assisted cheating in the final exam can be predicted using students' digital traces in the learning management system (LMS) during the first eight weeks of the semester. The sample comprised…
arxiv.org
Monday, September 28
Student Perceptions of Tablet-Based Teaching and Learning in TNE Undergraduate Mathematics
Tablet-based teaching and learning has become increasingly common in university mathematics courses, offering capabilities such as digital ink, dynamic visualisation, and real-time annotation. However, there is limited experiential evidence regarding how students perceive the specific benefits and drawbacks of…
arxiv.orgArgus: Academic Integrity in the Era of Generative AI
The rapid proliferation of large language models (LLMs) in the context of education has introduced significant challenges in enforcement of academic integrity, especially in programming courses. We present Argus, an automated detection system for LLM-assisted student work in undergraduate C programming assignments.…
arxiv.org
Sunday, September 27
An Empirical Study on how Computing Students Interact with Large Language Models for Learning Purposes
Large Language Models (LLM) have become popular tools in education. Therefore, understanding how students interact with LLMs for learning purposes is an important aspect of the responsible design and development of LLM based learning tools. However, existing research has focused on evaluating model performance,…
arxiv.orgFrom Granular Revision Operations to Meaningful Revision Units: Evaluating LLMs for Revision Boundary Detection
Revision traces provide valuable evidence about students' writing processes, but their usefulness for learning analytics depends on how individual revisions are represented. Automated draft-comparison methods often produce granular edit operations that can fragment a single purposeful revision into multiple analytic…
arxiv.org
Wednesday, September 23
HelpCoach: Scaffolding Targeted AI Help-Seeking During Problem-Solving
Students increasingly turn to AI for help with problem-solving, yet too much AI support can undermine learning itself. To benefit from AI, students need to specify the necessary knowledge and scaffold type in their questions. However, they struggle to formulate such targeted questions because they lack metacognitive…
arxiv.org
Tuesday, September 22
Who Acts, Who Knows, Who Answers? A Corpus-Assisted Discourse Analysis of Agency, Epistemic Responsibility, and Accountability in Generative AI Higher Education Research
Generative artificial intelligence (GenAI) is increasingly described in higher education as a tool, collaborator, evaluator, proxy, and infrastructure. These labels are not neutral: they shape who is seen as acting, knowing, and, crucially, being answerable when someone uses AI. This study examines how scholars…
arxiv.org
Saturday, September 19
Learner-Centered Design of Educational Tools for Cross-Expertise Technical Communication in Computing Contexts
Cross-expertise technical communication (i.e., communicating about computing topics across levels of computing expertise) is important for workplace collaboration. However, students are underprepared because computing education rarely explicitly teaches communication, and available practice tends to occur among peers…
arxiv.org
Friday, September 18
AI-written admissions essays are widespread but penalized
AI is rapidly transforming higher education, including the application process, yet relatively little is known about its use and consequences. To help close this gap, we analyze nearly 7{,}500 applications submitted between 2020 and 2025 to a large public policy master's program in the United States. We find that in…
arxiv.orgReducing Barriers to Academic Support: Evaluating a Course-Specific RAG System for Addressing Help-Seeking Disparities in Higher Education
Access to academic support is a key determinant of student success, yet students experience it unequally: some readily seek help from lecturers or tutors, while others hesitate due to anxiety, fear of judgement, uncertainty about expectations, or low confidence in their understanding. This may be especially evident in…
arxiv.org
Thursday, September 17
Your Programming Students' Cognition with ChatGPT: Higher Performance, Lower Retention, and Reduced Ownership
Generative AI can improve students' programming performance, but successful task completion may not reflect what they retain. We examined performance, retention, cognitive load, and ownership in a controlled between-subjects experiment with 59 undergraduate computer science students, 55 were retained for analysis.…
arxiv.orgWhite Men Without Degrees Receive the Lowest Ratings from Large Language Models
White men without an undergraduate degree receive the lowest average ratings among eight gender-race-education groups in controlled large-language-model evaluations of credit, hiring, and rental applications. We conduct full-factorial vignette experiments with 18 models from 12 developer groups, varying gender, race,…
arxiv.org
Wednesday, September 16
Prepared Or Unprepared? Evaluating Healthcare Workforce Readiness for Clinical Adoption of Artificial Intelligence in Nigeria
Artificial intelligence (AI) is increasingly integrated into healthcare systems worldwide, yet its successful clinical adoption depends critically on workforce readiness, particularly in low- and middle-income countries (LMICs) where infrastructural and training gaps persist. This cross-sectional study evaluated…
arxiv.orgIntegrating Flipped Learning and Generative AI for Practice-Based Design Education: Evidence from a Knit Yarn Design Course
In practice-based design courses such as knit yarn design, students must turn visual ideas into feasible material outcomes. This is difficult because creative decisions are tied to yarn properties, stitch structures, machine operation, and limited opportunities for physical sampling. This study presents an integrated…
arxiv.orgAn Evaluation of AI-Supported Evidence-Based Learning for Public Speaking Skill Development
Public speaking is an essential skill in academic and professional contexts, but it often causes anxiety. Although several AI-based speech coaching tools exist, they typically provide generic feedback and lack model speeches for learning. This study addresses these gaps by developing a system that incorporates speech…
arxiv.org
Tuesday, September 15
Teaching AI, Robotics, & Community: A Hubs-Based K-12 Education Framework for Reaching Rural Schools
K-12 robotics and AI education remains difficult to scale, especially in rural regions lacking sustained technical mentorship. Programs like FIRST provide competition pathways and instructional opportunities, but they do not eliminate the need for local programming and robotics expertise. We introduce AI, Robotics, &…
arxiv.org
Sunday, September 13
Trust by Design: Trust Calibration Through Non-Advisory Socratic Dialogue in Conversational Agents
As conversational AI systems increasingly operate in sensitive domains, the central challenge shifts from usability to trust calibration, ensuring that users rely on systems neither too much nor too little. Systems that provide advice or interpretations risk encouraging inappropriate reliance, particularly when users…
arxiv.org
Friday, September 11
Generative AI and Extended Reality in Collaborative Architectural Design Education: An Exploratory Studio Study
Architectural design education relies heavily on visual ideation and representation to support collaborative learning in studio environments. Recent advances in generative artificial intelligence (GenAI) and extended reality (XR) offer new opportunities for rapid idea exploration and immersive spatial visualization.…
arxiv.org
Thursday, September 10
Ethics Training Agents: Facilitating Group-Based Ethics Education with Role-Playing and Discussion for Ethical Reflection and Exploration
Group-based ethics training for Science, Technology, Engineering and Mathematics (STEM) students is a complex challenge, requiring substantial resources and expertise. While activity-based teaching methods, such as role-playing and discussions, are commonly employed to simulate real-world scenarios, current practices…
arxiv.org
Wednesday, September 9
"Coder first, advocate second, college student third": The Liminality of Going to College as a Blind Computing Student
Blind or low vision (BLV) students are less likely to graduate from college, particularly in computing. Prior work documents accessibility challenges in high school and college, but we lack understanding of the transition process that produces this "leaky pipeline." To address this, we interviewed ten BLV college…
arxiv.org5-Dialects-BN: Unmasking the Impact of Transliteration on Bangla Dialectal LLMs
Large Language Models (LLMs) have achieved remarkable progress across natural language processing (NLP) tasks, yet their capabilities degrade sharply for low-resource languages and dialectally diverse settings. Bangla, the world's sixth most spoken language, exemplifies this gap: existing resources overwhelmingly…
arxiv.org
Saturday, September 5
Flawed but Memorable: Student Critical Reception of Interest-Personalized GenAI Analogies in Computing Education
Motivation: Undergraduate computing students increasingly turn to generative AI (GenAI) tools to understand abstract concepts through analogies. Analogies compare an unfamiliar concept to something familiar, but judging whether the comparison holds requires knowledge of both. GenAI may also embed assumptions about who…
arxiv.org
Thursday, September 3
Decreasing Digital Distraction in College Students: Associated Online Learning Strategies Identified by Unsupervised Data Mining Approaches
The proliferation of digital tools in education offers numerous benefits but also introduces significant challenges, notably digital distractions that hinder academic performance, especially in online learning contexts. This study employed unsupervised data mining techniques, specifically association rule mining and…
arxiv.orgMaking Gender-Inclusive Practices Actionable: Evaluating a Research-Informed Computing Education Toolkit
The persistent gender imbalance in computing remains a global concern, and universities offer a key part of the pipeline to address it. Although research has identified practices that support under-represented student groups, translating this evidence into actionable guidance remains challenging. This paper first…
arxiv.org
Tuesday, September 1
Evaluating Usability in Biomedical Visualization: Rethinking Heuristic Evaluation for Spatial Omics and Multidisciplinary Research Platforms
Introduction: Clinical research informatics (CRI) platforms support biomedical discovery by integrating advanced computational tools into research workflows. Emerging technologies such as spatial omics and AI-enabled imaging expand research capabilities but introduce complex interfaces that increase cognitive burden…
arxiv.orgA Dataset for Modeling Iterative Problem-Solving
Solving problems through repeated attempts is a sequential modeling task: at each step, the solver receives feedback and decides how to revise their solutions. Predicting whether performance improves, plateaus, or regresses across attempts is central to understanding any iterative problem-solving process in both human…
arxiv.org
Saturday, August 29
Understanding Behavioral Dark Patterns of High BMI Individuals
Understanding how everyday behaviors influence body weight is essential for designing effective and personalized health interventions. Existing studies largely rely on self-reported questionnaires or limited sensing modalities, making it difficult to capture the temporal dynamics of daily behavior. In this work, we…
arxiv.org
Thursday, August 27
Generative AI Expands the Intellectual Reach of Course Based Undergraduate Research Experiences (CUREs)
Course-based undergraduate research experiences (CUREs) broaden access to authentic scientific inquiry through responsive instructor support as research problems become increasingly complex. Generative artificial intelligence (GenAI) may extend this support by providing individualized assistance that can adapt as…
arxiv.org
Wednesday, August 26
MathAdv: What Theorem Provers Know, Reason, Formalize, and Generalize
Formal theorem proving enables machine-verifiable evaluation of mathematical reasoning, yet existing benchmarks often emphasize aggregate proof accuracy, concentrate on a narrow range of mathematics, and provide limited evidence of robustness to equivalent reformulations. We introduce MathAdv, a diagnostic benchmark…
arxiv.org
Tuesday, August 25
Security Education in Higher Education through AI-Powered Gamification
Cybersecurity education is facing more challenges as AI-driven attacks are becoming increasingly realistic and difficult to detect. Traditional video-based cybersecurity training in higher education often suffers from both low engagement and limited effectiveness. This dilemma motivates educators to explore innovative…
arxiv.orgWho Falls for SMiSh? Learning Through Survey Data Where to Best Target Awareness Training for Mobile Messaging Attacks
As mobile phone adoption has surged, so have scams involving these devices. One such scam, known as SMiShing (or smishing) after Short Message Service (SMS), involves fraudsters sending phishing links via mobile texts. Despite the prevalence of SMiShing, there is a lack of data on who is most vulnerable to these…
arxiv.org
Monday, August 24
When LLMs Slow Down: How Environmental Impacts Mediate University Students' LLM Usage
Large Language Models (LLMs) are increasingly being embedded into all facets of society, from search to education, industrial, and financial applications. These systems' carbon and water footprints raise important sustainability concerns, particularly with adoption rates exceeding 80% among university students,…
arxiv.org
Sunday, August 23
Evaluation in the Age of AI: Output as Evidence of Learning
The rapid adoption of artificial intelligence (AI), particularly large language models (LLMs), has fundamentally disrupted how learning is demonstrated and evaluated in higher education. Tasks that once served as proxies for understanding-such as writing essays, solving problem sets, or producing computer code-can now…
arxiv.org
Thursday, August 20
Adaptive Training for Nautical Rules of the Road
Knowledge of the nautical rules of the road is essential for safe ship navigation and collision avoidance. We evaluated adaptive and non-adaptive versions of a ship-driving simulation trainer designed to assess and improve students' knowledge and application of these rules. We randomly assigned 30 university students…
arxiv.org