Agentic data science with the Data Agent Kit
cloud.google.com·7h ago
AI Research
arXiv CS.AI·25d ago·5 min read
The Uneven Impact of Generative AI on Student Learning: Examining the Roles of Reliance, Evaluation Literacy, and Course Policy in AI-related Courses
TL;DR
Generative AI (GenAI) is reshaping student learning in AI courses, revealing varied impacts based on usage patterns and course policies. Key findings indicate that reliance on GenAI can enhance or hinder learning experiences depending on evaluation literacy and instructor guidelines.
✦ Why It Matters
Revise course policies to support diverse GenAI usage and enhance student learning outcomes today.
Key Takeaways
- Identify and support high-use GenAI students for better outcomes.
- Implement clear instructor policies on GenAI usage in courses.
- Monitor early reliance on GenAI to mitigate negative impacts.
- Enhance evaluation literacy among students to improve learning experiences.
Full Summary
Generative AI is increasingly influencing educational environments, particularly in AI-related courses. A study involving 118 students across 12 courses identified four distinct user groups based on their GenAI usage: high-use, light-use, and two moderate-use categories.
The research revealed that students using premium versions of GenAI tools and those with supportive instructor policies reported greater academic benefits. Multivariable regression analysis showed that early reliance on GenAI correlated with both positive and negative impacts on learning, particularly as students' evaluation literacy increased.
While many students experienced cognitive and self-efficacy benefits, concerns about stress and reduced critical thinking were prevalent among those with lower perceived learning benefits. These insights suggest that educational institutions must develop better policies to ensure equitable access to GenAI's advantages.