Developing Core Probabilistic Reasoning for Data Science Using AI-Driven Modeling

This Level 1 IUSE ESL project from the University of Delaware aims to serve the national interest by exploring how AI tools can be used to support student reasoning in advanced undergraduate mathematics courses. Specifically, the project will incorporate large language models into probabilistic modeling courses and study how the use of artificial intelligence tools influence student modeling processes. Interactions with AI tools, faculty, and peers can all contribute to changes in student reasoning, and this project will explore how those three factors work together to improve modeling skills and understanding. Current research highlights the potential risks and rewards of AI use in undergraduate STEM courses. Using AI tools to support and guide, instead of replace, student thinking can be a powerful approach to strengthen student learning and understanding. Project research will explore how students’ probabilistic thinking about real-world models develops in settings that incorporate the use of AI. Of particular interest is how students’ reasoning about model development is impacted by interactions with AI tools, peers, and faculty. Data streams include videos of student group work during in-class modeling activities where students will use AI to support model development, student work from in- and out-of-class assignments, and surveys. These data will be used to create model diagrams that capture students’ modeling approach and reasoning. An expert advisory board will provide formative and summative feedback across the project to strengthen implementation and progress towards project goals. The NSF IUSE: EDU Program supports research and development projects to improve the effectiveness of STEM education for all students. Through the Engaged Student Learning track, the program supports the creation, exploration, and implementation of promising practices and tools. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.