Drawing-to-Assess: Validating Methods for Drawing Analysis

This project aims to serve the national interest by building evidence for using drawings as tools to measure student ideas and feelings. This Level 1 Engaged Student Learning project addresses gaps in approaches to assessing student learning, potentially offering a novel approach to measure learning in STEM undergraduate courses. This project intends to contribute to the development of exemplary undergraduate science education through encouraging new modes of student assessment. Ultimately, drawings provide a mechanism for evaluating constructs not as easily measured through other means. As learning and assessment activities, drawings can help students recognize their own misunderstandings and emotional barriers to learning, as well as provide a visual record of student learning across time. This project will provide researchers and educators with evidence and guidance needed for drawings to become a more usable and regular practice for classroom and research assessment. This project recognizes the unique place visualizations have in science, and the fundamental role visual communication of ideas plays in scientists’ ability to communicate complex ideas. The primary goal of this project is to establish validity and reliability of drawing analysis as a means for assessing student learning. The project plans to provide a foundation for drawings to be an effective alternative measure to more traditional scale approaches for assessing student outcomes. In the context of undergraduate STEM education, the project will evaluate the validity and reliability of five different drawing assessment methods: Rubric Score, Semiotic Analysis, Manual Grouping, Factor Analysis, and Artificial Intelligence Analysis. This will allow a comparison of validity and reliability evidence and determine conditions under which each approach is effective or ineffective as well as provide evidence-based guidance for utilizing drawings for assessment in undergraduate classrooms and for research. The NSF IUSE: EDU Program supports research and development projects to improve the effectiveness of STEM education for all students. Through the Engaged Student Learning track, the program supports the creation, exploration, and implementation of promising practices and tools. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.