Training Modules to Enhance Institutional Capacity to Evaluate Training Programs in the Biomedical Sciences

Program evaluation and trainee assessment are crucial to support successful training programs in the biomedical sciences. The updated NIGMS T32 funding mechanism identifies the critical role of trainee-focused learning goals, aligned activities, effective evaluation and feedback in advancing current approaches to graduate student training. Yet few training programs are prepared to integrate evaluation into their programs and incorporate trainee-centered cycles of improvement. We propose to develop a series of interactive content and video modules on program evaluation that can be used synchronously or asynchronously to train faculty and lead administrators in the biomedical sciences in effective evaluation of training programs. We further propose to test our content in five institutions with project-trained facilitators leading local learning communities. We will train (and pay) facilitators at these five institutions to lead teams of training grant PI/PDs and administrators in learning through a learning community model. The modules will build upon a set of pilot videos and workshops on program evaluation that were developed and piloted successfully 2020-2021 with funds from an NIH supplement to NIH 3T32GM008449-27S1 (Leonard, PI) Developing Capacity to Evaluate Training Programs via Development of Human, Institutional and Social Capital. The proposed modules will 1) include both introductory and advanced content about evaluation (e.g. direct measures of trainee performance, principles of evaluation, survey design, focus group design), 2) set participants up for success by preparing them to identify and work with evaluators, evaluation advisory boards, and cycles of improvement and 3) address issues and concerns that are unique to evaluation of training programs in the biomedical sciences. Finally, we will disseminate modules, facilitation training, and facilitation guides nationally.