I-Corps: Vision analysis system using inferred three-dimensional data to analyze and correct a user’s pose in relation to 3D space

The broader impact/commercial potential of this I-Corps project is the development of rehabilitative technology, focusing on augmenting home-based exercise regimens for precise mobility recovery. Currently, there is a growing need for accessible and consistent physical therapy support while current tools lead to poor adherence and ultimately poor recovery outcomes. The proposed technology provides an analysis of the human body to encourage recovery for physical therapy patients both in-clinic and at home through audio/visual feedback and corrective coaching. The technology is designed to provide instantaneous corrections and synchronized progress with care providers, while the pose analysis and real-time guidance system provides confidence during exercise sessions. The goal is to facilitate better health outcomes and improved quality of life by improving access to personalized rehabilitation, potentially reducing healthcare disparities and cost of knowledgeable, accessible care. This I-Corps project is based on the development of a software tool for physical rehabilitation, that addresses independently performed exercises for patients in physical therapy. Currently, clinicians are limited by home exercise tools that do not have customizable features. The proposed vision analysis system uses inferred three-dimensional data to analyze and correct a user’s pose in relation to 3D space. The technology includes a machine learning (ML) algorithm to dynamically extrapolate human pose insights and offers corrective action as needed. In addition, the proposed tool leverages a deep-learning approach that continues to improve through learning from outcomes and identifying engaging techniques for continued recovery. The goal is to provide high-precision support at-home that complements physical recovery and directly impacts mobility and therapy objectives. The proposed technology provides real-time guidance, corrective coaching, and integrated progress tracking, which may significantly improve the effectiveness of home-based exercises. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.