I-Corps: Translation potential for experiential supercomputing

This I-Corps project is based on the development of supercomputers for real-time, interactive problem solving and data analysis. Currently, there are significant problems in creating robust, complex, open-ended learning environments that are personalized, engaging, adaptive and scalable. Yet, such environments have great potential for the development of valuable real-world skills (e.g., creativity, leadership, and collaboration). Preliminary implementations of this type of technology exist in medical simulation and military training, and it is emerging in K-12 and higher education. In addition, supercomputers are used in on-the-job training and life-long learning experiences. This technology addresses the challenges by providing well-integrated, immersive, collaborative, and virtual/physical extended reality environments. These environments provide unparalleled tools for research collaborations, intellectual exploration, education, and creative output. They incorporate visual, audio, and physical components; artificial intelligence (AI) technologies to enhance human-human, human-agent, and human-robot social interactions; rapid prototyping and fabrication tools; and tightly coupled interactive visual, audio, and physical experiences. This solution may be applied to next-generation healthcare simulators, advanced cyberlearning environments, and smart homes for well-being and entertainment. The technology provides deep integration of virtual and physical settings and has the potential to transform the fundamental understanding of collaboration, learning, creativity, discovery and innovation. This I-Corps project utilizes experiential learning coupled with a first-hand investigation of the industry ecosystem to assess the translation potential of experiential supercomputing. The core technology is the well-integrated fusion of interaction devices and artificial intelligence (AI) into a transformative, cohesive, and scalable instrument. The components include visual (headsets, projectors), audio (headsets, speakers, binaural), physical (spatial computing, collaborative social robots, 3D fabrication), human dynamic (wearable sensors, eye tracking), and social dynamic (co-located and remote dyadic and small team interaction) capabilities. The technology immerses users within customizable mixed-reality simulation environments by combining high-resolution visual, high-fidelity audio environments, and haptic feedback along with artificial intelligence (AI)-enabled collaborative agents and robots. The system architecture is comprised of three conceptual levels: node/field kit systems (local and distributed multimodal interaction), network systems software (latency, reliability, bandwidth), and computation (cluster/storage, data, analytic systems, services). In addition, this solution incorporates best practices from multimodal interaction research, human dynamics and social collaboration. Through AI-enabled extended reality environments that focus on the synergy of human-human, human-agent, and human-robot social interaction, experiential supercomputing may advance simulation and rapid prototyping for collocated, distributed, and collaborative teams. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.