Collaborative Research: Frameworks: IOWarp: Bending the I/O Fabric for Advancing AI-Infused Scientific Workflows

Scientific discovery is increasingly driven by massive, complex datasets that hold the keys to unlocking new knowledge and solving global challenges. However, the current landscape of data storage and management is struggling to keep pace with this data deluge. IOWarp is designed to create a next-generation data management platform tailored to the unique needs of modern, data-intensive science. This platform will address the fundamental challenges that researchers face when dealing with diverse data types, the exponential growth of data, and the need for rapid access to critical information. By streamlining data workflows and enhancing data accessibility, IOWarp will empower scientists and researchers to focus their valuable time and resources on their core mission: making groundbreaking discoveries. Beyond its technical advancements, IOWarp will also foster a collaborative and inclusive research environment, democratizing access to data and equipping the next generation of scientists with essential data skills. By accelerating research in critical fields like genomics, climate modeling, and AI-driven discovery, IOWarp has the potential to unlock transformative solutions to global challenges and drive innovation. The IOWarp project will engineer a modular, adaptable, and scalable data management platform that addresses the specific challenges encountered in modern scientific workflows, particularly those enhanced by artificial intelligence (AI) technologies. IOWarp will significantly reduce data access times, accelerating the pace of scientific discovery by harnessing state-of-the-art technologies like NVMe SSDs, CXL devices, and CPU-GPU codesigns. It will foster a collaborative ecosystem, inviting contributions from diverse scientific and engineering communities. Building upon the team's extensive expertise in multi-tiered storage research and leveraging prior NSF investments in this field, IOWarp will integrate AI-driven solutions to redefine data management for high-performance computing environments. The anticipated outcomes of IOWarp will establish a thriving community-driven platform that continually evolves to meet the changing needs of scientific research. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.