OAC Core: Edge to Cloud Workflows: Advancing Workflow Management in the Computing Continuum

This project aims to build the scientific foundations for edge-to-cloud computing and catalyze research on innovative cyberinfrastructure (CI) and workflow management for the computing continuum. Edge computing is making significant inroads into our lives and is impacting the types of science and engineering we can do. Applications spanning from the edge to the cloud are used in environmental monitoring, precision agriculture, wildfire prediction, zooplankton classification, and construction. In computer science, many researchers are exploring techniques for federated learning. CI researchers are exploring edge-to-cloud solutions that can help process data at the edge and as it moves from the edge to the data center. However, efficiently executing edge-to-cloud applications is still a challenge. Edge devices are very heterogeneous and resource-limited (computing power, storage, network bandwidth, energy power). They can have intermittent network connectivity, be mobile, and are often prone to failures. However, because they are near the network’s edge, where the data is being generated, they provide low latency and quick turnaround time for latency-sensitive applications. They can also address data privacy concerns by operating on the data in place, and the overall application can be power-efficient because data does not have to move from the edge to the cloud. In this context, this project focuses on the efficient and robust management of edge-to-cloud workflows. It includes (1) the development of a set of real-world and synthetic scientific workflows that can serve as benchmarks for evaluating edge-to-cloud algorithms and systems, (2) the development and evaluation of novel task scheduling algorithms that can optimize the performance and reliability of edge-to-cloud applications, (3) the development of an experiment management framework that enables easy execution of edge-to-cloud workflows on the computing continuum, and (4) the broad dissemination of all research artifacts through online repositories with links from the project website. The project also enables and welcomes community contributions. Results will be published in peer-reviewed journals and conference proceedings. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.