Control-Theoretic Foundations for Trustworthy Generative Artificial Intelligence in Safety-Critical Engineering Systems
- Institution
- University of California-Irvine, CA
- Principal investigator
- Fabio Pasqualetti
- Funding
- $390K
- Duration
- 2026–2029
Moonbase score
Still being scored
Abstract
Generative artificial intelligence is increasingly used not only to create content but also to support decision-making in engineered systems, including robot motion planning, autonomous vehicles, and networked infrastructure. As these systems operate in the physical world, their decisions must satisfy strict safety requirements, coordinate reliably across multiple interacting components, and remain stable when operating in feedback with physical processes. Current generative artificial intelligence methods were not designed with these engineering requirements in mind, limiting their trustworthy deployment in safety-critical applications. The research supported by this award develops the mathematical foundations needed to make generative artificial intelligence safe, coordinated, and reliable for engineering systems. The research advances the national interest by enabling trustworthy artificial intelligence technologies that improve the safety and reliability of autonomous and networked systems while strengthening the scientific foundations of engineering decision-making in transportation, robotics, and infrastructure. The project will also train undergraduate and graduate students at the intersection of control engineering and machine learning, provide hands-on training through a multi-robot laboratory, and openly disseminate software, data, and educational materials with the research and education communities. This project establishes control-theoretic foundations for generative diffusion processes operating in constrained, distributed, and feedback-coupled settings. The research develops methods that certify the satisfaction of hard constraints throughout the generative sampling process, including techniques that account for reduced-order representations and uncertainty in the dynamics and constraints inferred from data. It further develops distributed protocols that allow multiple interacting generative systems to coordinate using only local communication while providing theoretical guarantees on convergence, training stability, and the influence of network structure on coordination quality. The project also establishes when a generative process can serve as a feedback policy for physical systems by characterizing the sensitivity of the generated decisions to the system state, the requirements for real-time implementation, and the conditions under which interconnected generative policies remain collectively stable. The research combines tools from control theory, including barrier certificates, sensitivity analysis, and interconnection theorems, with the mathematics of stochastic generative processes. The resulting theoretical contributions will be validated experimentally on a multi-robot testbed, connecting mathematical guarantees to measured performance on safety, coordination, and closed-loop tasks. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
LOADING MOONBASE SCORE
Questions for University of California-Irvine
Answered by the team behind this research.
No questions yet. Sign in to ask the first one
Related grants
Same institution, same topic, scored first.
- NIH · University of California-Irvine64
The thalamic paraventricular nucleus mediates the influence of early-life adversity on reward-seeking behaviors
Cassandra Leigh Kooiker · $55K · 2021–2025
- NIH · University of California-Irvine63
The role of context in sleep-related memory reactivation in humans
Eitan Schechtman-Drayman · $249K · 2022–2026
- NIH · University of California-Irvine60
The relationship between neuronal activity and stroke
Ron D Frostig · $416K · 2022–2027