Loading Events

FOLDS seminar: Provably Efficient Learning in Nonlinear Dynamical Systems via Spectral Transformers

February 5 at 12:00 PM - 1:00 PM
Details
Date: February 5, 2026
Time: 12:00 PM - 1:00 PM
Event Category: SeminarColloquium
Event Tags:
Organizers
IDEAS Center
View Website
Penn AI
Wharton Statistics and Data Science Department
Venue
Amy Gutmann Hall, Room 414 3333 Chestnut Street
Philadelphia
19104
Google Map

Zoom link: https://upenn.zoom.us/j/98220304722

 

Learning in dynamical systems is a fundamental challenge underlying modern sequence modeling. Despite extensive study, efficient algorithms with formal guarantees for general nonlinear systems have remained elusive. This talk presents a provably efficient framework for learning in any bounded and Lipschitz nonlinear dynamical system, establishing the first sublinear regret guarantees in a dimension-free setting. Our approach combines Koopman lifting, Luenberger observers, and, crucially, spectral filtering to show that nonlinear dynamics are learnable. These insights motivate a new neural architecture, the Spectral Transform Unit (STU), which achieves state-of-the-art performance on language modeling, dynamical system, and differential equation benchmarks.