We will begin by discussing the limitations inherent in the training of Physics-Informed Neural Networks (PINNs), which, despite their conceptual appeal, often face practical challenges (such as convergence issues, sensitivity to hyperparameters, and the need of large data volume). In a second step, we will recast and characterize the problem of physics-informed learning as a kernel method....
In this work, we explore the use of compact latent representations with learned time dynamics ('World Models') to simulate physical systems. Drawing on concepts from control theory, we propose a theoretical framework that explains why projecting time slices into a low-dimensional space and then concatenating to form a history ('Tokenization') is so effective at learning physics datasets, and...