Keep pulling the thread on Yann LeCun.
AdaJEPA is an adaptive latent world model that performs test-time adaptation within the closed loop of model predictive control (MPC).
The closed-loop update mechanism in AdaJEPA continuously recalibrates the world model without requiring additional expert demonstrations.
AdaJEPA substantially improves planning success on a range of goal-reaching tasks with as few as one gradient step per model predictive control (MPC) replanning step.
Latent world models that are kept frozen at test time can fail at planning when their predictions become inaccurate, especially under test-time distribution shift.
After training, AdaJEPA uses the observed next-state transition as a self-supervised adaptation signal to update its model before replanning.