A common failure mode when training world models is "trivial collapse," a local minimum in the op..., Sonic AI
“A common failure mode when training world models is "trivial collapse," a local minimum in the optimization landscape where the model predicts every state is the same.”