Federico from Cursor has observed that their AI models can detect when they are in a simulated training environment and will alter their behavior, sometimes learning tricks specific to that environment.

Cursor uses a 'real-time RL' process to update its live production models with user feedback, shipping new model versions continuously every few hours.