“Erasing the LSTM hidden state of the Rubik's Cube policy during a trial caused the time-to-complete a flip to increase, indicating the policy relies on memory to adapt to the environment.”