“The Transformer architecture does not perform compression in the time domain, as it retains all previous information in its context window.”