“Tom McGrath has been encouraged by early work applying interpretability to alternative architectures like Mamba, which have seemed 'remarkably interpretable'.”