“Induction heads are a type of attention head in transformers that enable a form of in-context learning by searching for previous patterns and copying the subsequent token.”