“The hardware requirements for LLMs have evolved to demand support for much larger matrices, growing from dimensions of around 128 to many thousands.”