“The KV cache for a single Wikipedia article can require 80 gigabytes of HBM memory on a GPU.”