“Doug O'Loughlin believes that even if KV Cache compression techniques reduce memory usage, users will simply increase their context length, negating any reduction in overall memory demand.”