The Speculative-Speculative Decoding (SSD) algorithm provides improvements in both latency and th..., Sonic AI
“The Speculative-Speculative Decoding (SSD) algorithm provides improvements in both latency and throughput, whereas standard speculative decoding is typically only a clear win for latency.”