In vanilla speculative decoding, it is possible to sample an extra "bonus" token for free at the ..., Sonic AI
“In vanilla speculative decoding, it is possible to sample an extra "bonus" token for free at the point of rejection without requiring an additional forward pass.”