SonicSampler supports dynamic per-request sampling behaviors, including grammar-constrained decod..., Sonic AI
“SonicSampler supports dynamic per-request sampling behaviors, including grammar-constrained decoding, various penalties, filtering methods, and speculative verification, within a single batched kernel.”