Find a story
Search Spins
Search titles, summaries, and missing voices across published articles — press releases, announcements, and media coverage.
0 results for “speculative decoding”
Speculative Decoding in vLLM on AMD GPUs
A forum thread on Hacker News discusses speculative decoding performance for vLLM on AMD GPUs, with no original reporting, data, or announcement — only user commentary.
Sep 7, 2026
Presentation: Producing the World's Cheapest Tokens: A How-to Guide
Meryem Arik presents architectural strategies to drastically reduce LLM inference costs for batched, non-real-time workloads through hardware selection, runtime optimization, speculative decoding, and queue management.
Aug 11, 2026
SpecLA: Efficient Speculative Decoding for Linear-Attention Models
SpecLA is a new speculative decoding runtime designed specifically for linear-attention models, enabling up to 1.70x end-to-end speedup by addressing recurrent-state verification challenges that existing speculative systems ignore.
Jul 21, 2026