Speculative Decoding Implementations: EAGLE-3, Medusa-1, PARD, Draft Models, N-gram and Suffix Decoding from scratch

I’ve been working on an educational implementation repo for speculative decoding: The goal is not to wrap existing libraries, but to implement several speculative decoding methods from scratch behind a shared decoding/evaluation contract so that the differences between proposer designs are easier to study. Implemented methods so far: EAGLE-3 Medusa-1 standard draft model speculation PARD / parallel draft models n-gram prompt lookup suffix decoding The repo has both training and inference paths w

More from Reddit

Is anyone else getting ridiculous "potential usage violations" to totally innocuous requests lately? Of all things animating elements on a webpage is potentially risky now?

Reddit

I add CatchEm and now i catch this cool characters while working with Claude

Reddit

My Chat history is getting deleted like crazy since 5.5 released. Is anyone else having this issue? I had a chat deleted mid-conversation

Reddit

What Claude Design does really well (and not so well)

Reddit

HUMANS.md

Reddit

Sabastian Sawe runs first sub-2-hour marathon race, shatters world record in London

Reddit