Summary
Decoupled Contrastive Decoding (DCD) uses EAGLE3-style expert-aligned drafting to reach 1.65-1.95x speedup over vanilla contrastive decoding. Code is available on GitHub.
Why it matters
For anyone working on inference acceleration, this is a low-cost paper to verify: the method is practical and the code is released.
Technical details
| Speedup | 1.65-1.95x vs vanilla contrastive decoding |
|---|---|
| Code | github.com/chadlzx/dcd |
Tags
decodingcontrastiveeagle3inference