DCAI
← 返回全部动态
arXiv 自然语言处理规则精选09月24日 12:00

When Parallel Drafter Meets Parallel Speculative Decoding

arXiv:2609.27396v1 Announce Type: new Abstract: DSpark-style parallel drafters have made speculative decoding highly effective, yet their draft phase remains serialized on the critical path of every round. Parallel speculative decoding (PSD) overlaps drafting with verification, yet existing methods must guess the accepted prefix and bonus token in advance: a wrong guess reverts the whole batch to serial drafting. We present DPara, a PSD framework that reuses effective parallel drafters yet guarantees backbone--verification overlap in every round, thereby eliminating this probabilistic fallback altogether. While the target verifies, DPara's di

阅读 arXiv 自然语言处理 原文 ↗