The v0.5.0 release brings significant architectural improvements to speculative decoding model training, introducing DFlash algorithm support, fully unified online training capabilities, and a...
Speculators v0.5.0: DFlash Support and Online Training
Source:vLLM Blog ↗