Speculative Decoding in vLLM on AMD GPUs

68 points

by ankitg12

5 hours ago

19 comments