Surpassing vLLM with a Generated Inference Stack

21 points

by lukebechtel

5 hours ago

6 comments