RouteLLM: A framework for serving and evaluating LLM routers

244 points

by djhu9

8 months ago

36 comments