Hypura – A storage-tier-aware LLM inference scheduler for Apple Silicon

159 points

by tatef

4 hours ago

66 comments