hacker news Hacker News
  1. new
  2. show
  3. ask
  4. jobs

Ask HN: What is the best LLM for consumer grade hardware?

240 points

by VladVladikoff

6 months ago

182 comments

story

I have a 5060ti with 16GB VRAM. I’m looking for a model that can hold basic conversations, no physics or advanced math required. Ideally something that can run reasonably fast, near real time.

loading...