hacker news Hacker News
  1. new
  2. show
  3. ask
  4. jobs

Ask HN: Is there any good open source model with reliable agentic capabilities?

4 points

by baalimago

1 days ago

story

I don't want to send my data to third party vendors all the time. But from my experience, the LLMs needs to be quite beefy in order to understand tool-calling, especially at longer contexts (200k+).

Before I dive headlong into investigating this and spend money on a project doomed to fail, do anyone have experience with a local model which can handle this sort of workload? I intend to run it on decent gaming CPU with 64-128GB ram.

loading...