hacker news Hacker News
  1. new
  2. show
  3. ask
  4. jobs

Ask HN: Build Your Own LLM?

5 points

by retube

1 days ago

8 comments

story

The best way to really understand how something works is to build it yourself. So I am wondering if there are any good tutorials on building your own LLM from scratch. I.e. implementing tokenisation, embeddings, attention and so on. I am not suggesting one could replicate chatGPT, but more a toy model that implements the core features but based on a much smaller corpus and training data.

loading...