Series
Inside LLMs
2 posts
- 1 From Common Crawl to the Base Model: How an LLM Learns Language
What a base LLM is and how it is built: Common Crawl and FineWeb data, tokenization, Transformer pre-training and why the base model is not a chatbot yet.
- 2 From Base Model to ChatGPT: SFT, Tools and Reinforcement Learning
How an LLM base model becomes ChatGPT: supervised fine-tuning, tool use, hallucination reduction and reinforcement learning explained clearly and in depth.