LLM foundations

This section builds a first chatbot, traces how a transformer processes context, and compares dense, mixture-of-experts, multimodal, and diffusion-style models.

Planned lessons

1. A small chatbot using an OpenAI-compatible API
2. Tokens, embeddings, attention, and transformer blocks
3. Choosing a model family for latency, quality, privacy, and cost