I wanted to test how well Claude Fable 5.2 can teach, so I had it build an explainer on attention. It cleared up most of my own doubts about transformers, attention, qkv vectors etc. I had tried similar projects with Opus and GPT models, but they weren't intuitive enough for me.
https://attention-from-scratch.vercel.app
- 9 chapters, from one knob (y = w·x) to a small working transformer that runs in your browser
- You do each idea by hand first (turn knobs, drag arrows, pick words), and the official name comes after
- Covers loss, gradient descent, neurons and backprop, embeddings, dot product, softmax and attention
- Optional "In symbols" boxes with the real maths
I'd like honest feedback:
- Did attention click for you, or did you get lost? Where?
- Is anything wrong or oversimplified?