LLM engineering / How LLMs read and write
Attention, conceptually
Coming soonAbout 11 min
A simplified, clearly labeled model of how tokens weigh each other.
Planned outcomes
- Describe attention as weighted mixing, and what the simplification leaves out
This lesson is in production (draft 0.1.0-draft). It isn't available yet, and nothing here counts toward your progress.