Systems session 3/3 · Instructor guide

KV-cache sizing and optimization

Assumptions

State architecture assumptions before using the formula. Compare the estimate with runtime telemetry and discuss fragmentation and implementation overhead.

60 min

  1. 10 min — framing
  2. 20 min — concepts
  3. 20 min — measured activity
  4. 10 min — review