Quiz with answers — Residual streams and attention over depth
Answer all eight questions, then check the score. Open only the explanations needed for remediation.
1. Solve the worked-case variant: Increase the third checkpoint score from 2 to 2.4 in [0,1,2]. Recompute depth-softmax weights.
Show answer
D. Weights move from about [0.090,0.245,0.665] to [0.068,0.184,0.748]. Retrieval concentrates more on the third checkpoint while retaining nonzero contributions from the other two. The correct answer executes the requested change and gives a checkable result; the other texts do not close this calculation or trace.
2. Which causal order correctly connects the first three stages of “Residual streams and attention over depth”?
Show answer
A. Residual connection → Dilution → Depth states The chain follows the taught progression; reversing stages consumes a representation or state before it is produced.
3. If “Depth states” is removed, which diagnostic method is defensible?
Show answer
B. Keep the same input, predict the first output that depends on “Depth states,” then compare the before/after trace. One intervention and a prior prediction make the delta attributable to the removed mechanism.
4. Which verdict respects this session’s validity boundary?
Show answer
C. AttnRes is presented as a course mechanism and source-reported case study; exact Kimi K3 details require a primary source. The correct answer bounds the conclusion; the others turn a local relation into a global guarantee.
5. Which evidence best matches the stated status of “Residual streams and attention over depth”?
Show answer
D. Mixed: established mechanisms + source-reported Kimi K3-style choices. Product or mechanism evidence must remain attributed and measured; availability and completion do not prove value.
6. When should a simpler baseline be preferred to “Blocking”?
Show answer
B. When a controlled test shows equivalent quality with lower memory, latency, or complexity. The choice depends on a measured trade-off on the real workload, not novelty or one isolated metric.
7. A learner gets the right result but cannot explain “Dilution.” Which remediation is most useful?
Show answer
A. Rebuild the first missing transformation, label its inputs and outputs, then test a neighboring case. The remediation targets the first causal break and then requires transfer instead of rewarding a guessed result.
8. Which submission actually demonstrates the outcome “Evaluate storage cost.”?
Show answer
C. A trace with starting data, transformations, observed result, boundary, and next experiment. The correct submission makes the reasoning reproducible and the verdict revisable by future measurement.