Quiz with answers — Linear attention and fixed-size matrix memory
Answer all eight questions, then check the score. Open only the explanations needed for remediation.
1. Solve the worked-case variant: For write k=[1,0], replace v=[2,3] with v=[2.4,3]. Recompute S and then read with q=[1,0].
Show answer
A. S becomes [[2.4,3],[0,0]] and qᵀS reads [2.4,3]. Only the first coordinate of the written value changes; selection through k and q is unchanged. The correct answer executes the requested change and gives a checkable result; the other texts do not close this calculation or trace.
2. Which causal order correctly connects the first three stages of “Linear attention and fixed-size matrix memory”?
Show answer
C. Matrix foundations → Dot product → Outer product The chain follows the taught progression; reversing stages consumes a representation or state before it is produced.
3. If “Outer product” is removed, which diagnostic method is defensible?
Show answer
B. Keep the same input, predict the first output that depends on “Outer product,” then compare the before/after trace. One intervention and a prior prediction make the delta attributable to the removed mechanism.
4. Which verdict respects this session’s validity boundary?
Show answer
D. Fixed memory means neither perfect memory nor infinite context: capacity and interference remain bounded. The correct answer bounds the conclusion; the others turn a local relation into a global guarantee.
5. Which evidence best matches the stated status of “Linear attention and fixed-size matrix memory”?
Show answer
A. Established mechanisms; numerical simplifications are pedagogical. Product or mechanism evidence must remain attributed and measured; availability and completion do not prove value.
6. When should a simpler baseline be preferred to “Fixed memory”?
Show answer
C. When a controlled test shows equivalent quality with lower memory, latency, or complexity. The choice depends on a measured trade-off on the real workload, not novelty or one isolated metric.
7. A learner gets the right result but cannot explain “Dot product.” Which remediation is most useful?
Show answer
B. Rebuild the first missing transformation, label its inputs and outputs, then test a neighboring case. The remediation targets the first causal break and then requires transfer instead of rewarding a guessed result.
8. Which submission actually demonstrates the outcome “Diagnose interference.”?
Show answer
D. A trace with starting data, transformations, observed result, boundary, and next experiment. The correct submission makes the reasoning reproducible and the verdict revisable by future measurement.