Quiz with answers — Mixture-of-Experts: routing and capacity
Answer all eight questions, then check the score. Open only the explanations needed for remediation.
1. Solve the worked-case variant: Increase the first expert score from 2.1 to 2.52 and keep [1.8,0.2] for the others. Recompute softmax and check whether top-2 changes.
Show answer
C. Weights move from about [0.529,0.392,0.079] to [0.631,0.307,0.062]. Experts 1 and 2 remain top-2, but expected load concentrates more on expert 1; capacity and overflow policy become more critical. The correct answer executes the requested change and gives a checkable result; the other texts do not close this calculation or trace.
2. Which causal order correctly connects the first three stages of “Mixture-of-Experts: routing and capacity”?
Show answer
D. Why experts → Router → Top-k and mixture The chain follows the taught progression; reversing stages consumes a representation or state before it is produced.
3. If “Top-k and mixture” is removed, which diagnostic method is defensible?
Show answer
A. Keep the same input, predict the first output that depends on “Top-k and mixture,” then compare the before/after trace. One intervention and a prior prediction make the delta attributable to the removed mechanism.
4. Which verdict respects this session’s validity boundary?
Show answer
B. Activation names and exact expert counts attributed to a named model remain source-reported until primary evidence is attached. The correct answer bounds the conclusion; the others turn a local relation into a global guarantee.
5. Which evidence best matches the stated status of “Mixture-of-Experts: routing and capacity”?
Show answer
C. Mixed: established mechanisms + source-reported Kimi K3-style choices. Product or mechanism evidence must remain attributed and measured; availability and completion do not prove value.
6. When should a simpler baseline be preferred to “Load balancing”?
Show answer
D. When a controlled test shows equivalent quality with lower memory, latency, or complexity. The choice depends on a measured trade-off on the real workload, not novelty or one isolated metric.
7. A learner gets the right result but cannot explain “Router.” Which remediation is most useful?
Show answer
A. Rebuild the first missing transformation, label its inputs and outputs, then test a neighboring case. The remediation targets the first causal break and then requires transfer instead of rewarding a guessed result.
8. Which submission actually demonstrates the outcome “Separate total and active parameters.”?
Show answer
B. A trace with starting data, transformations, observed result, boundary, and next experiment. The correct submission makes the reasoning reproducible and the verdict revisable by future measurement.