DSA Studio

Mini-GPT: End-to-End Language Model Checkpoint

Apply the module contracts to concrete traces and diagnose failures.

Get every question correct to pass this checkpoint. You can review feedback, revise your answers, and submit again.

1. For inputs [0,1,2] and [0,1,0], which MiniGPT logit rows must match under the same parameters?

Select one answer.

2. With maximum context 4 and a six-token generation seed, what should happen?

Select one answer.

3. A tiny model has 292 distinct parameters but parameters() returns 536 entries. The block has 244 parameters. What likely happened?

Select one answer.

4. Uniform logits for V=3 at three positions produce what mean next-token loss?

Select one answer.

Join Discord