Quiz — Advanced Level, Session 9
“Certification scenarios”
Program : Applied AI — Yann Isola Format: 15 MCQs (MCQ = Multiple Choice Questionnaire) in the exact format of the exam Claude Certified Architect — situation, question, 4 options, only 1 correct answer Duration : 22 minutes (exam pace: ~90 s/question) Threshold : 11/15 (≈ 72%, aligned with the certification threshold ⚠) Distribution by domain (proportional to exam weightings): D1 Architecture & orchestration ×4 · D2 Tools & MCP ×3 · D3 Claude Code ×3 · D4 Prompts & structured output ×3 · D5 Context & reliability ×2
⚠ The API behaviors, CLI flags, configuration paths, and Batch API settings described reflect the documentation at the time of writing and are volatile : check the official Anthropic documentation.
Domain 1 — Architecture & agent orchestration (4 questions)
Q1 — Stopping the agentic loop (Scenario 8)
Situation : An autonomous file processing agent loop: API call → execution of the requested tools → return of results. The developer implemented the stopping condition as follows: the loop ends when the helper text contains "task completed", with a guardrail of 10 iterations maximum as the main stopping mechanism.
What is the main problem with this design?
Q2 — Partial coverage of a multi-agent report (Scenario 3)
Situation : A coordinator + sub-agent system researches “the impact of AI on the health sector”. The final report only covers medical imaging and diagnostic assistance. The logs show that the coordinator created three subtasks: “AI in radiology”, “AI in pathology image analysis”, “AI and assisted diagnosis”. Each sub-agent produced complete and correctly sourced work on its sub-task.
What is the root cause?
Q3 — Passing context to subagents (Scenario 3)
Situation : In a research pipeline, the coordinator conducted a phase 1 analysis that produced key findings. It then generates a sub-editorial agent via the tool Task with the prompt: “Write the final report based on the conclusions of phase 1”. The subagent produces a generic report unrelated to the findings.
For what ?
Q4 — Guaranteed execution order (Scenario 1)
Situation : A banking support agent must verify the identity (get_customer ) before any financial transaction (process_refund ). The audit shows that in 7% of cases, the agent processes the reimbursement without prior verification, despite an instruction in capital letters in the prompt system: “ALWAYS CHECK IDENTITY FIRST”.
What correction provides a guarantee?
Domain 2 — Tool design & MCP integration (3 questions)
Q5 — Poor routing between similar tools (Scenario 1)
Situation : An agent has get_customer (“Gets customer info”) and lookup_order (“Looks up orders”). For questions about orders, call get_customer in 30% of cases. The team hesitates between four corrections.
Which one to apply first?
Q6 — Taxonomy of tool errors (Scenario 8)
Situation : The MCP tool process_refund fails in three ways: (1) payment gateway timeout, (2) amount exceeding the limit allowed by internal policy, (3) invalid transaction ID format. Currently, all three return {"isError": true, "message": "Operation failed"}. The agent systematically retries the three cases in a loop.
Which error response recast is correct?
Q7 — Sharing an MCP server as a team (Scenario 4)
Situation : A team of 12 developers wants the internal MCP “product catalog” server to be available to everyone from the repository clone, with authentication by individual token. A developer suggests adding the server with its token in ~/.claude.json and share this file on the wiki.
What is the correct configuration?
Domain 3 — Configuration & Claude Code workflows (3 questions)
Q8 — Conventions by file type (Scenario 2)
Situation : A monorepo contains strict testing conventions that apply to all files **/*.test.ts , which are co-located with the source code in dozens of directories. Developers want Claude Code to load these conventions uniquely when it edits test files, to save context.
Which configuration to choose?
Q9 — Claude Code blocked in CI (Scenario 5)
Situation : A GitLab CI job executes claude "Génère les tests manquants pour ce module" and remains suspended until the runner timeout. The same prompt works perfectly on the developer's workstation.
What is the documented fix?
Q10 — Architectural restructuring (Scenario 2)
Situation : You entrust Claude Code with the extraction of a billing service from a monolith: ~45 files affected, several possible divisions, choices of service boundaries to arbitrate. A colleague suggests: “launch it in direct execution with very detailed instructions, you will switch to plan mode if it goes badly”.
Which approach to recommend?
Domain 4 — Prompt engineering & structured output (3 questions)
Q11 — Strict schema, persistent errors (Scenario 6)
Situation : An invoice extraction pipeline uses tool_use with a strict JSON schema and tool_choice strength. The JSON produced is always syntactically valid and conforms to the schema. However, 4% of extractions contain errors: amount excluding tax placed in the including tax field, sum of lines different from the total extracted.
Which analysis is correct?
Q12 — Missing fields and hallucination (Scenario 6)
Situation : The contract extraction scheme imposes date_resiliation in the field required of string type. On contracts of indefinite duration – which do not have a termination date – the model produces plausible but invented dates. The team adds to the prompt: “never invent a date”, without any notable improvement.
What fundamental correction?
Q13 — False positives in automated code review (Scenario 5)
Situation : An automated PR review flags too many false positives, focused on style and naming remarks, which means developers also ignore security alerts — even though they are reliable. The current prompt asks: “do a thorough review and be thorough.”
Which prompt redesign is the most effective?
Domain 5 — Context management & reliability (2 questions)
Q14 — Progressive summary and transactional facts (Scenario 7)
Situation : A claims assistant conducts 100+ round conversations. To contain the context, ancient tricks are gradually summarized. Customers complain: in the 60th round, the assistant gets the deductible amount announced in the 5th round and the file number wrong – successive summaries have transformed them into “the conditions have been discussed”.
What architectural correction?
Q15 — Automate based on a global metric (Scenario 6)
Situation : An extraction pipeline shows 97% overall accuracy on the validation set. Management wants to eliminate the human magazine. An audit by segments reveals: 99% on native invoices (85% of the volume), but 71% on degraded scans and 64% on the IBAN field (IBAN = International Bank Account Number) of delivery notes — field used for transfers.
What architectural decision?