Mock exam — Advanced Level, Session 10
« Mock exam & final project »
Program : Applied AI — Yann Isola Format: 30 MCQs (MCQ = Multiple Choice Questionnaire), exam conditions — only one correct answer per question Duration : 45 minutes (i.e. 90 seconds per question, the actual pace of the exam ⚠) Threshold : 22/30 (≈ 72%, aligned with the certification threshold ⚠) Weighting by domain (aligned with the official exam ⚠):
| Domain | Weight exam ⚠ | Questions here |
|---|---|---|
| D1 — Architecture & agent orchestration | 27 % | Q1–Q8 (8) |
| D2 — Tool design & MCP integration | 18 % | Q9–Q13 (5) |
| D3 — Configuration & workflows Claude Code | 20 % | Q14–Q19 (6) |
| D4 — Prompt engineering & structured output | 20 % | Q20–Q25 (6) |
| D5 — Context management & reliability | 15 % | Q26–Q30 (5) |
⚠ Volatility: The exam format (60 questions, 90 minutes, threshold 720/1000 ≈ 72%), domain weightings and API behaviors described reflect the documentation at the time of writing. Check the official Anthropic certification page before booking the exam.
Instructions for use: take this mock exam in real conditions — timer started, no documentation, all questions answered (no penalty for a wrong answer). Then correct with the explanations, and report the score by domain in the preparation dashboard (session web page).
Domain 1 — Architecture & agent orchestration (Q1–Q8)
Q1 — Single agent or orchestrator?
A fintech company builds a support assistant that must: (1) answer questions about fees, (2) analyze PDF statements for anomalies, (3) write regulatory complaint letters. Each capability requires a lengthy system prompt and different tools. A single agent begins to confuse the instructions. Which architectural evolution is most justified?
Q2 — Context isolation of subagents
A document retrieval agent launches 4 sub-agents in parallel, each exploring a different source, then synthesizes their reports. What is the benefit main of this architecture compared to a single agent who would explore the 4 sources sequentially?
Q3 — Consensus pattern
In which case is the pattern “N agents evaluate independently, then vote/aggregate”? better justified?
Q4 — Router: classifier or agent?
A router must direct each incoming ticket to one of 5 queues. Traffic is 80,000 tickets/day. Which implementation to favor?
Q5 — Placement of the human in the loop
A reimbursement management agent can: consult a file (read), calculate an amount (calculation), issue a transfer (irreversible action). Where to place the mandatory human validation?
Q6 — Recovery from incident in a parallel fan-out
An orchestrator launches 6 sub-agents in parallel. Subagent #4 fails (timeout of an external tool). Which production strategy is the most robust?
Q7 — Status and session resume (SDK Agent)
An onboarding agent leads a 12-step process that can span several days. The user returns to step 7. Which approach is correct?
Q8 — Workflow or agent?
Which of these four tasks warrants autonomous agentic loop (the agent decides its next actions) rather than a workflow with fixed steps?
Domain 2 — Tool design & MCP integration (Q9–Q13)
Q9 — Lever #1 in tool selection
An agent has 12 tools and regularly chooses an unsuitable one. The JSON schemas of the parameters are correct. Which is the most effective correction lever first?
Q10 — MCP: tools, resources, prompts
In MCP (MCP = Model Context Protocol, open protocol for connection between AI applications and external systems), a server exposes three primitives. What assignment is correct for an "internal knowledge base" server?
Q11 — Granularity of tools
An internal MCP server exposes 22 tools, including get_client_name , get_client_email , get_client_phone , get_client_address … The agent makes multiple calls and saturates his context. Which redesign is best?
Q12 — Choice of MCP transport
A team is hesitating between stdio transport and HTTP (streamable) transport for its MCP servers. Which statement is correct?
Q13 — Tool errors: who should see them?
A tool reserver_salle fails because the room is already taken. What design allows the agent to to recover instead of failing?
Domain 3 — Configuration & workflows Claude Code (Q14–Q19)
Q14 — Role of CLAUDE.md
What should the file contain first? CLAUDE.md at the root of a repository for a team of 12 developers?
Q15 — Headless mode in CI
In a CI pipeline (CI = Continuous Integration), which invocation is correct for a non-interactive automatic review whose output will be parsed by a script?
Q16 — Slash vs commands CLAUDE.md
What information belongs to a slash command (file in .claude/commands/) rather than CLAUDE.md ?
Q17 — Outline mode
In which case the plan mode of Claude Code (exploration and proposal without modification of files) provides the most value?
Q18 — Team permissions
A team wants Claude Code, on the shared repository, to always be able to run tests and linter, but never git push without validation. Which mechanism is the right one?
Q19 — PR review automation
For an automatic review of each PR (PR = Pull Request, code merger proposal), which integration is most suitable?
Domain 4 — Prompt engineering & structured output (Q20–Q25)
Q20 — Prefilling + stop_sequences
You end the query with the message {"role": "assistant", "content": "<verdict>"} and pass stop_sequences: ["</verdict>"]. The model generates “compliant and I specify…”. What does your application receive in the response text?
Q21 — Counterproductive Chain of Thought
On which task does the addition of step-by-step reasoning (CoT — Chain of Thought) risk degrade performance?
Q22 — Guarantee schema-compliant JSON
Your downstream pipeline crashes at the slightest invalid JSON. What approach gives the strongest guarantee structural compliance?
Q23 — Composition of a few-shot game
With a budget of 5 few-shot examples for a conformance classifier, which composition is the most effective?
Q24 — Long context: placement
You submit an 80-page contract and a specific question. What organization of the prompt maximizes response quality?
Q25 — Design an evaluation harness
To continuously evaluate an invoice data extraction pipeline, which harness is best designed?
Domain 5 — Context management & reliability (Q26–Q30)
Q26 — Long agent: manage context saturation
An analysis agent has been running for 2 hours; its context approaches the limit. Which production strategy is most suitable?
Q27 — Prompt caching: invalidation
Your application uses the prompt cache (prompt caching: paid reuse at a reduced price ⚠ of the prompt prefixes already processed). What modification invalid the cache of a marked prefix?
Q28 — Reduce hallucinations in the RAG system
A documentary assistant (RAG — Retrieval-Augmented Generation) sometimes invents references. What combination of measures is most effective?
Q29 — API error resilience
Your service receives errors 429 (rate limit) and 529 (overload ⚠) during peak hours. Which customer strategy is correct?
Q30 — Traceability and provenance in production
For an AI system subject to regulatory audit, what should be logged as a minimum to reconstruct Why the system produced a given response?