I85PREP
⌘ K
Claude Certified Architect - Foundations study materials
Claude Certified Architect - Foundations study resources

Claude Certified Architect - Foundations practice questions

One question at a time. Build your Claude Certified Architect - Foundations understanding.

First 50 of 200 questions. Each one lists the choices, the correct answer, and an explanation. The checker at the top of this page saves progress in this browser when it is available.

Continue in the practice tool above to load more questions, 50 at a time.

Question 1Claude Fundamentals and Model Capabilities

Which statement best describes how a large language model generates a response to a prompt?

  1. It searches the public internet in real time before every reply.
  2. It compiles the prompt into executable code and runs it.
  3. It predicts the next token repeatedly based on patterns learned during training. Correct answer.
  4. It retrieves a stored answer from a fixed database of prior conversations.

Explanation

Language models generate text autoregressively: at each step the model estimates a probability distribution over the next token given the preceding context, samples or selects a token, and repeats. This is a learned statistical process, not retrieval from a fixed answer store or code execution.

Question 2Claude Fundamentals and Model Capabilities

A prompt includes a long document followed by a question about it. What is the primary role of the model's context window in this scenario?

  1. It sets the maximum length of the model's final answer only.
  2. It controls how many documents the model can store permanently.
  3. It limits the number of users who can query the model concurrently.
  4. It determines the maximum number of tokens the model can attend to at once. Correct answer.

Explanation

The context window bounds the total tokens the model can consider in a single request, including system prompt, input, and generated output. It is a per-request attention limit, not persistent storage or a concurrency control.

Question 3Claude Fundamentals and Model Capabilities

Which technique gives a model access to current information beyond its training cutoff at inference time?

  1. Providing retrieved documents in the prompt Correct answer.
  2. Increasing the temperature setting
  3. Fine-tuning on historical text
  4. Reducing the max output tokens

Explanation

Supplying fresh information as retrieved context (retrieval-augmented generation) lets the model reason over data it never saw in training. Temperature, token limits, and fine-tuning on old data do not introduce new knowledge.

Question 4Claude Fundamentals and Model Capabilities

What does a model's 'temperature' parameter primarily control?

  1. The number of tokens generated per second
  2. The randomness of token sampling during generation Correct answer.
  3. The size of the context window
  4. The cost per input token

Explanation

Temperature scales the sampling distribution: lower values make output more deterministic and higher values increase diversity. It does not affect throughput, context size, or pricing.

Question 5Claude Fundamentals and Model Capabilities

Which of the following is a core capability that distinguishes modern instruction-following models from simple text-completion models?

  1. Guaranteeing factual correctness on every query
  2. Following multi-step natural-language instructions Correct answer.
  3. Encrypting the prompt before processing
  4. Executing arbitrary shell commands natively

Explanation

Instruction tuning trains models to interpret and carry out natural-language directives, including multi-step tasks. They do not encrypt prompts, guarantee factual accuracy, or natively run shell commands without tools.

Question 6Claude Fundamentals and Model Capabilities

Why does providing a few worked examples in a prompt (few-shot prompting) often improve output quality?

  1. It increases the model's context window size.
  2. It permanently updates the model's weights for that task.
  3. It demonstrates the desired format and reasoning pattern in context. Correct answer.
  4. It disables the model's safety filters.

Explanation

Few-shot examples act as in-context demonstrations that show the model the expected structure, tone, and reasoning, improving alignment with the task without changing weights. They do not resize the context window or alter safety behavior.

Question 7Claude Fundamentals and Model Capabilities

A developer wants deterministic, repeatable outputs for a classification task. Which setting best supports this goal?

  1. A high temperature with top-p at 1.0
  2. A long system prompt with many examples
  3. A large max output token limit
  4. A low temperature such as 0 Correct answer.

Explanation

Setting temperature near zero makes the model favor the most probable tokens, yielding near-deterministic output. High temperature and broad top-p increase randomness, and token limits or long prompts do not guarantee determinism.

Question 8Claude Fundamentals and Model Capabilities

Which statement about a model's knowledge cutoff is accurate?

  1. The cutoff can be extended by raising the temperature.
  2. The cutoff only affects the model's output length.
  3. The model's training data ends at a certain date, so later events may be unknown. Correct answer.
  4. The model automatically learns new facts after each conversation.

Explanation

The knowledge cutoff marks the end of the training data, so events after that date are not reliably known unless supplied in context. Models do not learn from conversations, and the cutoff is unrelated to output length or temperature.

Question 9Claude Fundamentals and Model Capabilities

A team needs the model to reliably return JSON matching a specific schema. Which approach most directly improves reliability?

  1. Increasing the max output tokens substantially
  2. Removing all formatting instructions to avoid bias
  3. Describing the schema explicitly and providing a valid example in the prompt Correct answer.
  4. Raising temperature to encourage creativity

Explanation

Clearly specifying the schema and showing a conforming example gives the model an explicit target format to imitate. Higher temperature, removed instructions, or larger token limits do not enforce structure.

Question 10Claude Fundamentals and Model Capabilities

What is a 'system prompt' used for in a Claude-based application?

  1. Storing the model's training weights
  2. Configuring the network endpoint for API calls
  3. Defining the model's tokenizer vocabulary
  4. Setting persistent role, tone, and behavioral guidance for the conversation Correct answer.

Explanation

The system prompt establishes durable instructions such as persona, constraints, and tone that apply across the conversation. It does not store weights, define tokenization, or configure networking.

Question 11Claude Fundamentals and Model Capabilities

A model gives a confident but incorrect answer about a niche fact. What is this behavior called?

  1. Tokenization
  2. Hallucination Correct answer.
  3. Quantization
  4. Overfitting

Explanation

Hallucination is when a model produces fluent but factually incorrect or unsupported content. Overfitting, tokenization, and quantization are training or processing concepts unrelated to this output behavior.

Question 12Claude Fundamentals and Model Capabilities

Which prompt design most reduces the chance of a model hallucinating when answering questions over a provided document?

  1. Asking the model to answer from memory first, then check the document
  2. Removing the document to keep the prompt short
  3. Increasing temperature to explore more possibilities
  4. Instructing the model to answer only from the provided document and to say when the answer is absent Correct answer.

Explanation

Grounding instructions that restrict answers to supplied context, plus an explicit fallback when information is missing, reduce fabrication. Answering from memory first, raising temperature, or removing the source all increase hallucination risk.

Question 13Claude Fundamentals and Model Capabilities

What is the main benefit of 'chain-of-thought' style prompting for complex reasoning tasks?

  1. It guarantees mathematically correct results.
  2. It eliminates the need for a system prompt.
  3. It reduces the number of tokens the model must generate.
  4. It encourages the model to work through intermediate steps before concluding. Correct answer.

Explanation

Chain-of-thought prompting elicits intermediate reasoning steps, which often improves accuracy on multi-step problems. It typically increases token usage, does not guarantee correctness, and is independent of system prompts.

Question 14Claude Fundamentals and Model Capabilities

A model's response is cut off mid-sentence. Which parameter most likely caused this?

  1. A max output tokens limit that is too low Correct answer.
  2. Top-p set to 0.9
  3. Temperature set to 0
  4. A very short system prompt

Explanation

The max output tokens parameter caps response length, so a low value truncates output. Temperature, top-p, and system prompt length do not impose a hard cap on response length.

Question 15Claude Fundamentals and Model Capabilities

Which scenario is the best fit for using extended reasoning effort on a model?

  1. Reformatting a short string to uppercase
  2. Echoing a fixed confirmation message
  3. A simple one-word classification of sentiment
  4. A multi-constraint planning problem requiring careful trade-offs Correct answer.

Explanation

Complex problems with multiple interacting constraints benefit most from additional reasoning effort. Trivial transformations and fixed messages gain little and waste latency and tokens.

Question 16Claude Fundamentals and Model Capabilities

What does 'streaming' a model response provide to an application?

  1. A guarantee of lower token cost
  2. Permanent storage of the conversation on the model server
  3. Automatic translation into multiple languages
  4. Incremental delivery of tokens as they are generated Correct answer.

Explanation

Streaming returns output tokens progressively so users see partial results before completion. It does not persist conversations, reduce token cost, or translate content.

Question 17Claude Fundamentals and Model Capabilities

A prompt asks the model to summarize a 200-page report that exceeds the context window. Which approach is most appropriate?

  1. Ask the model to ignore the length limit
  2. Raise temperature until the whole document fits
  3. Chunk the document, summarize each chunk, then combine the summaries Correct answer.
  4. Disable the system prompt to free space

Explanation

When input exceeds the context window, chunking with per-chunk summaries followed by a combining pass (map-reduce summarization) handles the document within limits. Temperature, system prompts, and instructions cannot expand the window.

Question 18Claude Fundamentals and Model Capabilities

Which practice best mitigates prompt injection when a model processes untrusted user content?

  1. Increasing the model's temperature
  2. Removing all system instructions
  3. Trusting all content in the prompt equally
  4. Separating untrusted content and instructing the model to treat it as data, not instructions Correct answer.

Explanation

Delimiting untrusted content and telling the model to treat it as data rather than commands reduces the risk that embedded text hijacks behavior. Trusting content, removing instructions, or raising temperature weakens defenses.

Question 19Claude Fundamentals and Model Capabilities

What is the purpose of the 'assistant' turn in a multi-turn conversation structure?

  1. It stores the model's configuration parameters.
  2. It represents prior model outputs that the model can reference for continuity. Correct answer.
  3. It encrypts the conversation history.
  4. It defines the tokenizer used for the request.

Explanation

Prior assistant messages are part of the conversation history, letting the model maintain context and continuity across turns. They are not configuration storage, encryption, or tokenizer definitions.

Question 20Claude Fundamentals and Model Capabilities

An application needs the model to extract fields from invoices with high consistency. Which combination of techniques is most effective?

  1. Multiple contradictory instructions to test the model
  2. A vague instruction and a long max token limit
  3. High temperature with no examples
  4. Clear field definitions, a schema example, and low temperature Correct answer.

Explanation

Precise field definitions plus a conforming example and low temperature maximize consistency for structured extraction. High temperature, vague instructions, contradictions, or large token limits do not improve reliability.

Question 21Claude Fundamentals and Model Capabilities

A model performs well on a benchmark but poorly on real user queries. Which explanation is most plausible?

  1. The model's context window shrank after deployment
  2. The tokenizer was replaced at runtime
  3. The benchmark queries differ in distribution from real usage, revealing a generalization gap Correct answer.
  4. The temperature was permanently fixed at zero

Explanation

A gap between benchmark and production performance usually reflects distribution shift: benchmark examples do not represent real inputs. Context windows, temperature, and tokenizers do not spontaneously change at deployment.

Question 22Claude Fundamentals and Model Capabilities

Why can simply adding more few-shot examples eventually degrade performance?

  1. The model stops tokenizing input beyond ten examples
  2. Examples permanently overwrite the model's weights
  3. Examples consume context and can introduce conflicting or noisy patterns Correct answer.
  4. Each example doubles the inference cost of the model itself

Explanation

More examples consume context budget and may add inconsistent patterns that confuse the model, sometimes hurting accuracy. There is no hard example limit, weights are unchanged, and per-example cost reflects tokens rather than doubling model cost.

Question 23Claude Fundamentals and Model Capabilities

A team observes that the model ignores a constraint buried in the middle of a very long prompt. Which factor best explains this?

  1. The model has no tokenizer for mid-prompt text
  2. The system prompt was placed first
  3. Attention can be weaker for information positioned in the middle of long contexts Correct answer.
  4. The temperature was set to zero

Explanation

Models can attend less reliably to details in the middle of long contexts, a known positional effect. Tokenizers cover all text, and system-prompt placement or zero temperature do not explain mid-context misses.

Question 24Claude Fundamentals and Model Capabilities

Which design decision best balances latency and quality when a task has both simple and complex queries?

  1. Always use maximum reasoning effort for every query
  2. Route simple queries to fast settings and complex ones to higher reasoning effort Correct answer.
  3. Always disable reasoning to minimize latency
  4. Randomly vary temperature per request

Explanation

Routing by complexity allocates reasoning effort where it is needed while keeping simple queries fast, balancing quality and latency. Uniform maximum effort wastes latency, uniform minimum sacrifices quality, and random temperature adds noise.

Question 25Claude Fundamentals and Model Capabilities

A model consistently produces plausible-sounding citations that do not exist. Which mitigation is most principled?

  1. Require the model to cite only from a provided source set and verify each citation Correct answer.
  2. Remove all citation instructions
  3. Increase temperature so citations vary
  4. Ask the model to be more confident in its answers

Explanation

Restricting citations to a supplied source set and verifying them against that set grounds the output and catches fabrications. Confidence requests, higher temperature, or removing instructions do not prevent invented references.

Question 26Claude Fundamentals and Model Capabilities

Which statement best describes how Claude's context window constrains a single API request?

  1. It bounds the combined length of the input and the generated output. Correct answer.
  2. It applies solely to the system prompt, not to user turns.
  3. It limits only the length of the input prompt.
  4. It limits only the length of the generated output.

Explanation

The context window is the total token budget shared by everything in a request: system prompt, conversation history, the current user input, and the model's generated output. Input tokens and output tokens both draw from the same budget, so a long prompt leaves less room for a long response.

Question 27Claude Fundamentals and Model Capabilities

A support application wants Claude to answer strictly from a supplied policy excerpt and to say when the excerpt does not contain the answer. Which prompt design most directly enforces this behavior?

  1. Increase the temperature so the model explores more possible answers.
  2. Ask the model to answer helpfully and rely on its general knowledge to fill gaps.
  3. Provide several example questions without any instructions about grounding.
  4. Instruct the model to answer only from the excerpt and to state that the information is unavailable when it is absent. Correct answer.

Explanation

Grounding instructions that explicitly limit the model to the provided source and define a fallback response give the model a clear rule for when to abstain. Without such a constraint, the model may blend in parametric knowledge and produce unsupported answers.

Question 28Claude Fundamentals and Model Capabilities

A developer sends the same prompt repeatedly with temperature set to 0 and still sees occasional wording differences in the output. Which explanation is most accurate?

  1. Temperature 0 disables the model and returns a cached response.
  2. Identical output is guaranteed only when streaming is enabled.
  3. Generation remains probabilistic, so temperature 0 reduces but does not guarantee identical text. Correct answer.
  4. Temperature 0 is invalid and is silently ignored by the API.

Explanation

Temperature 0 makes the sampling distribution sharply peaked, but it does not remove every source of nondeterminism in generation. Small differences can still appear across runs, so applications should not treat temperature 0 as a strict reproducibility guarantee.

Question 29Claude Fundamentals and Model Capabilities

Which capability is a direct consequence of Claude being a large language model trained on text?

  1. It can browse the live internet on every request without any external integration.
  2. It can perform many language tasks, such as summarizing and classifying, without task-specific retraining. Correct answer.
  3. It can execute arbitrary code in the caller's environment without any tool configuration.
  4. It maintains a persistent memory of past conversations across separate API calls by default.

Explanation

A core property of large language models is general-purpose language competence: one model can handle summarization, classification, extraction, and similar tasks through prompting rather than per-task training. Persistence, code execution, and live browsing are not inherent and require explicit configuration or external systems.

Question 30Claude Fundamentals and Model Capabilities

A prompt contains a long reference section followed by the actual question. The model's answers frequently ignore details from the reference. Which change is most likely to improve adherence?

  1. Remove all formatting and line breaks from the reference section.
  2. Place the question and key instructions after the reference material so they are closest to the generation point. Correct answer.
  3. Increase the temperature to make the model attend more broadly.
  4. Move the question to the very beginning and keep the reference after it.

Explanation

Models tend to weight content near the end of the prompt more heavily, so positioning the question and critical instructions after long reference material improves adherence. This is a placement effect, not a sampling or formatting issue.

Question 31Prompt Engineering and System Prompt Design

Which XML-style tag structure does Anthropic recommend for separating distinct sections of a system prompt?

  1. Wrapping each section in descriptive tags such as <instructions> and <context> Correct answer.
  2. Using only numbered lists with no headings
  3. Separating sections with triple backticks and no labels
  4. Concatenating all sections into one paragraph without delimiters

Explanation

Descriptive tags give the model unambiguous boundaries between sections, which improves instruction-following and reduces cross-contamination between roles, context, and examples. Unlabeled delimiters leave the model to infer section purpose from content alone.

Question 32Prompt Engineering and System Prompt Design

A support assistant keeps answering with marketing language instead of the terse troubleshooting steps the product team wants. Which change to the system prompt most directly addresses this?

  1. Lower the temperature to zero
  2. Add an explicit instruction describing the desired response format and tone Correct answer.
  3. Move the user question into the system prompt
  4. Raise the max_tokens parameter so the model has room to be precise

Explanation

Style and format are governed primarily by explicit instructions in the system prompt; stating the desired format and tone directly constrains the output. Sampling parameters affect variability, not which style the model chooses.

Question 33Prompt Engineering and System Prompt Design

What is the primary purpose of assigning a role (for example, 'You are a senior tax analyst') in a system prompt?

  1. It steers vocabulary, depth, and perspective in responses Correct answer.
  2. It reduces the cost of each API call
  3. It disables the model's safety guidelines for that domain
  4. It guarantees factual accuracy on domain questions

Explanation

Role framing is a steering technique: it conditions the register, assumed expertise, and level of detail. It does not add knowledge or change safety behavior.

Question 34Prompt Engineering and System Prompt Design

You want the model to return data your application can parse reliably. Which instruction is most effective?

  1. Ask the model to 'respond in a structured way'
  2. Append 'JSON please' to the user message each time
  3. Request that the answer be short
  4. Provide a concrete output schema and an example of a valid response Correct answer.

Explanation

Supplying an explicit schema plus a worked example anchors the exact keys, nesting, and types expected. Vague requests for structure leave the shape underspecified.

Question 35Prompt Engineering and System Prompt Design

Which of the following best describes a 'system prompt' in the Claude API?

  1. A per-turn message that replaces the user's input
  2. Persistent instructions that establish behavior across the conversation Correct answer.
  3. A parameter that sets the model's sampling temperature
  4. A log of previous assistant responses

Explanation

The system prompt carries durable instructions, persona, and constraints that apply to the whole exchange rather than a single turn. It is distinct from user turns and from sampling parameters.

Question 36Prompt Engineering and System Prompt Design

When including few-shot examples in a prompt, what is the most important property of the examples?

  1. They should be written in a different language than the target output
  2. They should all be easy cases so the model succeeds
  3. They should be as long as possible to maximize context use
  4. They should be representative of the inputs the model will actually see Correct answer.

Explanation

Examples teach by pattern; their value depends on matching the distribution, edge cases, and format of real inputs. Length or ease is not the criterion.

Question 37Prompt Engineering and System Prompt Design

What does 'chain-of-thought' prompting ask the model to do?

  1. Call a tool for every step of a task
  2. Retrieve documents from an external index before answering
  3. Shorten its answer to a single sentence
  4. Produce intermediate reasoning steps before the final answer Correct answer.

Explanation

Chain-of-thought prompting elicits step-by-step reasoning so the final answer is grounded in explicit intermediate work. It is a reasoning technique, not a retrieval or tooling mechanism.

Question 38Prompt Engineering and System Prompt Design

Which practice best protects a system prompt from being overridden by text inside user-supplied documents?

  1. Instruct the model to treat document content as data, not instructions, and delimit it clearly Correct answer.
  2. Remove all instructions from the system prompt
  3. Increase temperature so the model ignores conflicting text
  4. Place the document text before the system prompt

Explanation

Prompt-injection resistance comes from establishing that retrieved or user content is untrusted data and isolating it with clear delimiters, so embedded commands are not treated as instructions. Ordering and randomness do not create that boundary.

Question 39Prompt Engineering and System Prompt Design

A system prompt says: 'Always answer in under 50 words. Provide a full legal analysis with citations.' What is the main defect?

  1. The prompt lacks a role definition
  2. The prompt uses too few tokens
  3. The prompt does not specify an output language
  4. The instructions conflict with each other Correct answer.

Explanation

When two constraints cannot both be satisfied, the model must guess which to honor, producing inconsistent behavior. Conflicting directives should be resolved or prioritized explicitly.

Question 40Prompt Engineering and System Prompt Design

You need Claude to extract fields from invoices and return them as JSON. Which prompt design is most robust?

  1. Provide the JSON schema, field definitions, and one filled example, and instruct it to output only JSON Correct answer.
  2. Describe the desired fields in prose and ask for a 'clean' response
  3. Ask the model to explain its extraction process before outputting anything
  4. Request the output as a markdown table and parse it later

Explanation

An explicit schema plus definitions and a worked example constrains key names, types, and edge-case handling, and instructing JSON-only output avoids prose wrapping. Prose descriptions and tables require downstream normalization.

Question 41Prompt Engineering and System Prompt Design

A prompt includes five examples, all of which classify sentiment as 'positive'. At inference the model labels nearly everything 'positive'. What is the most likely cause?

  1. The examples are imbalanced and teach a prior toward one class Correct answer.
  2. The temperature is set too low
  3. The model cannot perform classification
  4. The system prompt is too short

Explanation

Few-shot examples act as training signal within the context; a skewed set of demonstrations biases predictions toward the overrepresented label. Balanced examples across classes correct this.

Question 42Prompt Engineering and System Prompt Design

Which technique best improves reliability when Claude must follow a multi-step procedure with conditional branches?

  1. Remove the procedure and rely on general knowledge
  2. Ask it to summarize the procedure before starting
  3. Have it restate the applicable branch and steps before executing them Correct answer.
  4. Ask for the final answer only, with no intermediate output

Explanation

Having the model explicitly identify the relevant branch and enumerate steps makes the reasoning auditable and reduces skipped conditions. Summarizing or suppressing intermediate output hides the branch selection.

Question 43Prompt Engineering and System Prompt Design

A team wants deterministic, repeatable classification output from Claude. Which combination is most appropriate?

  1. Top-p of 1.0 with free-form answers
  2. Temperature 0 with a tightly constrained output schema and explicit labels Correct answer.
  3. Multiple parallel calls with varied prompts
  4. High temperature with a long system prompt

Explanation

Low temperature reduces sampling variability, and a constrained schema with an enumerated label set removes ambiguity in the output space. Together they maximize reproducibility.

Question 44Prompt Engineering and System Prompt Design

What is the recommended way to handle a task where the model must answer only from a provided knowledge base and otherwise decline?

  1. Instruct it to answer only questions it finds interesting
  2. Instruct it to answer from the provided documents and to say it does not know when the answer is absent Correct answer.
  3. Instruct it to use its general knowledge to fill gaps
  4. Instruct it to guess the most likely answer

Explanation

Grounding instructions plus an explicit abstention path reduce hallucination by making 'not found' an acceptable, defined outcome. Filling gaps from parametric knowledge undermines the grounding requirement.

Question 45Prompt Engineering and System Prompt Design

A prompt instructs: 'Summarize the article. Do not use more than three bullets. Each bullet must contain a citation.' Which prompt-engineering principle does this best illustrate?

  1. Eliciting chain-of-thought
  2. Reducing token cost
  3. Using role prompting
  4. Providing explicit, checkable constraints Correct answer.

Explanation

The instructions specify countable, verifiable properties of the output, which makes compliance easy to check and failures easy to detect. Role prompting and reasoning elicitation are different techniques.

Question 46Prompt Engineering and System Prompt Design

Where in a long prompt is the most effective place to put the critical formatting requirement?

  1. Only in the first sentence, never repeated
  2. Implicitly, by demonstrating it once in an example
  3. Near the end, restated clearly after the context Correct answer.
  4. Buried in the middle of a long context block

Explanation

Instructions placed near the end of a long prompt, close to where generation begins, tend to be followed more reliably, and restating a key requirement reinforces it. Burying it mid-context or relying on a single implicit cue is weaker.

Question 47Prompt Engineering and System Prompt Design

A system prompt contains a large block of retrieved reference text. What is the best way to keep the model's behavioral instructions effective?

  1. Delete the behavioral instructions to save tokens
  2. Convert the instructions into the reference text's formatting
  3. Interleave instructions randomly within the reference text
  4. Keep behavioral instructions in a distinct tagged section separate from the reference data Correct answer.

Explanation

Separating durable instructions from variable data with clear tags preserves the model's ability to distinguish rules from content. Mixing them dilutes the instructions and invites confusion with injected text.

Question 48Prompt Engineering and System Prompt Design

Which is the best reason to include an explicit 'if the request is ambiguous, ask a clarifying question' instruction?

  1. It prevents the model from silently guessing at underspecified requirements Correct answer.
  2. It allows the model to skip the system prompt
  3. It reduces the number of tokens the model generates
  4. It guarantees the model will never make an error

Explanation

Underspecified requests invite the model to fill gaps with assumptions; authorizing clarification turns a hidden guess into a visible, correctable step. It reduces risk but cannot guarantee error-free output.

Question 49Prompt Engineering and System Prompt Design

A prompt asks Claude to 'evaluate the candidate fairly.' Outputs vary widely in what criteria they apply. What is the most effective fix?

  1. Increase the temperature to capture more perspectives
  2. Ask the model to be 'more objective'
  3. Add a numbered rubric with explicit criteria and scoring guidance Correct answer.
  4. Shorten the prompt to reduce noise

Explanation

Undefined evaluative terms leave the criteria to the model's discretion; a concrete rubric fixes the dimensions and scale, making outputs comparable. Appeals to objectivity or randomness do not specify criteria.

Question 50Prompt Engineering and System Prompt Design

A system prompt says: 'You are a helpful assistant. Be concise. Be thorough. Prioritize speed. Prioritize accuracy above all.' What should the author do first?

  1. Add more adjectives to reinforce each value
  2. Resolve the conflicting priorities into an explicit ordering Correct answer.
  3. Remove the role definition
  4. Increase max_tokens

Explanation

When directives pull in opposite directions, the model must choose arbitrarily; an explicit priority ordering tells it which constraint wins. Adding more adjectives or adjusting token limits does not resolve the conflict.