PSM-AI study materials
PSM-AI study resources

PSM-AI key terms

PSM-AI · Get comfortable with the vocabulary.

Large Language Model (LLM)

A model trained on very large text collections to predict and generate language. It produces responses by estimating plausible word sequences rather than by looking facts up in a verified database.

Related: Token, Hallucination, Prompt
Token

The small chunk of text, often a word fragment, that a language model reads and generates. Token counts set context limits and drive usage cost, and they do not match word counts.

Related: Context window, Large Language Model (LLM), Usage cost
Prompt

The input a person gives a generative AI tool: instructions, background context, examples, or constraints. Its clarity and specificity strongly shape the quality and consistency of the response.

Related: Prompt engineering, System prompt, Context window
Hallucination

A confident but incorrect or invented output, such as a fabricated citation or a non-existent function. It occurs because the model generates plausible text rather than verifying facts against a source.

Related: Retrieval-Augmented Generation (RAG), Human in the loop, Non-determinism
Context window

The maximum amount of text, measured in tokens, that a model can consider in one interaction. Material beyond that limit is ignored unless it is summarized, retrieved, or supplied in a new request.

Related: Token, Retrieval-Augmented Generation (RAG)
Training data

The examples used to build a model's behaviour. Its gaps, biases, and knowledge cutoff date shape what the tool knows, how fairly it performs, and where it will fail.

Related: Bias, Fine-tuning, Model drift
Fine-tuning

Additional training of an existing model on a smaller, targeted dataset so it better fits a task, tone, or domain. It changes the model itself, unlike prompting, which only changes the input.

Related: Training data, Retrieval-Augmented Generation (RAG)
Retrieval-Augmented Generation (RAG)

A pattern where a tool first searches an approved knowledge source, then has the model answer using those retrieved passages. It reduces invention and keeps answers tied to current, organization-owned material.

Related: Hallucination, Context window, Prompt
Non-determinism

The tendency of the same prompt to produce different outputs on different runs. Teams must plan for variability, so a single good result is not evidence of reliable behaviour.

Related: Hallucination, Model evaluation, Guardrails
Agentic AI

Systems that can plan several steps and call tools or take actions with limited human involvement, instead of only answering one prompt. Greater autonomy increases the need for explicit limits and oversight.

Related: Guardrails, Human in the loop
Prompt engineering

The practice of designing and repeatedly refining prompts, with clear goals, context, constraints, and examples, to obtain more useful and consistent output from a generative tool.

Related: Prompt, Few-shot prompting, System prompt
System prompt

Pre-set instructions that define a tool's role, tone, and boundaries before a conversation begins. They apply to every turn and shape responses differently from a one-off user request.

Related: Prompt, Guardrails, Prompt engineering
Few-shot prompting

Including a handful of worked examples in a prompt so the model imitates the desired format, tone, or reasoning pattern. It is often the quickest way to stabilize output.

Related: Prompt engineering, Chain-of-thought prompting
Chain-of-thought prompting

Asking a model to work through intermediate steps before presenting a final answer. It can improve multi-step accuracy but lengthens output, raises cost, and exposes reasoning that may be wrong.

Related: Few-shot prompting, Prompt engineering
Guardrails

Technical or procedural limits on an AI tool, such as content filters, approved data sources, or required approvals. They constrain what the system will do and route exceptions to people.

Related: Agentic AI, Human in the loop, Acceptable use policy
Human in the loop

A deliberate checkpoint where a person reviews, corrects, or approves AI output before it is used or acted on. It preserves accountability and catches errors the tool cannot detect.

Related: Hallucination, Human accountability, Definition of Done (AI-augmented)
Model evaluation

A structured way to judge whether an AI tool suits a defined purpose, using test cases, rubrics, or comparison against a baseline. It replaces impressions of quality with evidence.

Related: Non-determinism, Pilot, Bias
AI literacy

A team's shared working understanding of what AI tools can and cannot do, including their typical failure modes. It lets members judge output critically instead of accepting it.

Related: Hallucination, Psychological safety, Over-reliance
Team AI working agreement

Explicit team norms covering where AI may be used, what must be disclosed, which data is off-limits, and who reviews output. The team revisits it as it learns.

Related: Transparency of AI use, Definition of Done (AI-augmented), Acceptable use policy
Psychological safety

A climate in which team members can try unfamiliar tools, admit mistakes, and share weak results without embarrassment. It is a precondition for honest learning about what actually helps.

Related: AI literacy, Team AI working agreement
Transparency of AI use

Openly telling colleagues, customers, or stakeholders when content or decisions involved AI, and to what extent. Disclosure lets others apply the scrutiny they consider appropriate.

Related: Human accountability, Team AI working agreement
Over-reliance

Accepting AI output without adequate checking, so the team gradually loses its own judgement. It shows up as unchallenged summaries, thin reviews, and unexamined assumptions.

Related: Automation bias, Human in the loop, AI literacy
Prompt library

A shared, versioned collection of prompts the team has found useful, with notes on context and results. It spreads good practice and cuts repeated trial and error.

Related: Prompt engineering, Team AI working agreement
Definition of Done (AI-augmented)

The team's checklist for when work is complete. Where AI contributes, teams often add checks for factual accuracy, sourcing, human review, and appropriate disclosure.

Related: Human in the loop, Transparency of AI use
AI governance

The policies, roles, and decision rights an organization uses to choose, use, and monitor AI. It clarifies who may approve a tool and who answers when something goes wrong.

Related: Acceptable use policy, Human accountability, AI regulation
Acceptable use policy

An organizational document stating which AI tools are approved, what data may be entered, and which uses are prohibited. Teams need it in plain, practical form to make daily choices.

Related: Data classification, Guardrails, AI governance
Data classification

Sorting information into levels such as public, internal, confidential, or personal, so people know what may be shared with an external AI service. It converts vague caution into clear rules.

Related: Acceptable use policy, Data leakage
Third-party risk assessment

Reviewing a supplier's data handling, security, model update practices, and exit terms before adoption. It addresses the chance that a tool changes behaviour or retains information beyond the organization's control.

Related: AI governance, Data classification, Model drift
Pilot

A time-boxed, narrowly scoped trial of an AI tool with agreed success measures and a decision point. It generates real evidence before the organization commits to wider adoption.

Related: Model evaluation, Scaling AI adoption, Usage cost
Scaling AI adoption

Moving an AI practice from one team's trial to broader organizational use, which requires updated policy, training, support, and evidence that the benefit still holds at larger scale.

Related: Pilot, AI governance
Usage cost

The ongoing expense of AI tools, driven by subscriptions and by tokens processed, plus the human time spent reviewing and reworking output. It belongs in the business case.

Related: Token, Pilot
Bias

Systematic skew in AI output that disadvantages certain groups or viewpoints, often inherited from training data and design choices. It persists unless teams deliberately test for it.

Related: Training data, Model evaluation, Explainability
Prompt injection

An attack in which hidden instructions inside content the model reads, such as a document or web page, redirect its behaviour. It is a security concern whenever tools process untrusted input.

Related: Guardrails, Data leakage
Data leakage

Unintended exposure of sensitive information through an AI tool, for example pasting confidential content into an external service that stores or learns from it. Classification and clear rules reduce the risk.

Related: Data classification, Prompt injection, Acceptable use policy
Intellectual property risk

Uncertainty about the ownership and provenance of AI-generated content, including whether it reproduces protected material. Teams should check licensing, attribution, and policy before publishing.

Related: Transparency of AI use, AI governance
Automation bias

The human tendency to trust a machine's suggestions more than the evidence warrants, especially under time pressure. It is the mechanism that turns convenient tools into unchecked decisions.

Related: Over-reliance, Human in the loop
Explainability

How far a person can understand why an AI system produced a particular output. Low explainability makes it hard to challenge results or defend decisions to stakeholders and regulators.

Related: Human accountability, Bias, AI regulation
Human accountability

The principle that a named person or role stays answerable for decisions and deliverables, whatever share of the work AI contributed. Systems cannot hold accountability or consent to being governed.

Related: Human in the loop, Transparency of AI use, AI governance
Model drift

Decline in a tool's accuracy or usefulness over time as the world, data, or underlying model changes. It argues for periodic re-evaluation rather than one-time approval.

Related: Model evaluation, Training data, Third-party risk assessment
AI regulation

Legally binding rules that classify AI uses by risk and impose duties such as disclosure, documentation, testing, or outright prohibition. Scrum Masters should know which uses in their context fall into higher-risk categories.

Related: AI governance, Explainability, Human accountability