PSM-AI key terms
PSM-AI · Get comfortable with the vocabulary.
- Large Language Model (LLM)
- Related: Token, Hallucination, Prompt
A model trained on very large text collections to predict and generate language. It produces responses by estimating plausible word sequences rather than by looking facts up in a verified database.
- Token
- Related: Context window, Large Language Model (LLM), Usage cost
The small chunk of text, often a word fragment, that a language model reads and generates. Token counts set context limits and drive usage cost, and they do not match word counts.
- Prompt
- Related: Prompt engineering, System prompt, Context window
The input a person gives a generative AI tool: instructions, background context, examples, or constraints. Its clarity and specificity strongly shape the quality and consistency of the response.
- Hallucination
- Related: Retrieval-Augmented Generation (RAG), Human in the loop, Non-determinism
A confident but incorrect or invented output, such as a fabricated citation or a non-existent function. It occurs because the model generates plausible text rather than verifying facts against a source.
- Context window
- Related: Token, Retrieval-Augmented Generation (RAG)
The maximum amount of text, measured in tokens, that a model can consider in one interaction. Material beyond that limit is ignored unless it is summarized, retrieved, or supplied in a new request.
- Training data
- Related: Bias, Fine-tuning, Model drift
The examples used to build a model's behaviour. Its gaps, biases, and knowledge cutoff date shape what the tool knows, how fairly it performs, and where it will fail.
- Fine-tuning
- Related: Training data, Retrieval-Augmented Generation (RAG)
Additional training of an existing model on a smaller, targeted dataset so it better fits a task, tone, or domain. It changes the model itself, unlike prompting, which only changes the input.
- Retrieval-Augmented Generation (RAG)
- Related: Hallucination, Context window, Prompt
A pattern where a tool first searches an approved knowledge source, then has the model answer using those retrieved passages. It reduces invention and keeps answers tied to current, organization-owned material.
- Non-determinism
- Related: Hallucination, Model evaluation, Guardrails
The tendency of the same prompt to produce different outputs on different runs. Teams must plan for variability, so a single good result is not evidence of reliable behaviour.
- Agentic AI
- Related: Guardrails, Human in the loop
Systems that can plan several steps and call tools or take actions with limited human involvement, instead of only answering one prompt. Greater autonomy increases the need for explicit limits and oversight.
- Prompt engineering
- Related: Prompt, Few-shot prompting, System prompt
The practice of designing and repeatedly refining prompts, with clear goals, context, constraints, and examples, to obtain more useful and consistent output from a generative tool.
- System prompt
- Related: Prompt, Guardrails, Prompt engineering
Pre-set instructions that define a tool's role, tone, and boundaries before a conversation begins. They apply to every turn and shape responses differently from a one-off user request.
- Few-shot prompting
- Related: Prompt engineering, Chain-of-thought prompting
Including a handful of worked examples in a prompt so the model imitates the desired format, tone, or reasoning pattern. It is often the quickest way to stabilize output.
- Chain-of-thought prompting
- Related: Few-shot prompting, Prompt engineering
Asking a model to work through intermediate steps before presenting a final answer. It can improve multi-step accuracy but lengthens output, raises cost, and exposes reasoning that may be wrong.
- Guardrails
- Related: Agentic AI, Human in the loop, Acceptable use policy
Technical or procedural limits on an AI tool, such as content filters, approved data sources, or required approvals. They constrain what the system will do and route exceptions to people.
- Human in the loop
- Related: Hallucination, Human accountability, Definition of Done (AI-augmented)
A deliberate checkpoint where a person reviews, corrects, or approves AI output before it is used or acted on. It preserves accountability and catches errors the tool cannot detect.
- Model evaluation
- Related: Non-determinism, Pilot, Bias
A structured way to judge whether an AI tool suits a defined purpose, using test cases, rubrics, or comparison against a baseline. It replaces impressions of quality with evidence.
- AI literacy
- Related: Hallucination, Psychological safety, Over-reliance
A team's shared working understanding of what AI tools can and cannot do, including their typical failure modes. It lets members judge output critically instead of accepting it.
- Team AI working agreement
- Related: Transparency of AI use, Definition of Done (AI-augmented), Acceptable use policy
Explicit team norms covering where AI may be used, what must be disclosed, which data is off-limits, and who reviews output. The team revisits it as it learns.
- Psychological safety
- Related: AI literacy, Team AI working agreement
A climate in which team members can try unfamiliar tools, admit mistakes, and share weak results without embarrassment. It is a precondition for honest learning about what actually helps.
- Transparency of AI use
- Related: Human accountability, Team AI working agreement
Openly telling colleagues, customers, or stakeholders when content or decisions involved AI, and to what extent. Disclosure lets others apply the scrutiny they consider appropriate.
- Over-reliance
- Related: Automation bias, Human in the loop, AI literacy
Accepting AI output without adequate checking, so the team gradually loses its own judgement. It shows up as unchallenged summaries, thin reviews, and unexamined assumptions.
- Prompt library
- Related: Prompt engineering, Team AI working agreement
A shared, versioned collection of prompts the team has found useful, with notes on context and results. It spreads good practice and cuts repeated trial and error.
- Definition of Done (AI-augmented)
- Related: Human in the loop, Transparency of AI use
The team's checklist for when work is complete. Where AI contributes, teams often add checks for factual accuracy, sourcing, human review, and appropriate disclosure.
- AI governance
- Related: Acceptable use policy, Human accountability, AI regulation
The policies, roles, and decision rights an organization uses to choose, use, and monitor AI. It clarifies who may approve a tool and who answers when something goes wrong.
- Acceptable use policy
- Related: Data classification, Guardrails, AI governance
An organizational document stating which AI tools are approved, what data may be entered, and which uses are prohibited. Teams need it in plain, practical form to make daily choices.
- Data classification
- Related: Acceptable use policy, Data leakage
Sorting information into levels such as public, internal, confidential, or personal, so people know what may be shared with an external AI service. It converts vague caution into clear rules.
- Third-party risk assessment
- Related: AI governance, Data classification, Model drift
Reviewing a supplier's data handling, security, model update practices, and exit terms before adoption. It addresses the chance that a tool changes behaviour or retains information beyond the organization's control.
- Pilot
- Related: Model evaluation, Scaling AI adoption, Usage cost
A time-boxed, narrowly scoped trial of an AI tool with agreed success measures and a decision point. It generates real evidence before the organization commits to wider adoption.
- Scaling AI adoption
- Related: Pilot, AI governance
Moving an AI practice from one team's trial to broader organizational use, which requires updated policy, training, support, and evidence that the benefit still holds at larger scale.
- Usage cost
- Related: Token, Pilot
The ongoing expense of AI tools, driven by subscriptions and by tokens processed, plus the human time spent reviewing and reworking output. It belongs in the business case.
- Bias
- Related: Training data, Model evaluation, Explainability
Systematic skew in AI output that disadvantages certain groups or viewpoints, often inherited from training data and design choices. It persists unless teams deliberately test for it.
- Prompt injection
- Related: Guardrails, Data leakage
An attack in which hidden instructions inside content the model reads, such as a document or web page, redirect its behaviour. It is a security concern whenever tools process untrusted input.
- Data leakage
- Related: Data classification, Prompt injection, Acceptable use policy
Unintended exposure of sensitive information through an AI tool, for example pasting confidential content into an external service that stores or learns from it. Classification and clear rules reduce the risk.
- Intellectual property risk
- Related: Transparency of AI use, AI governance
Uncertainty about the ownership and provenance of AI-generated content, including whether it reproduces protected material. Teams should check licensing, attribution, and policy before publishing.
- Automation bias
- Related: Over-reliance, Human in the loop
The human tendency to trust a machine's suggestions more than the evidence warrants, especially under time pressure. It is the mechanism that turns convenient tools into unchecked decisions.
- Explainability
- Related: Human accountability, Bias, AI regulation
How far a person can understand why an AI system produced a particular output. Low explainability makes it hard to challenge results or defend decisions to stakeholders and regulators.
- Human accountability
- Related: Human in the loop, Transparency of AI use, AI governance
The principle that a named person or role stays answerable for decisions and deliverables, whatever share of the work AI contributed. Systems cannot hold accountability or consent to being governed.
- Model drift
- Related: Model evaluation, Training data, Third-party risk assessment
Decline in a tool's accuracy or usefulness over time as the world, data, or underlying model changes. It argues for periodic re-evaluation rather than one-time approval.
- AI regulation
- Related: AI governance, Explainability, Human accountability
Legally binding rules that classify AI uses by risk and impose duties such as disclosure, documentation, testing, or outright prohibition. Scrum Masters should know which uses in their context fall into higher-risk categories.