GitHub Certified: Agentic AI Developer key terms
GitHub Certified: Agentic AI Developer · Get comfortable with the vocabulary.
- Autonomous agent
- Related: Agent run, Tool call
A software process that uses a language model to plan and carry out multi-step work in a repository - reading files, editing code, running commands, and opening pull requests - with limited direct human supervision.
- Agent run
- Related: Agent trace, Autonomous agent
One bounded execution of an agent against a task, from the triggering event to final output or termination, capturing every step taken and every artifact produced along the way.
- Trigger event
- Related: Agent run, Issue-to-pull-request loop
The event that starts an agent run, such as an issue assignment, a pull request comment, a scheduled job, or a manual dispatch from a workflow.
- Issue-to-pull-request loop
- Related: Human-in-the-loop approval gate, Agent run
The end-to-end cycle in which an agent reads an issue, plans changes, edits the codebase, runs tests, and opens a pull request that humans review before merge.
- Agent instructions file
- Related: Custom agent definition, Context window
A version-controlled document in the repository that gives the agent its role, project conventions, build commands, and constraints, loaded into context at the start of each run.
- Custom agent definition
- Related: Agent instructions file, Tool allowlist
A declarative configuration setting an agent's name, description, model, available tools, and instructions so it can be selected and invoked consistently across workflows.
- Tool call
- Related: Tool allowlist, MCP server
A single invocation by the agent of an external capability such as file read or write, shell execution, code search, or an API request, whose result feeds back into its reasoning loop.
- Tool allowlist
- Related: Tool call, Guardrail
An explicit set of tools and resources an agent may use, with everything else denied by default, so capabilities are limited to what the task actually requires.
- MCP server
- Related: Tool call, Tool allowlist
A service exposing tools, resources, and prompts over the Model Context Protocol so an agent can reach external systems through a standard, discoverable interface instead of bespoke integrations.
- Context window
- Related: Context packing, Agent memory
The bounded amount of text, code, and tool output a model can consider at once; managing it means selecting, summarizing, or discarding information as a run progresses.
- Context packing
- Related: Context window, Agent memory
The process of choosing which repository files, search results, and history to place in an agent's prompt so the model has the most relevant evidence within its context budget.
- Agent memory
- Related: Context window, Agent run
Information an agent persists across runs or turns, such as prior decisions, learned conventions, or task state, stored outside the model's transient context so it can be reused later.
- Sampling temperature
- Related: Regression suite, Behavior drift
A model setting controlling how much randomness is used when generating output; lowering it makes agent behavior more repeatable, which matters when the same task must yield stable results.
- Human-in-the-loop approval gate
- Related: Escalation policy, Autonomy level
A checkpoint where an agent must stop and wait for a named human to approve, edit, or reject an action before it continues, typically before merging, deploying, or changing protected settings.
- Autonomy level
- Related: Human-in-the-loop approval gate, Guardrail
The configured degree of independence granted to an agent, ranging from suggest-only output through draft pull requests to fully automated merge, matched to the risk of the task.
- Guardrail
- Related: Tool allowlist, Sandbox environment
A hard constraint enforced outside the model, such as blocked paths, prohibited commands, or required checks, that stops an agent from taking an action even when it decides to.
- Sandbox environment
- Related: Guardrail, Least-privilege token
An isolated, disposable execution environment with restricted network and filesystem access where an agent runs code, so mistakes or malicious actions cannot reach production systems.
- Least-privilege token
- Related: Secrets management, Guardrail
A credential scoped to the minimum permissions and repositories needed for one agent run, with a short lifetime, so a compromised or misbehaving agent cannot exceed its intended reach.
- Secrets management
- Related: Least-privilege token, Audit log
The practice of keeping credentials out of prompts, logs, and repository content, injecting them only at runtime and redacting them from any agent output that might be recorded.
- Prompt injection
- Related: Untrusted content boundary, Guardrail
An attack in which untrusted content the agent reads - an issue body, a file comment, a web page - contains instructions that hijack its behavior and redirect its actions.
- Untrusted content boundary
- Related: Prompt injection, Guardrail
A design rule treating all externally supplied text as data rather than instructions, keeping it out of privileged prompt positions and requiring human approval before acting on it.
- Escalation policy
- Related: Human-in-the-loop approval gate, Handoff
Predefined rules deciding when an agent should stop and hand a task to a human or higher-authority agent, such as repeated failures, ambiguous requirements, or high-risk changes.
- Handoff
- Related: Escalation policy, Supervisor agent
The transfer of a task, together with its accumulated context and state, from one agent or human to another when the work exceeds the current owner's scope or authority.
- Supervisor agent
- Related: Multi-agent orchestration, Handoff
An agent whose job is to decompose a goal, assign subtasks to specialist agents, track their progress, and combine or reject their outputs rather than performing the work itself.
- Multi-agent orchestration
- Related: Supervisor agent, Concurrency limit
Coordinating several agents with distinct roles and tools on one problem, including routing, sequencing, conflict resolution, and shared state, so their combined output stays coherent.
- Concurrency limit
- Related: Rate-limit backoff, Token budget
A cap on how many agent runs or tool calls may execute at once, protecting rate limits, shared resources, and cost while keeping queued work fairly ordered.
- Rate-limit backoff
- Related: Concurrency limit, Idempotency
A retry strategy that waits progressively longer after a throttled or failed call, often with randomized jitter, so an agent recovers from transient limits instead of hammering the API.
- Idempotency
- Related: Rate-limit backoff, Rollback
Designing agent actions so that repeating them produces the same end state, preventing duplicate pull requests, comments, or deployments when a step is retried after failure.
- Token budget
- Related: Concurrency limit, Agent trace
A per-run or per-project ceiling on model usage and spend that halts or downgrades an agent's work when exceeded, keeping autonomous activity economically bounded and predictable.
- Agent trace
- Related: Audit log, Agent run
A structured record of every step in an agent run - prompts, tool calls, outputs, timings, and costs - used to debug behavior and reconstruct what happened after the fact.
- Audit log
- Related: Agent trace, Human-in-the-loop approval gate
An append-only record of who or what triggered each agent action, what changed, and which approvals were granted, kept for compliance review and incident investigation.
- Evaluation harness
- Related: Golden task set, Rubric
A repeatable test setup that runs an agent against a fixed set of tasks and scores the results, so changes to prompts, models, or tools can be compared objectively.
- Golden task set
- Related: Evaluation harness, Regression suite
A curated collection of representative tasks with known-good expected outcomes, used as a stable benchmark against which successive agent versions are measured over time.
- Rubric
- Related: LLM-as-judge, Acceptance criteria
Written criteria describing what a good agent output looks like across dimensions such as correctness, completeness, and adherence to convention, used to score results consistently.
- LLM-as-judge
- Related: Rubric, Evaluation harness
Using a separate model to grade an agent's output against a rubric, which scales qualitative review but requires calibration against human ratings before it can be trusted.
- Regression suite
- Related: Golden task set, Behavior drift
The set of evaluation tasks re-run whenever an agent's model, prompt, or tools change, catching cases where previously working behavior has degraded.
- Behavior drift
- Related: Regression suite, Evaluation harness
A gradual change in an agent's outputs or success rate over time caused by model updates, tool changes, or shifting inputs, detected by comparing against established baselines.
- Acceptance criteria
- Related: Rubric, Human-in-the-loop approval gate
Concrete, checkable conditions defining when a task is complete, giving the agent a clear target and giving reviewers an objective basis for accepting its work.
- Rollback
- Related: Idempotency, Audit log
Restoring a repository or deployment to a known-good prior state when an agent-produced change causes failures, ideally through a tested, automated path rather than manual repair.