AZ MLO study materials
AZ MLO study resources

AZ MLO key terms

AZ MLO · Get comfortable with the vocabulary.

Workspace

A top-level Azure Machine Learning resource that groups related experiments, compute, datasets, models, and endpoints so teams can share and govern assets within one boundary.

Related: Compute Target, Datastore
Compute Target

A designated compute resource such as a compute instance, compute cluster, or attached Kubernetes cluster where training jobs or scoring services execute.

Related: Compute Instance, Managed Online Endpoint
Compute Instance

A fully managed, single-node cloud workstation used for authoring notebooks, running interactive experiments, and testing code before scaling out.

Related: Compute Target, Compute Cluster
Compute Cluster

A managed pool of scalable multi-node machines that automatically provisions and tears down nodes to run training or batch scoring jobs.

Related: Compute Instance, Job
Datastore

A saved connection to a storage service such as blob storage or a data lake, holding credentials so jobs and users can reference data by name.

Related: Data Asset, Workspace
Data Asset

A versioned pointer to data in a datastore, recording its location, type, and metadata so experiments can reference a stable, reproducible data source.

Related: Datastore, Data Versioning
Environment

A reusable specification of the software stack for a job or deployment, including base image, Python packages, and environment variables, enabling consistent reproducibility.

Related: Conda Environment File, Job
Job

A single unit of execution submitted to Azure Machine Learning, such as a command script or pipeline run, with tracked status, logs, and outputs.

Related: Pipeline, Experiment
Pipeline

A multi-step workflow that chains jobs or components together with defined inputs and outputs, supporting reuse and scheduled retraining.

Related: Job, Registered Model
Experiment

A logical grouping of runs used to compare results and track metrics across many attempts at the same modeling problem.

Related: Run, MLflow Tracking
Run

One execution of a job or script that records metrics, parameters, artifacts, and logs for later review and comparison.

Related: Experiment, MLflow Tracking
Registered Model

A named, versioned entry in the model registry that points to stored model files and carries metadata such as tags and descriptions.

Related: Model Registry, Model Version
Model Registry

A central catalog that stores, versions, and organizes trained models so they can be discovered, audited, and deployed across environments.

Related: Registered Model, Model Version
Model Version

An immutable snapshot of a registered model under a given name, incremented on each registration so deployments can pin an exact artifact.

Related: Registered Model, Model Registry
Managed Online Endpoint

A managed HTTPS endpoint that hosts one or more model deployments for real-time scoring, handling scaling, authentication, and traffic routing.

Related: Deployment, Traffic Split
Deployment

An instance of a model running on an endpoint with its own environment, scoring script, and resource allocation, which can receive a share of traffic.

Related: Managed Online Endpoint, Scoring Script
Traffic Split

A configuration that routes specified percentages of endpoint requests to different deployments, enabling safe canary rollouts and A/B comparison.

Related: Deployment, Managed Online Endpoint
Batch Endpoint

An endpoint that runs scoring jobs over large datasets on a schedule or on demand, writing predictions to a configured output location.

Related: Job, Data Asset
Scoring Script

A file defining init and run functions that load a model and produce predictions from request or batch input at serving time.

Related: Deployment, Managed Online Endpoint
Model Signature

A declared description of a model's expected input and output schema, used to validate requests and document the serving contract.

Related: MLflow Model, Scoring Script
MLflow Tracking

An open-source API and UI for logging parameters, metrics, and artifacts during runs, integrated with Azure Machine Learning for experiment comparison.

Related: Run, Experiment
MLflow Model

A standard directory format packaging model files, dependencies, and metadata so the model can be loaded and served by MLflow-compatible tools.

Related: Model Signature, Registered Model
Data Versioning

The practice of assigning immutable version identifiers to datasets so training runs can be reproduced against the exact data used.

Related: Data Asset, Lineage
Lineage

The recorded relationship chain linking data assets, jobs, environments, and models, supporting reproducibility, debugging, and audit investigations.

Related: Data Versioning, Run
Data Drift

A change in the distribution of input features over time relative to the training data, which can degrade model accuracy after deployment.

Related: Model Monitor, Data Drift Monitor
Data Drift Monitor

A configured Azure Machine Learning feature that compares recent production input data against a baseline dataset and signals when distributions diverge beyond thresholds.

Related: Data Drift, Model Monitor
Model Monitor

A scheduled signal that evaluates a deployed model's inputs, outputs, or performance metrics and raises alerts when configured thresholds are breached.

Related: Data Drift Monitor, Application Insights
Application Insights

An observability service that collects request logs, latency, error rates, and custom telemetry from online endpoints for operational troubleshooting.

Related: Model Monitor, Managed Online Endpoint
Responsible AI Dashboard

A toolset that visualizes model error analysis, fairness, interpretability, and counterfactual outcomes to support responsible model assessment.

Related: Fairness Assessment, Feature Importance
Fairness Assessment

An evaluation comparing model performance across sensitive groups defined by attributes such as age or gender to detect disparate error rates.

Related: Responsible AI Dashboard, Sensitive Attribute
Sensitive Attribute

A data field identifying a protected or demographic group, used in fairness analysis and sometimes excluded from training features.

Related: Fairness Assessment, Responsible AI Dashboard
Feature Importance

A measure of how much each input feature contributes to a model's predictions, used to explain behavior globally or for individual cases.

Related: Responsible AI Dashboard, Model Interpretability
Model Interpretability

The degree to which a person can understand why a model produced a given prediction, supported by explanation techniques such as SHAP or surrogate models.

Related: Feature Importance, Responsible AI Dashboard
Error Analysis

The process of segmenting model errors by feature cohorts to find where performance is weakest and guide targeted improvement.

Related: Responsible AI Dashboard, Fairness Assessment
Conda Environment File

A YAML document listing channels and package dependencies used to build a reproducible Python environment for training or inference.

Related: Environment, Job
Automated ML

A capability that automatically tries combinations of algorithms, preprocessing, and hyperparameters to find strong models for a labeled dataset.

Related: Hyperparameter Tuning, Job
Hyperparameter Tuning

A systematic search over model configuration values using sampling methods and an early-termination policy to find better-performing settings.

Related: Automated ML, Job
Feature Engineering

The process of creating, transforming, or selecting input variables so a model can capture relevant patterns more effectively.

Related: Feature Importance, Data Asset