AWS ML Engineer Associate study materials
AWS ML Engineer Associate study resources

AWS ML Engineer Associate key terms

AWS ML Engineer Associate · Get comfortable with the vocabulary.

Amazon S3 prefix

A key path segment used to organize objects in a bucket, commonly treated as a logical folder. Training jobs and pipelines point here to read datasets and write model artifacts.

Related: SageMaker Training Job, S3 data partitioning
S3 data partitioning

Organizing dataset objects into prefixes by values such as date or category so query engines and distributed training jobs read only relevant files, reducing scan volume and improving throughput.

Related: Amazon S3 prefix, SageMaker Pipe Mode
SageMaker Pipe Mode

A training input channel mode that streams record data directly from S3 to the algorithm instead of downloading the full dataset first, reducing startup time and disk usage.

Related: SageMaker File Mode, SageMaker Training Job
SageMaker File Mode

A training input channel mode that downloads the entire S3 dataset to local storage before training begins. Suitable for small datasets or algorithms needing random access.

Related: SageMaker Pipe Mode, SageMaker Training Job
SageMaker Ground Truth

A managed data-labeling service that combines human labelers with automated labeling and active learning to produce high-quality annotated datasets for supervised training.

Related: Labeling workforce, Active learning
Active learning

A labeling strategy where the model identifies unlabeled examples it is least confident about, so human effort focuses on the most informative samples and total annotation cost drops.

Related: SageMaker Ground Truth, Data sampling
SageMaker Data Wrangler

A visual data preparation tool for importing, profiling, transforming, and exporting tabular and text data, with built-in analyses that detect data quality and leakage issues.

Related: Feature Store, Data leakage
Data leakage

A modeling error where information unavailable at prediction time, such as target-derived columns or post-outcome fields, is used during training, inflating measured accuracy and degrading production performance.

Related: SageMaker Data Wrangler, Train-validation-test split
Train-validation-test split

Dividing a dataset into subsets for fitting parameters, tuning hyperparameters, and estimating final generalization performance, keeping the test set untouched until evaluation.

Related: Data leakage, Cross-validation
Cross-validation

A resampling technique that rotates which data folds serve as validation across several training rounds, giving a more stable performance estimate than a single split.

Related: Train-validation-test split, Hyperparameter tuning
Class imbalance

A condition where one target class greatly outnumbers others, causing models to favor the majority class; addressed with resampling, class weights, or metrics like recall and F1.

Related: Evaluation metric selection, Data sampling
Data sampling

Selecting a representative subset of records for training, evaluation, or labeling, used to control cost and class balance while preserving statistical fidelity.

Related: Class imbalance, Active learning
SageMaker Feature Store

A repository for storing, discovering, and serving curated features consistently for training and real-time inference, with online and offline stores kept in sync.

Related: Online store, Offline store
Online store

The low-latency portion of a feature repository that serves the latest feature values per entity for real-time inference requests, typically backed by a fast key-value database.

Related: SageMaker Feature Store, Offline store
Offline store

The storage layer holding historical feature values in files for batch training and analysis, enabling point-in-time joins so training data reflects what was known then.

Related: SageMaker Feature Store, Online store
SageMaker Training Job

A managed compute task that runs a training container on specified instance types, reads input channels from S3, and writes model artifacts and logs to S3.

Related: SageMaker Pipe Mode, Model artifact
Model artifact

The output files produced by training, such as serialized weights and configuration, packaged as a compressed archive in S3 and later used to create a deployable model.

Related: SageMaker Training Job, SageMaker Model Registry
SageMaker automatic model tuning

A hyperparameter optimization feature that runs many training jobs using search strategies such as Bayesian optimization to find the configuration that best optimizes a chosen objective metric.

Related: Hyperparameter tuning, Evaluation metric selection
Hyperparameter tuning

Systematically searching combinations of settings like learning rate and tree depth that govern training, using search strategies and early stopping to reduce cost.

Related: SageMaker automatic model tuning, Cross-validation
Evaluation metric selection

Choosing the measurement that reflects business success, such as precision, recall, F1, or RMSE, and using it consistently for tuning, thresholding, and comparing candidate models.

Related: Class imbalance, Model quality baseline
SageMaker Debugger

A capability that captures tensors and system metrics during training and applies built-in or custom rules to detect problems such as vanishing gradients, overfitting, or stalled progress.

Related: SageMaker Training Job, Model quality baseline
SageMaker Experiments

A tracking service that records training runs with their parameters, metrics, and artifacts, letting teams compare trials and reproduce the best configuration.

Related: SageMaker automatic model tuning, Model artifact
SageMaker Model Registry

A catalog for versioning trained models, storing metadata and approval status, and managing promotion across environments so deployment references an approved version.

Related: Model artifact, Model approval workflow
Model approval workflow

A governance process where a registered model version is reviewed against quality and compliance criteria and marked approved before a pipeline deploys it.

Related: SageMaker Model Registry, CI/CD pipeline for ML
SageMaker Pipelines

A managed workflow service for defining ML steps such as processing, training, evaluation, and registration as a directed acyclic graph that can be scheduled and rerun.

Related: CI/CD pipeline for ML, Model approval workflow
SageMaker Processing Job

A managed task for running data transformation, feature engineering, or model evaluation scripts on dedicated compute, writing outputs to S3 for downstream steps.

Related: SageMaker Pipelines, SageMaker Data Wrangler
CI/CD pipeline for ML

Automation that builds, tests, and deploys model and pipeline changes through environments, extending software delivery practices to models and their supporting infrastructure.

Related: SageMaker Pipelines, Model approval workflow
SageMaker real-time endpoint

A persistently hosted HTTPS inference service backed by one or more instances, providing low-latency predictions with configurable instance count and autoscaling.

Related: SageMaker Serverless Inference, Endpoint autoscaling
SageMaker Serverless Inference

An endpoint option that provisions compute on demand and scales to zero when idle, suited to intermittent or low-volume traffic where cold-start latency is acceptable.

Related: SageMaker real-time endpoint, SageMaker batch transform
SageMaker batch transform

An offline inference mode that processes a large S3 dataset with a deployed model and writes predictions to S3, without maintaining a persistent endpoint.

Related: SageMaker real-time endpoint, SageMaker Serverless Inference
SageMaker Asynchronous Inference

An endpoint mode that queues large or long-running requests, returns results via S3 when complete, and can scale to zero between requests.

Related: SageMaker real-time endpoint, Endpoint autoscaling
Endpoint autoscaling

Dynamically adjusting the number or size of instances behind an endpoint in response to traffic metrics, balancing latency targets against cost.

Related: SageMaker real-time endpoint, Shadow deployment
Shadow deployment

Routing a copy of live traffic to a new model version while the current version serves users, letting teams compare behavior before switching production traffic.

Related: Blue/green deployment, Endpoint autoscaling
Blue/green deployment

Deploying a new model version to a separate environment, validating it, then shifting traffic over so rollback means returning traffic to the unchanged original environment.

Related: Shadow deployment, Model rollback
Model rollback

Reverting production to a previously known-good model version after a regression or failure, which requires versioned artifacts and a tested reversal path.

Related: Blue/green deployment, SageMaker Model Registry
SageMaker Model Monitor

A service that captures endpoint or batch inference data and compares it against a baseline to detect drift in data quality, model quality, bias, and feature attribution.

Related: Data drift, Model quality baseline
Data drift

A change in the statistical distribution of input features over time relative to training data, which can degrade predictions even when the underlying relationship is unchanged.

Related: Concept drift, SageMaker Model Monitor
Concept drift

A change over time in the relationship between input features and the target, so the same inputs should now map to different outputs and the model must be retrained.

Related: Data drift, Model retraining trigger
Model quality baseline

A reference set of metric values, such as accuracy or error thresholds, captured from validation data and used to judge whether live performance has degraded.

Related: SageMaker Model Monitor, Evaluation metric selection
Model retraining trigger

An automated condition, such as drift exceeding a threshold or a metric falling below target, that starts a pipeline run to refresh the model.

Related: Concept drift, SageMaker Pipelines
SageMaker Clarify

A tool that computes bias metrics on data and models and generates feature attribution explanations, helping teams detect unfair outcomes and justify predictions.

Related: SageMaker Model Monitor, Model quality baseline
IAM execution role

An identity assumed by a SageMaker resource to access other AWS services, whose attached policies determine which buckets, repositories, and endpoints the job can use.

Related: VPC endpoint for SageMaker, AWS KMS encryption
VPC endpoint for SageMaker

A private network connection that lets training and hosting resources reach S3 and other services without traversing the public internet, supporting network isolation requirements.

Related: IAM execution role, AWS KMS encryption
AWS KMS encryption

Key management that encrypts data at rest in S3, EBS volumes, and feature stores, with key policies controlling which roles may decrypt training data and artifacts.

Related: IAM execution role, VPC endpoint for SageMaker