AWS ML Engineer Associate key terms
AWS ML Engineer Associate · Get comfortable with the vocabulary.
- Amazon S3 prefix
- Related: SageMaker Training Job, S3 data partitioning
A key path segment used to organize objects in a bucket, commonly treated as a logical folder. Training jobs and pipelines point here to read datasets and write model artifacts.
- S3 data partitioning
- Related: Amazon S3 prefix, SageMaker Pipe Mode
Organizing dataset objects into prefixes by values such as date or category so query engines and distributed training jobs read only relevant files, reducing scan volume and improving throughput.
- SageMaker Pipe Mode
- Related: SageMaker File Mode, SageMaker Training Job
A training input channel mode that streams record data directly from S3 to the algorithm instead of downloading the full dataset first, reducing startup time and disk usage.
- SageMaker File Mode
- Related: SageMaker Pipe Mode, SageMaker Training Job
A training input channel mode that downloads the entire S3 dataset to local storage before training begins. Suitable for small datasets or algorithms needing random access.
- SageMaker Ground Truth
- Related: Labeling workforce, Active learning
A managed data-labeling service that combines human labelers with automated labeling and active learning to produce high-quality annotated datasets for supervised training.
- Active learning
- Related: SageMaker Ground Truth, Data sampling
A labeling strategy where the model identifies unlabeled examples it is least confident about, so human effort focuses on the most informative samples and total annotation cost drops.
- SageMaker Data Wrangler
- Related: Feature Store, Data leakage
A visual data preparation tool for importing, profiling, transforming, and exporting tabular and text data, with built-in analyses that detect data quality and leakage issues.
- Data leakage
- Related: SageMaker Data Wrangler, Train-validation-test split
A modeling error where information unavailable at prediction time, such as target-derived columns or post-outcome fields, is used during training, inflating measured accuracy and degrading production performance.
- Train-validation-test split
- Related: Data leakage, Cross-validation
Dividing a dataset into subsets for fitting parameters, tuning hyperparameters, and estimating final generalization performance, keeping the test set untouched until evaluation.
- Cross-validation
- Related: Train-validation-test split, Hyperparameter tuning
A resampling technique that rotates which data folds serve as validation across several training rounds, giving a more stable performance estimate than a single split.
- Class imbalance
- Related: Evaluation metric selection, Data sampling
A condition where one target class greatly outnumbers others, causing models to favor the majority class; addressed with resampling, class weights, or metrics like recall and F1.
- Data sampling
- Related: Class imbalance, Active learning
Selecting a representative subset of records for training, evaluation, or labeling, used to control cost and class balance while preserving statistical fidelity.
- SageMaker Feature Store
- Related: Online store, Offline store
A repository for storing, discovering, and serving curated features consistently for training and real-time inference, with online and offline stores kept in sync.
- Online store
- Related: SageMaker Feature Store, Offline store
The low-latency portion of a feature repository that serves the latest feature values per entity for real-time inference requests, typically backed by a fast key-value database.
- Offline store
- Related: SageMaker Feature Store, Online store
The storage layer holding historical feature values in files for batch training and analysis, enabling point-in-time joins so training data reflects what was known then.
- SageMaker Training Job
- Related: SageMaker Pipe Mode, Model artifact
A managed compute task that runs a training container on specified instance types, reads input channels from S3, and writes model artifacts and logs to S3.
- Model artifact
- Related: SageMaker Training Job, SageMaker Model Registry
The output files produced by training, such as serialized weights and configuration, packaged as a compressed archive in S3 and later used to create a deployable model.
- SageMaker automatic model tuning
- Related: Hyperparameter tuning, Evaluation metric selection
A hyperparameter optimization feature that runs many training jobs using search strategies such as Bayesian optimization to find the configuration that best optimizes a chosen objective metric.
- Hyperparameter tuning
- Related: SageMaker automatic model tuning, Cross-validation
Systematically searching combinations of settings like learning rate and tree depth that govern training, using search strategies and early stopping to reduce cost.
- Evaluation metric selection
- Related: Class imbalance, Model quality baseline
Choosing the measurement that reflects business success, such as precision, recall, F1, or RMSE, and using it consistently for tuning, thresholding, and comparing candidate models.
- SageMaker Debugger
- Related: SageMaker Training Job, Model quality baseline
A capability that captures tensors and system metrics during training and applies built-in or custom rules to detect problems such as vanishing gradients, overfitting, or stalled progress.
- SageMaker Experiments
- Related: SageMaker automatic model tuning, Model artifact
A tracking service that records training runs with their parameters, metrics, and artifacts, letting teams compare trials and reproduce the best configuration.
- SageMaker Model Registry
- Related: Model artifact, Model approval workflow
A catalog for versioning trained models, storing metadata and approval status, and managing promotion across environments so deployment references an approved version.
- Model approval workflow
- Related: SageMaker Model Registry, CI/CD pipeline for ML
A governance process where a registered model version is reviewed against quality and compliance criteria and marked approved before a pipeline deploys it.
- SageMaker Pipelines
- Related: CI/CD pipeline for ML, Model approval workflow
A managed workflow service for defining ML steps such as processing, training, evaluation, and registration as a directed acyclic graph that can be scheduled and rerun.
- SageMaker Processing Job
- Related: SageMaker Pipelines, SageMaker Data Wrangler
A managed task for running data transformation, feature engineering, or model evaluation scripts on dedicated compute, writing outputs to S3 for downstream steps.
- CI/CD pipeline for ML
- Related: SageMaker Pipelines, Model approval workflow
Automation that builds, tests, and deploys model and pipeline changes through environments, extending software delivery practices to models and their supporting infrastructure.
- SageMaker real-time endpoint
- Related: SageMaker Serverless Inference, Endpoint autoscaling
A persistently hosted HTTPS inference service backed by one or more instances, providing low-latency predictions with configurable instance count and autoscaling.
- SageMaker Serverless Inference
- Related: SageMaker real-time endpoint, SageMaker batch transform
An endpoint option that provisions compute on demand and scales to zero when idle, suited to intermittent or low-volume traffic where cold-start latency is acceptable.
- SageMaker batch transform
- Related: SageMaker real-time endpoint, SageMaker Serverless Inference
An offline inference mode that processes a large S3 dataset with a deployed model and writes predictions to S3, without maintaining a persistent endpoint.
- SageMaker Asynchronous Inference
- Related: SageMaker real-time endpoint, Endpoint autoscaling
An endpoint mode that queues large or long-running requests, returns results via S3 when complete, and can scale to zero between requests.
- Endpoint autoscaling
- Related: SageMaker real-time endpoint, Shadow deployment
Dynamically adjusting the number or size of instances behind an endpoint in response to traffic metrics, balancing latency targets against cost.
- Shadow deployment
- Related: Blue/green deployment, Endpoint autoscaling
Routing a copy of live traffic to a new model version while the current version serves users, letting teams compare behavior before switching production traffic.
- Blue/green deployment
- Related: Shadow deployment, Model rollback
Deploying a new model version to a separate environment, validating it, then shifting traffic over so rollback means returning traffic to the unchanged original environment.
- Model rollback
- Related: Blue/green deployment, SageMaker Model Registry
Reverting production to a previously known-good model version after a regression or failure, which requires versioned artifacts and a tested reversal path.
- SageMaker Model Monitor
- Related: Data drift, Model quality baseline
A service that captures endpoint or batch inference data and compares it against a baseline to detect drift in data quality, model quality, bias, and feature attribution.
- Data drift
- Related: Concept drift, SageMaker Model Monitor
A change in the statistical distribution of input features over time relative to training data, which can degrade predictions even when the underlying relationship is unchanged.
- Concept drift
- Related: Data drift, Model retraining trigger
A change over time in the relationship between input features and the target, so the same inputs should now map to different outputs and the model must be retrained.
- Model quality baseline
- Related: SageMaker Model Monitor, Evaluation metric selection
A reference set of metric values, such as accuracy or error thresholds, captured from validation data and used to judge whether live performance has degraded.
- Model retraining trigger
- Related: Concept drift, SageMaker Pipelines
An automated condition, such as drift exceeding a threshold or a metric falling below target, that starts a pipeline run to refresh the model.
- SageMaker Clarify
- Related: SageMaker Model Monitor, Model quality baseline
A tool that computes bias metrics on data and models and generates feature attribution explanations, helping teams detect unfair outcomes and justify predictions.
- IAM execution role
- Related: VPC endpoint for SageMaker, AWS KMS encryption
An identity assumed by a SageMaker resource to access other AWS services, whose attached policies determine which buckets, repositories, and endpoints the job can use.
- VPC endpoint for SageMaker
- Related: IAM execution role, AWS KMS encryption
A private network connection that lets training and hosting resources reach S3 and other services without traversing the public internet, supporting network isolation requirements.
- AWS KMS encryption
- Related: IAM execution role, VPC endpoint for SageMaker
Key management that encrypts data at rest in S3, EBS volumes, and feature stores, with key policies controlling which roles may decrypt training data and artifacts.