AWS Machine Learning Specialty (AWS) key terms
AWS Machine Learning Specialty · Get comfortable with the vocabulary.
- Amazon S3
- Related: S3 storage class, SageMaker Training Job, AWS Glue
Durable object storage service that holds raw datasets, training inputs, and model artifacts; exam scenarios often use it as the source and sink for SageMaker jobs and pipelines.
- S3 storage class
- Related: Amazon S3
Tiering option such as Standard, Intelligent-Tiering, or Glacier that trades retrieval latency and cost; choosing one for training data affects both pipeline speed and monthly spend.
- AWS Glue
- Related: AWS Glue Data Catalog, AWS Glue Crawler, Apache Parquet
Serverless data integration service that catalogs datasets and runs Apache Spark extract-transform-load jobs, commonly used to prepare features before model training in SageMaker.
- AWS Glue Data Catalog
- Related: AWS Glue, AWS Glue Crawler, Amazon Athena
Central metadata repository storing table definitions, schemas, and partition information; services such as Athena, Redshift Spectrum, and SageMaker read from it to locate data.
- AWS Glue Crawler
- Related: AWS Glue Data Catalog, Apache Parquet
Automated process that scans data stores, infers schemas and partitions, and writes table definitions into the Data Catalog so downstream query and training tools can use them.
- Apache Parquet
- Related: Amazon Athena, AWS Glue
Columnar file format with compression and schema embedding that reduces scan volume and cost; converting CSV training data to Parquet is a frequent optimization in exam scenarios.
- Amazon Athena
- Related: AWS Glue Data Catalog, Apache Parquet
Serverless query service that runs SQL directly against files in S3 using table definitions from the Data Catalog, useful for ad hoc exploration without loading a warehouse.
- Amazon Kinesis Data Streams
- Related: Amazon Kinesis Data Firehose, Streaming feature pipeline
Real-time streaming service that ingests ordered records at high throughput; feature pipelines and online inference systems read from it to process events within seconds.
- Amazon Kinesis Data Firehose
- Related: Amazon Kinesis Data Streams, Amazon S3
Managed delivery service that buffers streaming records and writes them to destinations such as S3, Redshift, or OpenSearch, often landing raw events for later batch training.
- AWS Lake Formation
- Related: AWS Glue Data Catalog, Amazon S3
Service that centralizes fine-grained permission management over data lake tables in S3 and the Data Catalog, letting teams share training data without copying it.
- Amazon SageMaker Ground Truth
- Related: Active learning, SageMaker Training Job
Managed labeling workflow that combines human annotators, automated labeling, and active learning to produce high-quality labeled datasets for supervised training.
- SageMaker Training Job
- Related: SageMaker estimator, Amazon S3, Spot training
Managed run that provisions compute, pulls training data, executes a container's training script, and writes model artifacts to S3, with metrics and logs emitted to CloudWatch.
- SageMaker estimator
- Related: SageMaker Training Job, SageMaker automatic model tuning
Python SDK object that declares a training job's container image, instance type and count, hyperparameters, and input channels before calling fit to launch it.
- SageMaker automatic model tuning
- Related: Hyperparameter, SageMaker estimator
Hyperparameter optimization feature that runs many training jobs using Bayesian or random search strategies to find configurations optimizing a chosen objective metric.
- Hyperparameter
- Related: SageMaker automatic model tuning, Overfitting
Configuration value set before training, such as learning rate, tree depth, or batch size, that governs how an algorithm learns rather than being learned from data.
- Overfitting
- Related: Cross-validation, Regularization, Hyperparameter
Failure mode where a model memorizes training noise and generalizes poorly; detected by a widening gap between training and validation metrics and addressed with regularization or more data.
- Regularization
- Related: Overfitting, Early stopping
Technique that penalizes model complexity, through L1 or L2 weight penalties, dropout, or early stopping, to reduce variance and improve performance on unseen data.
- Early stopping
- Related: Regularization, Overfitting
Training control that halts when validation performance stops improving for a set number of rounds, saving compute and limiting overfitting without changing the model family.
- Cross-validation
- Related: Train-validation-test split, Overfitting
Resampling procedure that rotates held-out folds so every observation serves as validation once, producing a more reliable estimate of generalization than a single split.
- Train-validation-test split
- Related: Cross-validation, Data leakage
Partitioning data into a fitting set, a tuning set for model selection, and an untouched test set for final unbiased evaluation; leakage between them inflates reported accuracy.
- Data leakage
- Related: Train-validation-test split, Feature engineering
Contamination where information unavailable at prediction time, such as target-derived features or future rows, enters training and produces optimistic offline metrics that fail in production.
- Class imbalance
- Related: Precision and recall, Confusion matrix
Situation where one label vastly outnumbers others, making accuracy misleading; remedies include resampling, class weights, and choosing precision-recall metrics instead of raw accuracy.
- Confusion matrix
- Related: Precision and recall, Class imbalance
Table of predicted versus actual classes showing true positives, false positives, true negatives, and false negatives, the basis for deriving precision, recall, and related metrics.
- Precision and recall
- Related: Confusion matrix, F1 score
Precision measures how many predicted positives are correct; recall measures how many actual positives were found. Their tradeoff depends on the business cost of false positives versus misses.
- F1 score
- Related: Precision and recall, Class imbalance
Harmonic mean of precision and recall, giving a single balanced number that is useful when classes are imbalanced and both false positives and false negatives matter.
- ROC AUC
- Related: Precision and recall, Class imbalance
Area under the receiver operating characteristic curve, measuring how well a classifier ranks positives above negatives across all thresholds; 0.5 is random and 1.0 is perfect.
- Feature engineering
- Related: Data leakage, SageMaker Feature Store
Creating, transforming, or selecting input variables, through encoding, scaling, binning, or aggregation, so that patterns become easier for the algorithm to learn.
- SageMaker Feature Store
- Related: Feature engineering, Training-serving skew
Repository with online and offline stores that keeps feature definitions consistent between training and real-time inference, reducing skew from separately computed pipelines.
- Training-serving skew
- Related: SageMaker Feature Store, SageMaker endpoint
Divergence between how features are computed during training and during inference, which silently degrades live predictions; shared feature pipelines and stored features prevent it.
- SageMaker endpoint
- Related: SageMaker batch transform, Training-serving skew
Hosted HTTPS inference service backed by one or more model instances; supports real-time prediction with autoscaling and can run multiple models behind a single URL.
- SageMaker batch transform
- Related: SageMaker endpoint, Amazon S3
Offline inference mode that loads a model, processes a large S3 dataset in batches, and writes predictions back to S3 without keeping a persistent endpoint running.
- SageMaker automatic scaling
- Related: SageMaker endpoint, Amazon CloudWatch
Policy-driven adjustment of endpoint instance count based on CloudWatch metrics such as invocations per instance, balancing latency targets against cost during traffic swings.
- Amazon CloudWatch
- Related: SageMaker automatic scaling, Model Monitor
Monitoring service collecting metrics, logs, and alarms; used to watch training loss, endpoint latency, and data drift signals and to trigger automated responses.
- SageMaker Model Monitor
- Related: Amazon CloudWatch, SageMaker endpoint
Capability that compares live endpoint traffic against a baseline and raises alarms for data drift, model quality decay, bias drift, and feature attribution drift.
- SageMaker Pipelines
- Related: SageMaker Training Job, SageMaker Model Registry
Workflow orchestration service that chains processing, training, evaluation, and registration steps as a directed acyclic graph with lineage tracking and repeatable execution.
- SageMaker Model Registry
- Related: SageMaker Pipelines, SageMaker endpoint
Catalog of trained model versions with metadata and approval status, enabling controlled promotion from development to production and supporting automated deployment workflows.
- Spot training
- Related: SageMaker Training Job, SageMaker Managed Warm Pools
Using discounted spare EC2 capacity for training jobs with checkpointing so work resumes after interruption, cutting cost substantially for fault-tolerant workloads.
- SageMaker Managed Warm Pools
- Related: Spot training, SageMaker Training Job
Feature that keeps provisioned instances alive between jobs so subsequent training or processing starts quickly, trading idle cost for reduced startup latency.
- IAM execution role
- Related: Amazon S3, SageMaker Training Job
AWS identity assumed by a SageMaker job or endpoint that grants exactly the S3, ECR, and CloudWatch permissions needed, following least-privilege access principles.