GCP ML Engineer study materials
GCP ML Engineer study resources

GCP ML Engineer (Google Cloud Certifications) key terms

GCP ML Engineer · Get comfortable with the vocabulary.

Vertex AI

Google Cloud's unified ML platform that brings dataset management, training, model registry, deployment, pipelines, and monitoring under a single API and console, replacing the earlier separate AI Platform services.

Related: AutoML, Vertex AI Pipelines, Vertex AI Model Registry
AutoML

A Vertex AI capability that trains models on your own labeled data using Google-managed architectures and hyperparameter search, so no training code is needed. You supply the data and a budget; Vertex AI handles the rest.

Related: Vertex AI, Vertex AI model evaluation
Vertex AI Studio

A console and API workspace for writing generative AI prompts, comparing model responses, and tuning and evaluating models on your own examples before integrating them into an application.

Related: Gemini on Vertex AI, Supervised fine-tuning
Gemini on Vertex AI

Google's family of multimodal generative models served through Vertex AI. They accept text, images, audio, and video, and are callable through the Vertex AI API with enterprise controls such as IAM and VPC Service Controls.

Related: Vertex AI Studio, Grounding and RAG
BigQuery ML

A BigQuery feature for creating, training, evaluating, and predicting with models using SQL. Data stays in place, and supported models range from logistic regression to imported or remotely hosted foundation models.

Related: Vertex AI, Dataplex and Data Catalog
Document AI

Pre-trained and customizable document parsers that extract text, tables, and structured fields from scans such as invoices, receipts, and forms, returning typed entities rather than raw OCR text alone.

Related: Pre-built ML APIs, Vertex AI
Pre-built ML APIs

Ready-to-call Google Cloud services such as Vision, Natural Language, Speech-to-Text, and Translation that return predictions for common tasks with no training, suitable when a general-purpose model already meets requirements.

Related: Document AI, Vertex AI Model Garden
Vertex AI Agent Builder

A low-code environment for assembling search and conversational agents over your own documents, combining retrieval, grounding, and Gemini models behind a managed serving API.

Related: Grounding and RAG, Gemini on Vertex AI
Grounding and RAG

Grounding supplies retrieved source content to a model at inference time so answers reflect your data. Retrieval-augmented generation implements this by embedding documents, searching an index, and inserting top results into the prompt.

Related: Vertex AI Agent Builder, Gemini on Vertex AI
Supervised fine-tuning

Adapting a foundation model to a narrow task by training on labeled input-output examples, updating all weights or only a small adapter, which improves consistency and can lower cost per request.

Related: Vertex AI Studio, Vertex AI Model Garden
Vertex AI Model Registry

A central catalog of model versions with metadata, lineage, and evaluation results. From it, models can be reviewed, compared, deployed to endpoints, or promoted between environments.

Related: Vertex ML Metadata, Model card
Vertex AI managed dataset

A platform resource that records where training data lives in Cloud Storage or BigQuery along with its schema, enabling splitting, labeling, and statistics without copying the data.

Related: BigQuery ML, Vertex AI custom training
Dataplex and Data Catalog

Governance services that discover, catalog, classify, and tag data assets across BigQuery, Cloud Storage, and other sources, giving teams a searchable inventory with lineage and access context.

Related: Service account and IAM roles, Vertex AI managed dataset
Service account and IAM roles

A non-human identity with scoped permissions that training jobs, pipelines, and endpoints use to read data and call services, keeping access least-privilege and auditable.

Related: Dataplex and Data Catalog, Private endpoint and VPC Service Controls
Vertex AI Workbench

A managed JupyterLab environment preintegrated with Google Cloud, used for data exploration, notebook prototyping, and handing work off to training jobs and pipelines.

Related: Vertex AI custom training, Vertex AI Experiments
Model card

A structured document describing a model's intended use, training data, evaluation metrics, and known limitations, published with the model version to inform reviewers and downstream consumers.

Related: Vertex AI Model Registry, Vertex AI model evaluation
Vertex ML Metadata

A metadata service that records the artifacts, executions, and parameters of pipeline runs, producing a queryable lineage graph linking datasets, models, and evaluations.

Related: Vertex AI Pipelines, Vertex AI Model Registry
Vertex AI Model Garden

A catalog of foundation models, open models, and task-specific models that can be used as-is, tuned, or deployed, providing a starting point instead of training from scratch.

Related: Supervised fine-tuning, Pre-built ML APIs
Vertex AI custom training

Running your own training code on Vertex AI by specifying a container image, machine type, and data location; the service provisions workers, retries failures, and writes outputs to Cloud Storage.

Related: Distributed training with reduction server, Vertex AI managed dataset
Distributed training with reduction server

Splitting training across many workers using data or model parallelism. Vertex AI's reduction server aggregates gradients efficiently so synchronous multi-worker jobs scale without network bottlenecks.

Related: Vertex AI custom training, Accelerators
Hyperparameter tuning

Automated search over ranges of training settings such as learning rate, batch size, or tree depth, using Bayesian optimization to find strong configurations within a trial and time budget.

Related: Vertex AI Experiments, Vertex AI custom training
Vertex AI Experiments

A tracking service that records runs with their parameters, metrics, and artifacts, letting teams compare trials and reproduce the configuration behind a chosen model.

Related: Hyperparameter tuning, Vertex ML Metadata
Accelerators

Specialized hardware attached to training or prediction nodes. GPUs suit many deep learning workloads, while TPUs are optimized for the large matrix operations in TensorFlow, JAX, and PyTorch.

Related: Vertex AI custom training, Autoscaling on endpoints
Vertex AI Feature Store

A managed repository that serves feature values to both training and online prediction at low latency, with point-in-time lookups that prevent label leakage.

Related: Training-serving skew and drift, Vertex AI Endpoint
Vertex AI Endpoint

A deployed, addressable resource that hosts one or more model versions behind an HTTP or gRPC API and routes requests to them for online prediction.

Related: Traffic split, Autoscaling on endpoints
Autoscaling on endpoints

Adjusting the number of serving replicas between configured minimum and maximum values based on traffic or utilization, balancing latency under load against cost when idle.

Related: Vertex AI Endpoint, Traffic split
Batch prediction

An asynchronous job that scores a large stored dataset and writes results to a destination, trading immediate responses for higher throughput and lower cost per prediction.

Related: Vertex AI Endpoint, Vertex AI Pipelines
Traffic split

Sending specified percentages of prediction requests to different model versions on the same endpoint, enabling canary releases, A/B tests, and gradual rollouts.

Related: Vertex AI Endpoint, Vertex AI Model Monitoring
Explainable AI feature attributions

A Vertex AI capability that reports how much each input feature contributed to a prediction, using methods such as Sampled Shapley or integrated gradients for tabular, image, and text models.

Related: Vertex AI Endpoint, Vertex AI Model Monitoring
Private endpoint and VPC Service Controls

Deployment and network settings that keep prediction traffic on private IP addresses or within a service perimeter, so requests and data never traverse the public internet.

Related: Service account and IAM roles, Vertex AI Endpoint
Vertex AI Pipelines

A managed service that runs containerized pipeline steps defined with KFP or TFX, tracks their artifacts and metadata, and supports scheduled or triggered executions.

Related: Kubeflow Pipelines, Vertex ML Metadata
Kubeflow Pipelines

An open-source SDK and specification for defining ML workflows as directed acyclic graphs of containerized components; Vertex AI Pipelines compiles and executes those definitions.

Related: Vertex AI Pipelines, Artifact Registry
Cloud Composer

A managed Apache Airflow service for orchestrating workflows that span systems, commonly scheduling Vertex AI pipelines alongside BigQuery jobs, data transfers, and other Google Cloud tasks.

Related: Vertex AI Pipelines, Eventarc with Cloud Functions and Cloud Run
Artifact Registry

A service for storing and versioning container images and language packages, used as the source of component images, training containers, and prediction containers.

Related: Kubeflow Pipelines, Vertex AI custom training
Eventarc with Cloud Functions and Cloud Run

Event-driven building blocks: Eventarc routes events from Google Cloud sources to triggers, which invoke Cloud Functions or Cloud Run services to react to new data or pipeline completion.

Related: Cloud Composer, Vertex AI Pipelines
Vertex AI Model Monitoring

A service that watches deployed models for training-serving skew and prediction drift, comparing feature and prediction distributions against a baseline and emitting alerts when thresholds are crossed.

Related: Training-serving skew and drift, Cloud Monitoring and Cloud Logging
Training-serving skew and drift

Skew is a mismatch between the feature distribution seen in training and the one seen at serving; drift is change in live data over time. Both erode accuracy and signal retraining.

Related: Vertex AI Model Monitoring, Vertex AI Feature Store
Cloud Monitoring and Cloud Logging

Google Cloud's observability services. They collect endpoint metrics, errors, and logs and support dashboards, log-based metrics, and alerting policies for ML services.

Related: Vertex AI Model Monitoring, Vertex AI Endpoint
Vertex AI model evaluation

Automated computation of quality metrics such as precision, recall, and RMSE on held-out data, available for AutoML and custom models and stored alongside the model version.

Related: Vertex AI Model Registry, Model card