GCP ML Engineer (Google Cloud Certifications) key terms
GCP ML Engineer · Get comfortable with the vocabulary.
- Vertex AI
- Related: AutoML, Vertex AI Pipelines, Vertex AI Model Registry
Google Cloud's unified ML platform that brings dataset management, training, model registry, deployment, pipelines, and monitoring under a single API and console, replacing the earlier separate AI Platform services.
- AutoML
- Related: Vertex AI, Vertex AI model evaluation
A Vertex AI capability that trains models on your own labeled data using Google-managed architectures and hyperparameter search, so no training code is needed. You supply the data and a budget; Vertex AI handles the rest.
- Vertex AI Studio
- Related: Gemini on Vertex AI, Supervised fine-tuning
A console and API workspace for writing generative AI prompts, comparing model responses, and tuning and evaluating models on your own examples before integrating them into an application.
- Gemini on Vertex AI
- Related: Vertex AI Studio, Grounding and RAG
Google's family of multimodal generative models served through Vertex AI. They accept text, images, audio, and video, and are callable through the Vertex AI API with enterprise controls such as IAM and VPC Service Controls.
- BigQuery ML
- Related: Vertex AI, Dataplex and Data Catalog
A BigQuery feature for creating, training, evaluating, and predicting with models using SQL. Data stays in place, and supported models range from logistic regression to imported or remotely hosted foundation models.
- Document AI
- Related: Pre-built ML APIs, Vertex AI
Pre-trained and customizable document parsers that extract text, tables, and structured fields from scans such as invoices, receipts, and forms, returning typed entities rather than raw OCR text alone.
- Pre-built ML APIs
- Related: Document AI, Vertex AI Model Garden
Ready-to-call Google Cloud services such as Vision, Natural Language, Speech-to-Text, and Translation that return predictions for common tasks with no training, suitable when a general-purpose model already meets requirements.
- Vertex AI Agent Builder
- Related: Grounding and RAG, Gemini on Vertex AI
A low-code environment for assembling search and conversational agents over your own documents, combining retrieval, grounding, and Gemini models behind a managed serving API.
- Grounding and RAG
- Related: Vertex AI Agent Builder, Gemini on Vertex AI
Grounding supplies retrieved source content to a model at inference time so answers reflect your data. Retrieval-augmented generation implements this by embedding documents, searching an index, and inserting top results into the prompt.
- Supervised fine-tuning
- Related: Vertex AI Studio, Vertex AI Model Garden
Adapting a foundation model to a narrow task by training on labeled input-output examples, updating all weights or only a small adapter, which improves consistency and can lower cost per request.
- Vertex AI Model Registry
- Related: Vertex ML Metadata, Model card
A central catalog of model versions with metadata, lineage, and evaluation results. From it, models can be reviewed, compared, deployed to endpoints, or promoted between environments.
- Vertex AI managed dataset
- Related: BigQuery ML, Vertex AI custom training
A platform resource that records where training data lives in Cloud Storage or BigQuery along with its schema, enabling splitting, labeling, and statistics without copying the data.
- Dataplex and Data Catalog
- Related: Service account and IAM roles, Vertex AI managed dataset
Governance services that discover, catalog, classify, and tag data assets across BigQuery, Cloud Storage, and other sources, giving teams a searchable inventory with lineage and access context.
- Service account and IAM roles
- Related: Dataplex and Data Catalog, Private endpoint and VPC Service Controls
A non-human identity with scoped permissions that training jobs, pipelines, and endpoints use to read data and call services, keeping access least-privilege and auditable.
- Vertex AI Workbench
- Related: Vertex AI custom training, Vertex AI Experiments
A managed JupyterLab environment preintegrated with Google Cloud, used for data exploration, notebook prototyping, and handing work off to training jobs and pipelines.
- Model card
- Related: Vertex AI Model Registry, Vertex AI model evaluation
A structured document describing a model's intended use, training data, evaluation metrics, and known limitations, published with the model version to inform reviewers and downstream consumers.
- Vertex ML Metadata
- Related: Vertex AI Pipelines, Vertex AI Model Registry
A metadata service that records the artifacts, executions, and parameters of pipeline runs, producing a queryable lineage graph linking datasets, models, and evaluations.
- Vertex AI Model Garden
- Related: Supervised fine-tuning, Pre-built ML APIs
A catalog of foundation models, open models, and task-specific models that can be used as-is, tuned, or deployed, providing a starting point instead of training from scratch.
- Vertex AI custom training
- Related: Distributed training with reduction server, Vertex AI managed dataset
Running your own training code on Vertex AI by specifying a container image, machine type, and data location; the service provisions workers, retries failures, and writes outputs to Cloud Storage.
- Distributed training with reduction server
- Related: Vertex AI custom training, Accelerators
Splitting training across many workers using data or model parallelism. Vertex AI's reduction server aggregates gradients efficiently so synchronous multi-worker jobs scale without network bottlenecks.
- Hyperparameter tuning
- Related: Vertex AI Experiments, Vertex AI custom training
Automated search over ranges of training settings such as learning rate, batch size, or tree depth, using Bayesian optimization to find strong configurations within a trial and time budget.
- Vertex AI Experiments
- Related: Hyperparameter tuning, Vertex ML Metadata
A tracking service that records runs with their parameters, metrics, and artifacts, letting teams compare trials and reproduce the configuration behind a chosen model.
- Accelerators
- Related: Vertex AI custom training, Autoscaling on endpoints
Specialized hardware attached to training or prediction nodes. GPUs suit many deep learning workloads, while TPUs are optimized for the large matrix operations in TensorFlow, JAX, and PyTorch.
- Vertex AI Feature Store
- Related: Training-serving skew and drift, Vertex AI Endpoint
A managed repository that serves feature values to both training and online prediction at low latency, with point-in-time lookups that prevent label leakage.
- Vertex AI Endpoint
- Related: Traffic split, Autoscaling on endpoints
A deployed, addressable resource that hosts one or more model versions behind an HTTP or gRPC API and routes requests to them for online prediction.
- Autoscaling on endpoints
- Related: Vertex AI Endpoint, Traffic split
Adjusting the number of serving replicas between configured minimum and maximum values based on traffic or utilization, balancing latency under load against cost when idle.
- Batch prediction
- Related: Vertex AI Endpoint, Vertex AI Pipelines
An asynchronous job that scores a large stored dataset and writes results to a destination, trading immediate responses for higher throughput and lower cost per prediction.
- Traffic split
- Related: Vertex AI Endpoint, Vertex AI Model Monitoring
Sending specified percentages of prediction requests to different model versions on the same endpoint, enabling canary releases, A/B tests, and gradual rollouts.
- Explainable AI feature attributions
- Related: Vertex AI Endpoint, Vertex AI Model Monitoring
A Vertex AI capability that reports how much each input feature contributed to a prediction, using methods such as Sampled Shapley or integrated gradients for tabular, image, and text models.
- Private endpoint and VPC Service Controls
- Related: Service account and IAM roles, Vertex AI Endpoint
Deployment and network settings that keep prediction traffic on private IP addresses or within a service perimeter, so requests and data never traverse the public internet.
- Vertex AI Pipelines
- Related: Kubeflow Pipelines, Vertex ML Metadata
A managed service that runs containerized pipeline steps defined with KFP or TFX, tracks their artifacts and metadata, and supports scheduled or triggered executions.
- Kubeflow Pipelines
- Related: Vertex AI Pipelines, Artifact Registry
An open-source SDK and specification for defining ML workflows as directed acyclic graphs of containerized components; Vertex AI Pipelines compiles and executes those definitions.
- Cloud Composer
- Related: Vertex AI Pipelines, Eventarc with Cloud Functions and Cloud Run
A managed Apache Airflow service for orchestrating workflows that span systems, commonly scheduling Vertex AI pipelines alongside BigQuery jobs, data transfers, and other Google Cloud tasks.
- Artifact Registry
- Related: Kubeflow Pipelines, Vertex AI custom training
A service for storing and versioning container images and language packages, used as the source of component images, training containers, and prediction containers.
- Eventarc with Cloud Functions and Cloud Run
- Related: Cloud Composer, Vertex AI Pipelines
Event-driven building blocks: Eventarc routes events from Google Cloud sources to triggers, which invoke Cloud Functions or Cloud Run services to react to new data or pipeline completion.
- Vertex AI Model Monitoring
- Related: Training-serving skew and drift, Cloud Monitoring and Cloud Logging
A service that watches deployed models for training-serving skew and prediction drift, comparing feature and prediction distributions against a baseline and emitting alerts when thresholds are crossed.
- Training-serving skew and drift
- Related: Vertex AI Model Monitoring, Vertex AI Feature Store
Skew is a mismatch between the feature distribution seen in training and the one seen at serving; drift is change in live data over time. Both erode accuracy and signal retraining.
- Cloud Monitoring and Cloud Logging
- Related: Vertex AI Model Monitoring, Vertex AI Endpoint
Google Cloud's observability services. They collect endpoint metrics, errors, and logs and support dashboards, log-based metrics, and alerting policies for ML services.
- Vertex AI model evaluation
- Related: Vertex AI Model Registry, Model card
Automated computation of quality metrics such as precision, recall, and RMSE on held-out data, available for AutoML and custom models and stored alongside the model version.