GCP GenAI Engineer key terms
GCP GenAI Engineer · Get comfortable with the vocabulary.
- Vertex AI Pipelines
- Related: Kubeflow Pipelines, Pipeline component, Artifact lineage
A managed service that runs ML workflows defined as directed acyclic graphs, where each step is a containerized component and artifacts pass between steps through documented inputs and outputs.
- Kubeflow Pipelines
- Related: Vertex AI Pipelines, Pipeline component
An open-source platform for building and running portable ML workflows on Kubernetes, using Python-defined components that Vertex AI Pipelines can compile and execute.
- Pipeline component
- Related: Vertex AI Pipelines, Artifact lineage
A self-contained, reusable step in an ML workflow with a declared interface of typed inputs and outputs, packaged so it can run in isolation and be shared across pipelines.
- Artifact lineage
- Related: Vertex ML Metadata, Pipeline component
The recorded graph of which executions produced which artifacts and from which inputs, enabling reproducibility, debugging, and impact analysis when data or code changes.
- Vertex ML Metadata
- Related: Artifact lineage, Vertex AI Experiments
A managed metadata store that records artifacts, executions, and contexts from ML workflows so teams can trace model provenance and compare runs across experiments.
- Vertex AI Experiments
- Related: Vertex ML Metadata, Hyperparameter tuning
A tracking service that logs parameters, metrics, and artifacts for training runs so candidates can compare trials and choose the best configuration systematically.
- Hyperparameter tuning
- Related: Vertex AI Experiments, Search space
An automated search over training configuration values such as learning rate or tree depth, guided by a chosen metric, to find settings that improve model quality without manual trial and error.
- Search space
- Related: Hyperparameter tuning
The defined ranges or discrete candidate values for each hyperparameter that a tuning job may explore, including scaling choices such as linear or logarithmic sampling.
- Custom training job
- Related: Training container, Prebuilt container
A Vertex AI training run that executes your own packaged application in a managed container on selected machine types, with optional distributed workers and hyperparameter tuning.
- Training container
- Related: Custom training job, Artifact Registry
A container image bundling your training code and dependencies that Vertex AI runs on managed compute; it must expose an entrypoint that reads arguments and writes outputs to expected paths.
- Prebuilt container
- Related: Training container, Custom container
A Google-maintained image with common ML frameworks already installed, usable for training or prediction so teams avoid building and patching their own base images.
- Custom container
- Related: Prebuilt container, Prediction server
A user-built image for serving predictions when the prebuilt runtimes do not meet dependency, framework, or preprocessing needs; it must implement the required HTTP contract.
- Prediction server
- Related: Custom container, Online prediction
The HTTP process inside a serving container that loads the model and answers health, predict, and explain requests according to the platform's request and response contract.
- Online prediction
- Related: Endpoint, Batch prediction
Synchronous inference against a deployed endpoint that returns results within the request, suited to interactive use where low latency matters more than throughput cost.
- Batch prediction
- Related: Online prediction, BigQuery ML
Asynchronous inference over a large stored dataset that writes predictions to a destination such as BigQuery or Cloud Storage, trading latency for throughput and cost efficiency.
- Endpoint
- Related: Model version, Traffic split
A deployed, addressable resource that routes prediction traffic to one or more model versions on allocated compute, with configurable traffic splitting and autoscaling.
- Model version
- Related: Model Registry, Traffic split
An immutable snapshot of a trained model registered under a model resource, allowing several versions to coexist and be deployed or rolled back independently.
- Traffic split
- Related: Endpoint, Model version
A percentage allocation of endpoint requests across deployed model versions, used for canary releases, A/B tests, and gradual rollouts with quick rollback.
- Model Registry
- Related: Model version, Artifact lineage
A central catalog of models and their versions with metadata such as training source and evaluation results, supporting governance and deployment workflows.
- Autoscaling
- Related: Endpoint, Quota
Dynamic adjustment of serving replicas based on load or utilization so an endpoint meets latency targets during peaks while releasing capacity when demand falls.
- Quota
- Related: Autoscaling
A regional or project-level limit on resources such as accelerators, endpoints, or requests per minute that must be planned for before scaling a deployment.
- BigQuery ML
- Related: Batch prediction, Feature Store
A capability to create, train, and evaluate models using SQL directly on BigQuery data, useful for quick baselines and keeping training close to large datasets.
- Vertex AI Feature Store
- Related: Training-serving skew, Feature
A managed repository for feature values that serves consistent features to training and online inference, reducing skew and duplicated preprocessing logic across teams.
- Training-serving skew
- Related: Vertex AI Feature Store, Data drift
A mismatch between how features are computed during training and during inference, often from duplicated code paths, which degrades live model quality silently.
- Data drift
- Related: Concept drift, Training-serving skew
A change in input feature distributions over time relative to training data, which can erode model accuracy even when the underlying relationship remains stable.
- Concept drift
- Related: Data drift, Model monitoring
A change over time in the relationship between inputs and the target, so the same features now imply different outcomes and retraining on recent data becomes necessary.
- Model monitoring
- Related: Data drift, Concept drift
Continuous tracking of a deployed model's inputs, outputs, and performance signals to detect drift, skew, or degradation and trigger alerts or retraining.
- Vertex AI Model Monitoring
- Related: Model monitoring, Data drift
A managed feature that watches deployed endpoints for training-serving skew and drift against configured baselines and thresholds, emitting alerts when violations occur.
- Dataflow
- Related: Apache Beam, Dataflow template
A managed Apache Beam runner for batch and streaming pipelines, commonly used to transform raw data into features and to preprocess inputs for training or prediction.
- Apache Beam
- Related: Dataflow, Windowing
An open-source programming model for unified batch and streaming pipelines, where the same transform code runs on different runners such as Dataflow.
- Dataflow template
- Related: Dataflow, Cloud Composer
A packaged, parameterized pipeline that can be launched without writing code, useful for recurring ingestion and preprocessing jobs triggered by orchestration.
- Windowing
- Related: Apache Beam, Dataflow
Grouping unbounded streaming data into finite chunks by time or count, such as fixed or sliding windows, so aggregations can be computed on continuous input.
- Cloud Composer
- Related: Dataflow template, Vertex AI Pipelines
A managed Apache Airflow service for authoring, scheduling, and monitoring workflows that coordinate services such as Dataflow, BigQuery, and Vertex AI training jobs.
- Cloud Scheduler
- Related: Cloud Composer, Pub/Sub
A managed cron service that triggers HTTP, Pub/Sub, or App Engine targets on a schedule, often used to start pipelines or batch jobs periodically.
- Pub/Sub
- Related: Cloud Scheduler, Dataflow
A managed asynchronous messaging service with topics and subscriptions that decouples producers from consumers, commonly feeding streaming pipelines and event-driven retraining.
- Vertex AI Vizier
- Related: Hyperparameter tuning, Search space
The optimization service behind Vertex AI hyperparameter tuning that searches parameter spaces efficiently, including black-box optimization for custom objective functions.
- Explainable AI
- Related: Model monitoring, Vertex AI Model Monitoring
Vertex AI features that attribute prediction outputs to input features, such as Sampled Shapley or integrated gradients, helping validate model behavior and satisfy review requirements.