Cloudera CDP Administrator - Public Cloud key terms
Cloudera CDP Administrator - Public Cloud · Get comfortable with the vocabulary.
- Environment (CDP Control Plane)
- Related: Data Lake Cluster, Data Hub Cluster, CDP Control Plane
A logical container in the CDP control plane that groups a data lake, its Data Hub clusters, and shared services under one set of credentials, region, and network settings. Environments let administrators isolate teams or workloads while reusing common configuration.
- CDP Control Plane
- Related: Environment (CDP Control Plane), Cross-Account Role
The Cloudera-managed SaaS layer that hosts the management console, APIs, and orchestration logic used to create, scale, and delete environments and clusters in your cloud account. It stores metadata but customer data stays in the customer's cloud account.
- Data Lake Cluster
- Related: Data Hub Cluster, Environment (CDP Control Plane), Shared Data Experience (SDX)
The foundational cluster in a CDP environment that provides shared services such as SDX governance, storage management, and the metastore that Data Hub clusters attach to. Each environment has exactly one data lake, and it must exist before workloads are deployed.
- Data Hub Cluster
- Related: Data Lake Cluster, Cluster Template, Autoscaling (Data Hub)
A workload cluster attached to a data lake, hosting service roles such as Hive, Spark, Impala, or Kafka. Data Hubs inherit governance and storage configuration from the data lake but can be sized and scaled independently per workload.
- Cluster Template
- Related: Data Hub Cluster, Autoscaling (Data Hub), Instance Group
A reusable definition describing which service roles a Data Hub cluster runs, their instance types, and their scaling policy. Administrators create templates once and use them to deploy consistent clusters across environments.
- Instance Group
- Related: Cluster Template, Autoscaling (Data Hub), Node Repair
A named set of cloud instances within a cluster that all run the same roles and share a configuration. Instance groups are the unit for scaling, repair, and node replacement in CDP clusters.
- Autoscaling (Data Hub)
- Related: Instance Group, Cluster Template, YARN Queue Manager
A policy that adds or removes worker instances in an instance group based on metrics such as YARN pending containers or CPU load. It requires a schedule or load-based rule and a defined minimum and maximum node count.
- Cross-Account Role
- Related: CDP Control Plane, Environment (CDP Control Plane), IDBroker
An IAM role in the customer's cloud account that the CDP control plane assumes to provision and manage resources. Its trust policy and permissions determine what the control plane can create, so misconfiguration is a common provisioning failure cause.
- IDBroker
- Related: Cross-Account Role, Ranger, Knox Gateway
A CDP component that issues short-lived cloud credentials to cluster services and users, replacing long-lived access keys stored on nodes. It maps an authenticated identity to a cloud role, enabling least-privilege access to object storage.
- Shared Data Experience (SDX)
- Related: Ranger, Atlas, Data Lake Cluster
The CDP framework that centralizes metadata, governance policies, and security controls across clusters so that definitions made once apply everywhere. It is anchored in the data lake and consumed by attached Data Hub clusters.
- Ranger
- Related: Tag-Based Policy, Atlas, Shared Data Experience (SDX)
The authorization component of SDX that evaluates fine-grained access policies for HDFS, Hive, HBase, Kafka, and other services. Policies are defined centrally and can be scoped by resource path, column, or tag.
- Tag-Based Policy
- Related: Ranger, Atlas, Data Classification
A Ranger policy that grants or denies access based on classification tags attached to data rather than on physical paths. Because the policy follows the tag, access stays correct when data is moved or copied.
- Atlas
- Related: Tag-Based Policy, Data Classification, Shared Data Experience (SDX)
The metadata and lineage service in SDX that catalogs datasets, tracks how data flows between them, and stores classification tags. Ranger reads Atlas tags to enforce tag-based policies.
- Data Classification
- Related: Atlas, Tag-Based Policy, Ranger
The process of assigning sensitivity or business tags, such as PII or confidential, to datasets so that governance policies can target them. In CDP it is often automated by profilers that inspect column contents.
- Knox Gateway
- Related: IDBroker, LDAP Authentication, Kerberos
The reverse proxy that exposes cluster web UIs and REST APIs through a single authenticated endpoint. It enforces authentication, applies per-service access control lists, and shields internal hosts from direct client access.
- Kerberos
- Related: Knox Gateway, LDAP Authentication, IDBroker
A network authentication protocol in which clients obtain time-limited tickets from a key distribution center instead of sending passwords. CDP clusters use it for strong service-to-service and user authentication.
- LDAP Authentication
- Related: Kerberos, Ranger, Knox Gateway
A configuration in which CDP validates user credentials against an external directory such as Active Directory. It is commonly paired with group lookups so that directory groups map to Ranger roles and policies.
- Hive Metastore
- Related: Data Lake Cluster, Apache Iceberg, Ranger
The service that stores table definitions, partitions, and schema metadata for SQL engines in the cluster. In CDP it is hosted in the data lake so that Hive, Impala, and Spark share one catalog.
- Apache Iceberg
- Related: Hive Metastore, Object Storage (S3/ADLS/GCS), Apache Ozone
An open table format that adds snapshots, schema evolution, and hidden partitioning to files stored in object storage. CDP supports Iceberg tables for reliable concurrent reads and writes on data lakes.
- Apache Ozone
- Related: Object Storage (S3/ADLS/GCS), Apache Iceberg, Data Lake Cluster
A distributed object store that can serve as the storage layer for a CDP data lake, providing an HDFS-compatible namespace at very large scale. It stores data in buckets and volumes rather than traditional HDFS directories.
- Object Storage (S3/ADLS/GCS)
- Related: IDBroker, Apache Iceberg, Apache Ozone
Cloud-native storage accessed over HTTP APIs, used by CDP for data lake files, logs, and backups. Access is governed by cloud IAM policies and temporary credentials issued through IDBroker.
- YARN Queue Manager
- Related: Autoscaling (Data Hub), Data Hub Cluster, Impala Admission Control
The interface for defining capacity-scheduler queues, their capacities, and their placement rules. It lets administrators partition cluster resources between teams and is often tuned alongside Data Hub autoscaling.
- Impala Admission Control
- Related: YARN Queue Manager, Data Hub Cluster, Ranger
A mechanism that limits how many Impala queries run concurrently and queues or rejects excess requests. It protects cluster stability by preventing a single user or workload from exhausting memory and CPU.
- Node Repair
- Related: Instance Group, Cloudera Manager, Diagnostic Bundle
The CDP operation that replaces or reconfigures an unhealthy instance in a cluster while preserving its role assignment. Administrators trigger it from the console or API after diagnosing hardware or service failures.
- Cloudera Manager
- Related: Node Repair, Diagnostic Bundle, Cloudera Runtime
The per-cluster management service that deploys, configures, monitors, and restarts the roles running on cluster hosts. Administrators use it for service-level health checks and configuration changes that the control plane does not expose.
- Cloudera Runtime
- Related: Cloudera Manager, Data Hub Cluster, Data Lake Cluster
The packaged set of open-source components, such as HDFS, YARN, Hive, and Spark, that CDP installs on cluster hosts. Its version determines available features and must match the data lake and Data Hub compatibility matrix.
- Diagnostic Bundle
- Related: Cloudera Manager, Node Repair, Audit Log
A collected archive of logs, configuration files, and system metrics from cluster hosts, generated to support troubleshooting. Administrators create bundles before contacting support or after a recurring failure.
- Audit Log
- Related: Ranger, Diagnostic Bundle, Knox Gateway
A record of access attempts and administrative actions, including Ranger authorization decisions and API calls. Auditors use these logs to investigate incidents and to demonstrate compliance with access policies.
- Workload Password
- Related: Kerberos, Knox Gateway, LDAP Authentication
A per-user credential used by CDP clients and APIs to authenticate when Kerberos or SSO is not practical. It is managed in the control plane profile and can be rotated without changing the directory password.
- Machine User
- Related: Workload Password, Ranger, CDP Control Plane
A non-human account created in the CDP control plane for automation such as CI pipelines or scripts. It authenticates with its own credentials and is granted scoped roles rather than sharing a human administrator's identity.
- Recipe
- Related: Cluster Template, Cloudera Manager, Instance Group
A script or configuration override applied during cluster deployment to customize hosts, install packages, or tune services. Recipes let administrators standardize changes that the console does not natively support.
- Proxy Config (CDP)
- Related: Environment (CDP Control Plane), Cross-Account Role, Cluster Template
A setting that routes outbound cluster traffic through an HTTP proxy for environments with restricted internet access. It must allow the control plane and package repositories so provisioning and upgrades succeed.
- Data Lake Upgrade
- Related: Cloudera Runtime, Data Lake Cluster, Data Hub Cluster
The controlled process of moving a data lake, and then its attached Data Hubs, to a newer Cloudera Runtime version. It requires compatibility checks, backups, and typically a maintenance window because services restart.
- Replication Policy
- Related: Data Hub Cluster, Object Storage (S3/ADLS/GCS), Hive Metastore
A CDP definition that copies selected HDFS paths or Hive tables from a source cluster to a target on a schedule. It supports disaster recovery and data migration between environments or clouds.
- Decommission
- Related: Node Repair, Instance Group, Cloudera Manager
The graceful removal of a node or role from a cluster in which data is drained or replicated elsewhere before shutdown. Doing this before terminating instances prevents data loss and under-replication.
- Telemetry (Cloudera)
- Related: CDP Control Plane, Diagnostic Bundle, Audit Log
Optional usage and diagnostic data that Cloudera collects from the control plane and clusters to improve support and product quality. Administrators can review and adjust what is shared in account settings.