Cloudera CDP-3002 key terms
Cloudera CDP-3002 · Get comfortable with the vocabulary.
- Cloudera Manager
- Related: Service Descriptor, Parcel, Cloudera Runtime
The web-based control plane that installs, configures, monitors, and starts or stops services across a CDP cluster. It tracks host health, raises alerts, and stores configuration history for rollback.
- Parcel
- Related: Cloudera Manager, Cloudera Runtime
A versioned binary distribution of Cloudera Runtime that Cloudera Manager distributes and activates on hosts. Parcels allow side-by-side versions and rollback without reinstalling operating-system packages.
- Cloudera Runtime
- Related: Parcel, Cloudera Manager
The bundled set of open-source components (HDFS, YARN, Hive, Impala, Spark, and others) shipped as a parcel and managed together by Cloudera Manager on CDP hosts.
- Service Descriptor
- Related: Cloudera Manager, Role Group
A configuration file inside a parcel that declares a service's roles, configuration parameters, and dependencies, letting Cloudera Manager generate and validate configuration for that service.
- Role Group
- Related: Service Descriptor, Gateway Role
A named collection of role instances that share one configuration set in Cloudera Manager. Editing a role group changes every member at once, simplifying management of large clusters.
- Gateway Role
- Related: Role Group, Hue
A client-side role that deploys service client configuration files to an edge host so tools and applications there can reach cluster services without running server daemons.
- NameNode High Availability
- Related: JournalNode, HDFS Federation
An HDFS deployment with active and standby NameNodes sharing an edit log through JournalNodes. A failover controller promotes the standby if the active node fails.
- JournalNode
- Related: NameNode High Availability, HDFS Federation
A lightweight HDFS daemon that stores shared edit-log entries so multiple NameNodes can stay consistent. Quorum write guarantees let the standby take over without data loss.
- HDFS Federation
- Related: NameNode High Availability, JournalNode
A design that runs several independent NameNodes, each owning a namespace and block pool, so HDFS capacity and namespace load scale beyond a single NameNode.
- YARN ResourceManager
- Related: Capacity Scheduler Queue, NodeManager
The cluster-wide scheduler that allocates resources to applications and launches ApplicationMasters. It enforces queues, capacity limits, and fairness policies defined in scheduler configuration.
- NodeManager
- Related: YARN ResourceManager, Container
The per-host YARN agent that reports available memory and CPU, launches containers on request, and enforces container limits. It also runs auxiliary services and local log aggregation.
- Capacity Scheduler Queue
- Related: YARN ResourceManager, Container
A hierarchical YARN queue with configured capacity, maximum capacity, and user limits. Applications submit into a queue, and the scheduler shares resources among queues by policy.
- Container
- Related: NodeManager, Capacity Scheduler Queue
The unit of resource allocation in YARN: a granted amount of memory and virtual cores on one NodeManager where a task process runs until it completes or is killed.
- Hive Metastore
- Related: External Table, Apache Iceberg Table
The service that stores table definitions, partitions, and locations for Hive, Impala, and Spark. Losing or misconfiguring it makes existing tables invisible to query engines.
- External Table
- Related: Hive Metastore, Managed Table
A table whose data files live outside the managed warehouse directory. Dropping the table removes metadata only; the underlying files remain and can be re-registered later.
- Managed Table
- Related: External Table, Hive Metastore
A table whose data files sit in a location controlled by the metastore. Dropping it deletes both metadata and stored data, so it suits disposable or fully governed datasets.
- Apache Iceberg Table
- Related: Hive Metastore, Partition Pruning
A table format storing data as Parquet files plus metadata and snapshot manifests. It supports ACID commits, schema evolution, time travel, and hidden partitioning on CDP engines.
- Partition Pruning
- Related: Apache Iceberg Table, Apache Impala
A query optimization where the engine reads only partitions matching filter predicates, skipping unrelated directories or files. Good partition column choice sharply cuts scanned data.
- Apache Impala
- Related: Hive Metastore, Partition Pruning
A massively parallel SQL engine that runs queries directly on HDFS and object-store data without MapReduce. It relies on the metastore catalog and uses stateless coordinators and executors.
- Apache Spark on YARN
- Related: YARN ResourceManager, Container
Running Spark applications with YARN as the cluster manager, where an ApplicationMaster requests executors. Executor count and memory are tuned through spark-submit properties.
- Apache Oozie
- Related: YARN ResourceManager, Workflow
A workflow scheduler for Hadoop jobs that defines actions and dependencies in XML. It coordinates Hive, Spark, and shell steps into ordered workflows and recurring coordinators.
- Workflow
- Related: Apache Oozie, Apache NiFi
A directed graph of dependent jobs with defined start and end nodes. In CDP tooling it captures execution order, retries, and parameters so pipelines run reproducibly.
- Apache NiFi
- Related: Workflow, Apache Kafka
A flow-based data movement tool with processors, connections, and back-pressure. It ingests, routes, and transforms streaming or batch data while tracking provenance for each record.
- Apache Kafka
- Related: Apache NiFi, Schema Registry
A distributed publish-subscribe log organized into partitioned topics with replicated brokers. Producers append records and consumer groups read them at their own offsets.
- Apache Ranger
- Related: Ranger Policy, Apache Atlas
The centralized authorization service for CDP. It stores policies per resource such as HDFS paths, Hive tables, or Kafka topics and enforces them through plugins in each component.
- Ranger Policy
- Related: Apache Ranger, Row-Level Filter
A rule granting or denying access to a resource for users, groups, or roles, optionally with row filters, column masks, and time conditions. Policies are evaluated in priority order.
- Row-Level Filter
- Related: Ranger Policy, Column Masking
A Ranger or Hive feature that rewrites a query so a user sees only rows matching a predicate, such as their own region, without changing the underlying table data.
- Column Masking
- Related: Ranger Policy, Row-Level Filter
A policy that replaces sensitive column values with redacted or hashed output for selected users at query time, leaving stored data unchanged for authorized readers.
- Apache Atlas
- Related: Apache Ranger, Tag-Based Policy
The metadata and governance catalog in CDP. It captures lineage, classifications, and business metadata for datasets and integrates with Ranger for tag-based access control.
- Tag-Based Policy
- Related: Apache Atlas, Apache Ranger
An access rule attached to a classification such as PII rather than to a physical path or table. Any asset Atlas tags with that classification inherits the restriction automatically.
- Kerberos Principal
- Related: Keytab, Delegation Token
A unique identity in the Kerberos realm, usually service/host@REALM for daemons or user@REALM for people. Services authenticate to each other by proving possession of keytabs.
- Keytab
- Related: Kerberos Principal, Delegation Token
A file holding encrypted long-term keys for one or more Kerberos principals. Daemons and scheduled jobs use it to authenticate without an interactive password.
- Delegation Token
- Related: Kerberos Principal, Keytab
A short-lived credential issued after Kerberos authentication so a distributed job's tasks can access services without forwarding the user's ticket or keytab.
- TLS Certificate
- Related: Cloudera Manager, Kerberos Principal
A signed public-key document that lets CDP services encrypt traffic and verify each other's identity. Expired or mismatched certificates break agent heartbeats and web UI access.
- Cloudera Manager Alert
- Related: Health Check, Cloudera Manager
A notification triggered when a health check crosses a threshold, such as low disk or a down role. Alerts carry severity and can forward to email or external monitoring.
- Health Check
- Related: Cloudera Manager Alert, Role Group
A named test Cloudera Manager runs against a service or role, returning GOOD, CONCERNING, or BAD. Its thresholds and enablement are configurable per role group.
- Diagnostic Bundle
- Related: Cloudera Manager Alert, Health Check
A collected archive of logs, configuration, and metrics from cluster hosts, generated by Cloudera Manager to support troubleshooting without manual log gathering.
- Replication Policy
- Related: HDFS Snapshot, Cloudera Manager
A Cloudera Manager or Replication Manager rule that copies HDFS data, Hive metadata, or snapshots from a source to a target cluster on a schedule for disaster recovery.
- HDFS Snapshot
- Related: Replication Policy, NameNode High Availability
A read-only point-in-time view of a directory that consumes little extra space by sharing unchanged blocks. It enables rollback and consistent copies for replication.