DMLI flashcards
DMLI · Build recall with a focused review session.
32 cards. Read the term and the definition here. The deck at the top of this page is optional.
- Data Steward
- A role accountable for the quality, definitions, and appropriate use of data within an assigned domain, operating under the data owner's authority.
- Master Data
- Core business entities such as customer, product, and employee that are shared across systems and require consistent, governed definitions.
- Reference Data
- A controlled set of permissible values, such as country codes or order statuses, used to classify and constrain other data consistently.
- Metadata
- Data that describes other data, including business definitions, technical schemas and data types, and operational statistics such as job logs.
- ACID Properties
- Atomicity, consistency, isolation, and durability: guarantees that a transaction completes fully or not at all and survives failures.
- CAP Theorem
- A distributed system can simultaneously guarantee only two of consistency, availability, and partition tolerance when a network partition occurs.
- Data Lifecycle
- The phases data passes through: plan, design and enable, create and obtain, store and maintain, use and enhance, share, archive, and purge.
- Decision Rights
- Explicitly assigned authority to make and approve decisions about data, such as definitions, access, and quality thresholds, within a governance model.
- GDPR Lawful Bases
- Consent, contract, legal obligation, vital interests, public task, and legitimate interests; at least one must apply to every processing activity.
- Data Processing Agreement
- A contract between controller and processor specifying subject matter, duration, purpose, data categories, and security measures for processing personal data.
- Data Classification
- Assigning data to tiers such as public, internal, confidential, and restricted, which determines required access, encryption, and retention controls.
- Legal Hold
- A directive that suspends scheduled destruction of data relevant to litigation, investigation, or audit until the hold is formally released.
- Record of Processing Activities
- A register documenting each processing activity's purpose, data and subject categories, recipients, retention periods, and security measures.
- Data Subject Access Right
- An individual's right to obtain confirmation and a copy of their personal data being processed, generally answered within one month under GDPR.
- Segregation of Duties
- Separating authorization, custody, and reconciliation responsibilities so no single person can both cause and conceal an error or misuse.
- Data Quality Dimensions
- The six core measures: completeness, accuracy, consistency, timeliness, uniqueness, and validity, each assessed against defined rules.
- Data Profiling
- Statistical analysis of source data covering null counts, distinct values, min/max ranges, frequency distributions, and pattern detection.
- Idempotent Pipeline
- A pipeline that produces identical output when rerun on the same input, making retries and backfills safe without duplication.
- Data Lineage
- A recorded path of data from source through transformation to target, used for impact analysis and root-cause investigation.
- SCD Type 2
- A dimension technique preserving history by inserting a new row per change, with effective dates and a current-record flag.
- ETL versus ELT
- ETL transforms data before loading into the target; ELT loads raw data first and transforms it inside the target platform.
- Reconciliation Control
- Comparing source and target record counts and control totals to detect records lost or duplicated during integration.
- Third Normal Form
- A table is in 3NF when it is in 2NF and has no transitive dependency of a non-key attribute on the primary key.
- Fact Table Grain
- The precise level of detail represented by one row of a fact table, declared before selecting measures and dimensions.
- Star Schema
- A dimensional design with a central fact table joined to denormalized dimension tables, optimized for query simplicity and speed.
- Data Vault Model
- An integration model using hubs for business keys, links for relationships, and satellites for descriptive attributes with history.
- Conceptual Data Model
- The highest-level model showing business entities and their relationships without attributes, keys, or physical implementation detail.
- Surrogate Key
- A system-generated identifier assigned in the warehouse that decouples warehouse records from source business keys and supports history.
- Analytics Maturity Levels
- Descriptive answers what happened, diagnostic why, predictive what will happen, and prescriptive what action should be taken.
- Leading versus Lagging Indicators
- Leading indicators predict future outcomes and are actionable early; lagging indicators confirm outcomes already realized.
- Semi-Additive Measure
- A fact measure that can be summed across some dimensions but not others, such as an account balance that cannot be summed over time.
- K-Anonymity
- A privacy property requiring each record to be indistinguishable from at least k-1 other records on the released quasi-identifiers.