SnowPro Advanced Data Engineer study materials
SnowPro Advanced Data Engineer study resources

SnowPro Advanced Data Engineer key terms

SnowPro Advanced Data Engineer · Get comfortable with the vocabulary.

Stage

A named location holding data files for loading into or unloading out of Snowflake. Internal stages are managed by Snowflake; external stages point at cloud storage such as S3, GCS, or Azure Blob.

Related: Storage Integration, COPY INTO, File Format Object
Storage Integration

An account-level object that stores the cloud identity and permissions Snowflake uses to read and write an external storage bucket, so individual stage definitions do not need embedded credentials.

Related: Stage
File Format Object

A reusable named definition of how to parse staged files: type (CSV, JSON, Parquet and so on), delimiter, compression, header handling, and null treatment, referenced by stages and COPY statements.

Related: Stage, COPY INTO
COPY INTO

The SQL command that loads staged files into a table or unloads table data to a stage, with options controlling file formats, error handling, file purging, and validation before a real load.

Related: Stage, Snowpipe, File Format Object
Snowpipe

A Snowflake-managed service that loads new files automatically as they land in a stage, using cloud event notifications or a periodic file listing, with serverless compute billed per file loaded.

Related: Snowpipe Streaming, Stage
Snowpipe Streaming

A low-latency ingestion API that writes rows directly into Snowflake tables from client applications using the Snowflake Ingest SDK, without staging files first.

Related: Snowpipe
Stream

A Snowflake object that captures change data, meaning inserts, updates, and deletes, on a source table so downstream jobs can process only the rows that changed since the last consumption.

Related: MERGE, Task
MERGE

A single SQL statement that inserts, updates, or deletes rows in a target table depending on whether each source row matches an existing key, commonly used to apply streamed change data.

Related: Stream
FLATTEN

A table function that turns arrays or objects stored inside a VARIANT column into individual rows, usually joined back to their parent row with a LATERAL clause.

Related: VARIANT
QUALIFY

A Snowflake clause that filters rows on the output of window functions inside the same query block, removing the need for an extra subquery or CTE.

Snowflake Scripting

Snowflake's procedural SQL dialect for stored procedures and anonymous blocks, providing variables, branching, loops, cursors, resultsets, and exception handling.

Related: Task
Micro-partition

Snowflake's immutable, compressed storage unit holding a contiguous slice of table rows, with per-column metadata such as minimum and maximum values that the optimizer uses to skip data.

Related: Clustering Key, Partition Pruning
Clustering Key

A table setting naming the columns Snowflake should physically co-locate data on, improving pruning for large tables that are frequently filtered or joined on those columns.

Related: Clustering Depth, Micro-partition
Clustering Depth

A measure of how well a table's micro-partitions are sorted by its clustering columns; lower depth means better pruning and typically faster scans.

Related: Clustering Key
Zero-Copy Clone

A metadata-only copy of a database, schema, or table that shares the source's micro-partitions until either side is modified, making copies fast and cheap in storage.

Related: Time Travel, Micro-partition
VARIANT

A semi-structured Snowflake data type that holds JSON, Avro, ORC, Parquet, or XML documents in a single column, queried with dot and bracket notation.

Related: FLATTEN
Query Profile

A visual execution breakdown of a single query showing each operator's timing, rows and partitions processed, and memory or disk spilling, used to locate performance bottlenecks.

Related: Spilling, Partition Pruning
Partition Pruning

The optimizer's ability to skip micro-partitions whose metadata shows they cannot satisfy a query's filters, reducing the volume of data scanned.

Related: Micro-partition, Clustering Depth
Spilling

Overflow of intermediate results to local disk and then remote storage when a warehouse runs out of memory, which slows queries and signals an undersized warehouse or an unfiltered join.

Related: Query Profile
Result Cache

An account-wide cache that returns the stored output of a previously executed query when an identical query arrives and the underlying data has not changed, using no warehouse compute.

Multi-Cluster Warehouse

A warehouse setting that starts additional compute clusters automatically when queries begin to queue and shuts them down when demand falls, supporting high concurrency.

Search Optimization Service

An optional service that maintains an auxiliary index structure so selective lookups, equality tests, and substring predicates on large tables avoid full table scans.

Related: Clustering Key
RBAC

Snowflake's access model in which privileges are granted to roles, roles are granted to users or other roles, and a user's effective rights come from the roles active in the session.

Related: Database Role, Secure View
Row Access Policy

A schema-level policy attached to a table or view that decides, at query time, which rows a given role is allowed to see.

Related: Masking Policy, Secure View
Masking Policy

A column-level policy that returns a substituted value, such as a hash or null, to unauthorized roles while authorized roles continue to see the original data.

Related: Tag-Based Masking, Row Access Policy
Tag-Based Masking

Assigning a tag to sensitive columns and attaching a masking policy to that tag, so the protection is applied automatically everywhere the tag is set.

Related: Masking Policy
Secure View

A view that hides its defining SQL and the objects it references from users, so they cannot inspect underlying tables or infer data they lack privileges for.

Related: Row Access Policy
Time Travel

A retention window, up to 90 days for permanent objects, during which past table states can be queried with AT or BEFORE clauses or restored after a mistake.

Related: Fail-safe, Zero-Copy Clone
Fail-safe

A fixed seven-day period after Time Travel expires during which only Snowflake support can recover deleted or lost data; users cannot query it directly.

Related: Time Travel
Network Policy

An account-level or user-level rule that permits or blocks session access based on the client's IP address range.

Related: RBAC
Secure Data Sharing

A Snowflake capability that exposes selected database objects to consumers through a share with no data copied, so consumers query the provider's live, read-only data.

Related: Reader Account, Database Role
Reader Account

A separate Snowflake account created and paid for by a provider so external consumers who do not own a Snowflake account can query shared data.

Related: Secure Data Sharing
Data Exchange

A private, invitation-only hub where members publish and subscribe to shares, typically used between an organization and its partners or internal business units.

Related: Secure Data Sharing
Database Role

A role defined inside a database that bundles privileges on that database's objects and can be granted to shares, accounts, or account-level roles.

Related: Secure Data Sharing, RBAC
Replication

Copying databases, shares, and account objects to another region or account so they stay available for disaster recovery or for readers located in that region.

Related: Secure Data Sharing
Task

A Snowflake object that runs a SQL statement or stored procedure on a schedule or when triggered, and can be chained to other tasks.

Related: Task Graph (DAG), Stream
Task Graph (DAG)

A set of tasks connected by dependencies so that one root task triggers a directed acyclic graph of child tasks in a defined order.

Related: Task, Dynamic Table
Dynamic Table

A table whose contents Snowflake keeps current automatically from a query you define, refreshing incrementally as base data changes instead of relying on scheduled jobs.

Related: Task
Serverless Task

A task that runs on Snowflake-managed compute rather than a user warehouse, so no warehouse has to be sized or kept running for scheduled work.

Related: Task
Error Notification Integration

An account-level integration with a cloud messaging service or email that lets tasks and pipes send alerts when a run fails.

Related: Task, Snowpipe