SnowPro Advanced Data Engineer key terms
SnowPro Advanced Data Engineer · Get comfortable with the vocabulary.
- Stage
- Related: Storage Integration, COPY INTO, File Format Object
A named location holding data files for loading into or unloading out of Snowflake. Internal stages are managed by Snowflake; external stages point at cloud storage such as S3, GCS, or Azure Blob.
- Storage Integration
- Related: Stage
An account-level object that stores the cloud identity and permissions Snowflake uses to read and write an external storage bucket, so individual stage definitions do not need embedded credentials.
- File Format Object
- Related: Stage, COPY INTO
A reusable named definition of how to parse staged files: type (CSV, JSON, Parquet and so on), delimiter, compression, header handling, and null treatment, referenced by stages and COPY statements.
- COPY INTO
- Related: Stage, Snowpipe, File Format Object
The SQL command that loads staged files into a table or unloads table data to a stage, with options controlling file formats, error handling, file purging, and validation before a real load.
- Snowpipe
- Related: Snowpipe Streaming, Stage
A Snowflake-managed service that loads new files automatically as they land in a stage, using cloud event notifications or a periodic file listing, with serverless compute billed per file loaded.
- Snowpipe Streaming
- Related: Snowpipe
A low-latency ingestion API that writes rows directly into Snowflake tables from client applications using the Snowflake Ingest SDK, without staging files first.
- Stream
- Related: MERGE, Task
A Snowflake object that captures change data, meaning inserts, updates, and deletes, on a source table so downstream jobs can process only the rows that changed since the last consumption.
- MERGE
- Related: Stream
A single SQL statement that inserts, updates, or deletes rows in a target table depending on whether each source row matches an existing key, commonly used to apply streamed change data.
- FLATTEN
- Related: VARIANT
A table function that turns arrays or objects stored inside a VARIANT column into individual rows, usually joined back to their parent row with a LATERAL clause.
- QUALIFY
A Snowflake clause that filters rows on the output of window functions inside the same query block, removing the need for an extra subquery or CTE.
- Snowflake Scripting
- Related: Task
Snowflake's procedural SQL dialect for stored procedures and anonymous blocks, providing variables, branching, loops, cursors, resultsets, and exception handling.
- Micro-partition
- Related: Clustering Key, Partition Pruning
Snowflake's immutable, compressed storage unit holding a contiguous slice of table rows, with per-column metadata such as minimum and maximum values that the optimizer uses to skip data.
- Clustering Key
- Related: Clustering Depth, Micro-partition
A table setting naming the columns Snowflake should physically co-locate data on, improving pruning for large tables that are frequently filtered or joined on those columns.
- Clustering Depth
- Related: Clustering Key
A measure of how well a table's micro-partitions are sorted by its clustering columns; lower depth means better pruning and typically faster scans.
- Zero-Copy Clone
- Related: Time Travel, Micro-partition
A metadata-only copy of a database, schema, or table that shares the source's micro-partitions until either side is modified, making copies fast and cheap in storage.
- VARIANT
- Related: FLATTEN
A semi-structured Snowflake data type that holds JSON, Avro, ORC, Parquet, or XML documents in a single column, queried with dot and bracket notation.
- Query Profile
- Related: Spilling, Partition Pruning
A visual execution breakdown of a single query showing each operator's timing, rows and partitions processed, and memory or disk spilling, used to locate performance bottlenecks.
- Partition Pruning
- Related: Micro-partition, Clustering Depth
The optimizer's ability to skip micro-partitions whose metadata shows they cannot satisfy a query's filters, reducing the volume of data scanned.
- Spilling
- Related: Query Profile
Overflow of intermediate results to local disk and then remote storage when a warehouse runs out of memory, which slows queries and signals an undersized warehouse or an unfiltered join.
- Result Cache
An account-wide cache that returns the stored output of a previously executed query when an identical query arrives and the underlying data has not changed, using no warehouse compute.
- Multi-Cluster Warehouse
A warehouse setting that starts additional compute clusters automatically when queries begin to queue and shuts them down when demand falls, supporting high concurrency.
- Search Optimization Service
- Related: Clustering Key
An optional service that maintains an auxiliary index structure so selective lookups, equality tests, and substring predicates on large tables avoid full table scans.
- RBAC
- Related: Database Role, Secure View
Snowflake's access model in which privileges are granted to roles, roles are granted to users or other roles, and a user's effective rights come from the roles active in the session.
- Row Access Policy
- Related: Masking Policy, Secure View
A schema-level policy attached to a table or view that decides, at query time, which rows a given role is allowed to see.
- Masking Policy
- Related: Tag-Based Masking, Row Access Policy
A column-level policy that returns a substituted value, such as a hash or null, to unauthorized roles while authorized roles continue to see the original data.
- Tag-Based Masking
- Related: Masking Policy
Assigning a tag to sensitive columns and attaching a masking policy to that tag, so the protection is applied automatically everywhere the tag is set.
- Secure View
- Related: Row Access Policy
A view that hides its defining SQL and the objects it references from users, so they cannot inspect underlying tables or infer data they lack privileges for.
- Time Travel
- Related: Fail-safe, Zero-Copy Clone
A retention window, up to 90 days for permanent objects, during which past table states can be queried with AT or BEFORE clauses or restored after a mistake.
- Fail-safe
- Related: Time Travel
A fixed seven-day period after Time Travel expires during which only Snowflake support can recover deleted or lost data; users cannot query it directly.
- Network Policy
- Related: RBAC
An account-level or user-level rule that permits or blocks session access based on the client's IP address range.
- Secure Data Sharing
- Related: Reader Account, Database Role
A Snowflake capability that exposes selected database objects to consumers through a share with no data copied, so consumers query the provider's live, read-only data.
- Reader Account
- Related: Secure Data Sharing
A separate Snowflake account created and paid for by a provider so external consumers who do not own a Snowflake account can query shared data.
- Data Exchange
- Related: Secure Data Sharing
A private, invitation-only hub where members publish and subscribe to shares, typically used between an organization and its partners or internal business units.
- Database Role
- Related: Secure Data Sharing, RBAC
A role defined inside a database that bundles privileges on that database's objects and can be granted to shares, accounts, or account-level roles.
- Replication
- Related: Secure Data Sharing
Copying databases, shares, and account objects to another region or account so they stay available for disaster recovery or for readers located in that region.
- Task
- Related: Task Graph (DAG), Stream
A Snowflake object that runs a SQL statement or stored procedure on a schedule or when triggered, and can be chained to other tasks.
- Task Graph (DAG)
- Related: Task, Dynamic Table
A set of tasks connected by dependencies so that one root task triggers a directed acyclic graph of child tasks in a defined order.
- Dynamic Table
- Related: Task
A table whose contents Snowflake keeps current automatically from a query you define, refreshing incrementally as base data changes instead of relying on scheduled jobs.
- Serverless Task
- Related: Task
A task that runs on Snowflake-managed compute rather than a user warehouse, so no warehouse has to be sized or kept running for scheduled work.
- Error Notification Integration
- Related: Task, Snowpipe
An account-level integration with a cloud messaging service or email that lets tasks and pipes send alerts when a run fails.