Ingestion-time partitioning in BigQuery
C
Senior Data Engineer • Contractor / Freelancer • GCP & AWS Certified
Command Palette
Search for a command to run...
Comments
Join the discussionNo comments yet. Be the first to comment.
BigQuery Performance
Part 10 of 13
Practical guides to making BigQuery queries faster and cheaper — partitioning, clustering, search indexes, time travel, cost optimization, and query tuning strategies.
Why partitioning tables is not a silver bullet for BigQuery performance
I recently encountered an interesting case that reminded me of a couple of things and taught me a few lessons. When working with BigQuery tables, partitioning and clustering are often go-to operations. Typically, we would partition by a meaningful da...
More from this blog
pre_ and post_operations in Dataform
Here's a useful Dataform concept: pre_operations and post_operations. As the name implies, these represent a set of actions that run before and after the main operation (table, view, or SQL operations
May 20, 20261 min read
BigQuery Object Tables: A Practical Introduction
BigQuery has always been a SQL engine for tabular data. Object tables add an interesting twist to that. Instead of rows containing values, an object table gives you one row per file — pointing at da
May 15, 20262 min read
BigQuery BigLake Tables Explained: What They Are and When to Use Them
Query your data lake with warehouse-grade security and performance — without moving a single file.
Apr 26, 20264 min read
BigQuery Saves Your Query Results — Here's How to Find Them
Ever run a heavy BigQuery SQL query, processed gigabytes of data — and then accidentally closed the tab or forgot to save the results? 😬 Don't re-run it. Your results are still there. BigQuery automa
Mar 5, 20261 min read
Parameters in BigQuery
You can use query parameters in BigQuery hashtag#SQL (now in the console as well!) — but how are they different from variables, and when should you use each? Both parameters and variables act as place
Feb 7, 20261 min read
