Search for a command to run...
Here's a useful Dataform concept: pre_operations and post_operations. As the name implies, these represent a set of actions that run before and after the main operation (table, view, or SQL operations
BigQuery has always been a SQL engine for tabular data. Object tables add an interesting twist to that. Instead of rows containing values, an object table gives you one row per file — pointing at da
Query your data lake with warehouse-grade security and performance — without moving a single file.
Ever run a heavy BigQuery SQL query, processed gigabytes of data — and then accidentally closed the tab or forgot to save the results? 😬 Don't re-run it. Your results are still there. BigQuery automa
You can use query parameters in BigQuery hashtag#SQL (now in the console as well!) — but how are they different from variables, and when should you use each? Both parameters and variables act as place
I've noticed that a new JSON function has been added (in Preview) in BigQuery SQL - JSON_FLATTEN(). It allows us to flatten JSON arrays and return a single flat ARRAY, no matter how many nested levels there are. So where is this actually useful?➡️ Ha...
Even an “empty” STRUCT is still technically something. Not the same as a standalone NULL value. This is why, if you work with STRUCTs in SQL and try to find the latest non-empty struct using LAST_VALUE(...) IGNORE NULLS, you’ll notice it doesn’t help...
I was doing some exploratory data analysis on a number of tables I didn’t have much information about and, unfortunately, didn’t know their grain. I needed a quick way to validate my assumptions about the table grain, identify contradicting observati...
So I recently discovered the WITH expression in BigQuery SQL. Not to be confused with the WITH clause, which we use to define common table expressions (CTEs). 👉 What does a WITH expression do?It lets you define a series of variables, scoped to a sin...
