Search for a command to run...
Series
Hands-on guides to data tooling, infrastructure, and operations — scheduling, pipelines, access control, and the engineering behind data workflows.
In a previous post, I mentioned Remote Functions—a powerful way to send data from BigQuery to an external service for processing, including a Cloud Run function. This is especially useful when SQL lacks built-in support for your specific needs, and w...
title: "Exploring the BigQuery Query History" seoTitle: "Understanding BigQuery Query History" seoDescription: "Discover how BigQuery's Job History helps track and retrieve past queries efficiently with filtering options and saved results for recent ...
Maybe save a bit on that next expensive laptop upgrade? Over the weekend, I worked on some small personal projects and decided to try out remote development using SSH and Visual Studio Code. I have an 18 GB M3 Pro MBP, which is acceptable, but it’s n...
Spreadsheets are a central part of a modern workplace. Pretty much every office workplace uses one. It's also quite used for personal use cases. One such product is Google Sheets. I use it for many things - organizing finance, planning travel itinera...
SQL folks, are you using any linters? Myself, I've used linters such as Pylint for Python, but in the last 3 years, despite working with BigQuery daily, I didn't use one. First, what is a linter? If you haven't encountered the term before, a linter l...
Some of the most interesting Data Engineering projects I've worked with leveraged Google Cloud Functions. It's a serverless execution environment that lets you run your code without provisioning or managing servers. I found it to be very versatile, e...
