My quick-start guide of running dbt models on Airflow with some tips and tricks

Schedule dbt models on Airflow

On my previous episode, we just finished setting up Airflow. In this episode, I will focus on the workflow — How to create a DAG file and schedule a run for your dbt models on Airflow. Let’s get started :)


My quick post on my debugging method

Schedule dbt models on Airflow

Part 5a: Schedule dbt models on Airflow

Table of Contents

  1. Debugging
  2. Common errors
    2.1 Python
    2.2 Semantic
    - The long way
    - The hacky solution
  3. Airflow CLI

Debugging

Yesterday night I was struggling to debug some of the problems in Airflow. But after a while, I was able to iterate quickly and fix the problem.

After using this debugging method I was able to follow the fail-fast principle and debug quickly. Now today I quickly sat down and wrote this short post to share with everyone (but i think many of you have already been using it). …


Installation and Data pre-processing

This is my second episode. If you are new and want to know what are the key power of DBT, you can visit my first episode on this #dbtdataseries.

Getting started with data build tool (dbt) on Google BigQuery

Table of Contents

1) Set up DBT

Homebrew

What is Homebrew? Homebrew is an open-source software package manager that makes it easier to install software on macOS. It’s like AppStore for installation.

1.1 Install Homebrew. Then, run:

brew…


What is the power of DBT?

This is a rather short introduction about DBT. Further explanation with examples will be available in my next episode.

Table of Contents

What is DBT?

DBT (data build tool) is a command-line tool that enables data analysts and engineers to transform data in their warehouses simply by writing SELECT statements.

DBT does the T in ETL (Extract, Transform, Load) process — it doesn’t extract or load data, but it’s extremely good at transforming data that’s already loaded into your warehouse.


Whether you want to have a quick guide on what is Google Shopping ads or look for a quick study exam guide before taking Google’s assessment, here you go. Below is my summary of 7 key points that will help you ace the exam like a boss and get certified as you wish.

Google Shopping ads campaign

As you may know, SkillShop with Google is a platform where you can grow your skills using Google advertising tools to advertise your business online and get certified which is usually valid for a year. And yes it’s totally free which is a great thing for a student like me.

Google Ads is one of the most widely-used Google advertising tools industry-wide. Under Google Ads umbrella, they offer courses like Ads Search, Ads Display, Ads Video, and Ads Measurement.

Google Shopping Ads is one of them.

Who is this course for?

Either student like me who or retailers who wants…


“Minimalism was a radical turning point in the history of art that it has roots in Asia. Emerging in the 1960s, it changed how we experience the art object, making the physical encounter with the artwork and its surrounding space increasingly important.” — National Gallery Singapore

Impermanence, quality of being, egolessness, emptiness, and rebirth are key thoughts expressed in Suzuki’s philosophy that are also expressed in these arts I see.

Impermanence in existence

Everything is tentative existence. Each existence is another expression of the quality of being itself. “Within this moment, this temporal existence does not change, does not move…

Jessica Le

Data-driven, strategic professional with a passion for driving user acquisition and product performance. Eager to make a social impact in this VUCA world.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store