Jessica Le – Medium

Published in Towards Dev

·Pinned

Reading BigQuery table in PySpark

A short intro and quick-start guide on how I setup Spark and read a Google BigQuery table from my local. — Table of Contents Introduction Pre-requisites Read from BigQuery in Spark 3.1 About Spark-BigQuery package Installing java Installing Cloud SDK Running spark-bigquery 3.2 Create the script file 3.3 Run the script Summary 1. Introduction Imagine you need to generate a report for upper management to keep track on the health of a product. How would you…

Spark

4 min read

Spark

4 min read

Pinned

Part 5a: Schedule dbt models on Airflow

My quick-start guide of running dbt models on Airflow with some tips and tricks — Previously — on my #dataseries A Beginner’s Guide to Apache Airflow — Part 3: Intro and Setup On my previous episode, we just finished setting up Airflow. In this episode, I will focus on the workflow — How to create a DAG file and schedule a run for your dbt…

Data

7 min read

Data

7 min read

Pinned

Part 5b: How to fail fast with Airflow

My quick post on my debugging method — Previously — on my #dataseries Part 5a: Schedule dbt models on Airflow Table of Contents Debugging Common errors 2.1 Python 2.2 Semantic - The long way - The hacky solution Airflow CLI Debugging Yesterday night I was struggling to debug some of the problems in Airflow. …

Data Analytics

5 min read

Data Analytics

5 min read

Pinned

A Beginner’s Guide to DBT (data build tool) — Part 4: DBT — Automation, Test and Templating

Welcome to my fourth episode on the #dataseries! Previously — on my #dataseries 1. A Beginner’s Guide to DBT (data build tool) — Part 1: Introduction 2. A Beginner’s Guide to DBT (data build tool) — Part 2: Setup guide & tips 3. …

Data

8 min read

Data

8 min read

Pinned

A Beginner’s Guide to Apache Airflow — Part 3: Intro and Setup

Setup Airflow with Docker in 15 minutes — This is my third episode on the #dataseries. Previously — on my #dataseries 1. A Beginner’s Guide to DBT (data build tool) — Part 1: Introduction 2. A Beginner’s Guide to DBT (data build tool) — Part 2: Setup guide & tips Table of Contents 1. What is Airflow? 1.1 — Definition 1.2 — Quick…

Data

5 min read

A Beginner’s Guide to Apache Airflow — Part 3: Intro and Setup

Data

5 min read

Published in SelectFrom

·Dec 11, 2021

9 Basic Commands for PySpark SQL

In the previous post — Reading BigQuery table in PySpark, I’ve written about what PySpark is with a quick setup. In this post, I will share with you 9 basic commands for Spark SQL using Python. Table of Contents Introduction Basic Commands Summary Introduction Many data scientists, analysts, and general business intelligence users rely…

Spark

4 min read

Spark

4 min read

Nov 7, 2021

Key Takeaways from Chapter 2 — Product Analytics: Applied Data Science Techniques for Actionable Consumer Insights

A framework to formulate testable hypothesis and quantify metrics from abstract concepts — TL;DR — “Every time we need to analyse a new social process in a web product, we should start with theory building. It’s the necessary foundation to derive actionable insight.” “Have you ever wondered how to come up with a good hypothesis for an A/B test?” Last Saturday, I came…

4 min read

Key Takeaways from Chapter 2 — Product Analytics: Applied Data Science Techniques for Actionable…

4 min read

Aug 22, 2021

Integrate GitHub Actions to automatically deploy to Firebase Hosting

How to deploy live & preview channels via GitHub pull requests — Last week I’ve shared how I deployed my static custom-built website to Firebase, then installed Google Tag Manager + Facebook Pixel to my web + seamlessly integrated it to Google Analytics 4. …

Data

6 min read

Integrate GitHub Actions to automatically deploy to Firebase Hosting

Data

6 min read

Aug 18, 2021

Integrate Modern Analytics Tracking stack to Your Website

How to install Tag Manager, Facebook Pixel to your Web and integrate it with Google Analytics 4 — In my previous post: Deploy to Firebase Hosting, I’ve shared about how I deployed my static custom-built website to Firebase. It shocked me on how seamless and user-friendly the deployment process was. …

Data

8 min read

Integrate Modern Analytics Tracking stack to Your Website

Data

8 min read

Aug 15, 2021

Deploy to Firebase Hosting

A quick simple guide to deploy your static website to Firebase — What is Firebase Hosting? Firebase is Google’s mobile application development platform. Firebase Hosting is a Google hosting service which provides static web content to the user in a secure, fast, free (under Spark Plan) and easy way. Why Firebase Hosting? Use case

Data

5 min read

Data

5 min read