How to Create a Data Pipeline with BigQuery and Airflow! Beginner's Guide to BigQuery + Airflow

In this video, I'll show you the basics of creating a data pipeline with BigQuery and Airflow!
airflow.apache...
docs.astronome...

[@Levy957]

your channel is insane! so much content with all the details and code. Keep up the good work!

[@thedataguygeorge]

Thanks so much Levy, appreciate the love!

[@dataengineermatheusbudin7011]

just found gold (your channel) wow what an amazing quality of content! congratz man!
Also can i make a request please? Could you please bring a "data pipeline end to end, using gcp compose (airflow), dataflow, cloud functions (triggers the dataflow when a new file lands in the bucket) and finally big query (fact and dimention tables, just a few)"
thank you in advance mate

[@thedataguygeorge]

Thanks Mattheus! I can definitely cook up a flow like that, will just be using Astro instead of GCP Compose ;)

[@santoshkumargouda6033]

please make a videoes on ETL scripts like incremental load scripts , validation scripts, backfill scripts , clean up scripts in etl process...

[@thedataguygeorge]

Yep, added to the pipeline for next week!