Video není dostupné.
Omlouváme se.

Big Query Live Training - A Deep Dive into Data Pipelining

Sdílet
Vložit
  • čas přidán 6. 08. 2024
  • What is BigQuery and why would you use it as a marketer? Amad is an agency owner who started to report on more and more data for his clients. Find out why processing your data in BigQuery is so awesome and get a deep dive into data pipelining with BigQuery in this live training replay.
    This was a private live training just for MeasureMasters members. To watch more monthly trainings sign up here: measureschool.com/products/me...
    OUTLINE:
    00:00 - Intro
    5:02 - The Big Data Problem
    7:21 - The Solution
    9:15 - Your Data Pipeline Journey
    15:54 - What is BigQuery?
    24:00 - Extract & Load Data: Getting Data into BigQuery
    29:37 - Transform Data: Clean, Join, Prepare and Manipulate
    31:03 - Using Your Data: Visualization, Analysis, and Upload
    34:25 - Hands-On Demo
    🔗 Links:
    Try BigQuery for Free: cloud.google.com/bigquery
    Google BigQuery Introduction Tutorial:
    • Google BigQuery Tutorial
    NEW Google BigQuery Course in MeasureMasters: measureschool.com/products/me...
    📄 Read this Video’s Guide: measureschool.com/google-bigq...
    🎓 Measure Masters Membership: measureschool.com/measure-mas...
    ❓ Take Our GA4 Quiz: measureschool.com/google-anal...
    FREE Tag Manager Course: measureschool.com/products/fr...
    FREE Analytics Course: measureschool.com/products/fr...
    🔀 GTM Copy Paste - Our Chrome extension chrome.google.com/webstore/de...
    🚀 Hire us: measureschool.com/services/?u...
    📚 Recommended Measure Books: kit.co/Measureschool/recommen...
    📷 Gear we used to produce this video: kit.co/Measureschool/measures...
    📡 Our Live Streaming Software: restream.io/join/YXLM2
    👍 FOLLOW US
    Facebook: / measureschool
    Twitter: / measureschool
    LinkedIn: / measureschool

Komentáře • 34

  • @MeasureSchool
    @MeasureSchool  Před 4 lety +5

    00:00 - Intro
    5:02 - The Big Data Problem
    7:21 - The Solution
    9:15 - Your Data Pipeline Journey
    15:54 - What is BigQuery?
    24:00 - Extract & Load Data: Getting Data into BigQuery
    29:37 - Transform Data: Clean, Join, Prepare and Manipulate
    31:03 - Using Your Data: Visualization, Analysis, and Upload
    34:25 - A Hands-On Demo

    • @andresu6796
      @andresu6796 Před 3 lety

      Great and usefull video,thanks a lot and he explains very well.

  • @MeerVideos
    @MeerVideos Před 3 lety +4

    As Digital Marketing is evolving and nobody knows how this is going to be in the next 5 years, It's so great to see how data science and marketing coming together.
    I'm on a journey to become a Market/Business Analyst from Digital Account Management. It's going to be an interesting switch and these videos are indeed life savior.

  • @putyah
    @putyah Před 2 lety

    This video is awesome. I've used the timeline/slides of this video for many presentations and it has been an blueprint for many projects. I always refrence to this channel before presenting. Thank you.

  • @AkshayKumarJain_official
    @AkshayKumarJain_official Před 3 lety +2

    This is a great video, I came across before having an interview to understand use-cases. Thanks

  • @useydkerimoglu5720
    @useydkerimoglu5720 Před 3 lety

    I think this was the most helpful video I have ever watched on CZcams. All the love :)

  • @madhukyatham
    @madhukyatham Před 4 lety +1

    Great Video measure school, Thank you, expecting more on bigquery as data guy. Thanks

  • @dudeiknowman
    @dudeiknowman Před 4 lety +4

    Thank you so much! So much value.

  • @lena5721
    @lena5721 Před 4 lety +8

    Best 1 hour investment in my education lately. That’s so this great video

  • @ASO-xh5vu
    @ASO-xh5vu Před 2 lety

    Fantastic presentation. Absolutely fantastic

  • @ignaciopinero2569
    @ignaciopinero2569 Před 2 lety

    Nice one guys : )
    thank you a lot and keep it up

  • @birdsong2552
    @birdsong2552 Před 3 lety +1

    more like these would be great!

  • @e-commercecorporation4583

    Very informative video
    Thank you so much

  • @saumitrad
    @saumitrad Před 2 lety

    The trainer (Amad) is fantastic.

  • @niteshnirala1664
    @niteshnirala1664 Před 4 lety +1

    Thanks for video Ahmad and Julian!
    Few questions I had
    - When we have terabytes of data in Bigquery. Do we leave it there or should I export to Google Cloud Storage? What is the good practice to minimize cost in Google Cloud?
    - I will be interested in having the app script. Do you have script that will update columns in row if it has a matching date? I want to extract data in weekly basis and upload it. I want to avoid duplicates and override values if the fields has changed.

  • @akshay6822
    @akshay6822 Před 3 lety

    Great video, I tried the same with a UK data set but for some reason, it’s giving me a syntax error when I merge two data sets “Unexpected String Literal”.

  • @ryanvaughan1247
    @ryanvaughan1247 Před 4 lety

    Can’t thank you enough.

  • @maraudeuse952
    @maraudeuse952 Před 2 lety

    Hello hello! Thank you for the tutorial.
    I did everything that was in the video, but I got no data in the datatable. I also did not get error message. Can you please tell me how I can debug the problem or what to do?

  • @gotit547
    @gotit547 Před 3 lety

    If I run query and connected that data to GDS and display there then how does the data view in data studio get refreshed if the data is from source like GA that is live

  •  Před rokem

    Ahmad is a top notch trainer. Which I could learn on the job with him. ;)
    I did not know that UA also had sampling data. The video has almost three years, so I don't know if at that time was possible. But right now can't we create a simple pipeline GA4 > BigQuery? Or the example of data pipelines were given to connect more data sources than only GA4? Did not full understand it. TY.

  • @RGopiKrishna
    @RGopiKrishna Před 4 lety +2

    why should we use it ?

  • @jahangeeryousaf6587
    @jahangeeryousaf6587 Před 3 lety

    hi Julian, coming to this video and the function that was copy pasted. i tried that function but i was stuck at newblob and could not go further and when i generated table automatically and tried to export the data to datastudio i was stuck with following error...
    Failed to fetch data from the underlying data set Error ID: 0e5ecee6
    can you help me with it?
    i will be very thankful to you

  • @user-oe5ki5to5v
    @user-oe5ki5to5v Před 3 lety

    Much thank you! Could you tell about incremental uploading? How does it work in BigQuery?

    • @abdulmunaf4941
      @abdulmunaf4941 Před 3 lety

      Did you find any solution? Iam also looking for possible solution on incremental upload

  • @sandeepmore5290
    @sandeepmore5290 Před 2 lety

    Good..I like your in dept knowledge about google big query.Can you deliver hands on demo on Google Big Query in online mode..plz reply..

  • @abhimanyusachdeva3082
    @abhimanyusachdeva3082 Před 3 lety +1

    The reason it did not work is that you misspelled the "Var TableID = dailly_users_per state", spelling of "dailly" is wrong in the script.

  • @ElcoTubes
    @ElcoTubes Před 4 lety

    Thank you for the great video. Is it possible to share the script?

    • @MeasureSchool
      @MeasureSchool  Před 4 lety +1

      please Email ahmad on his website

    • @Poziom666
      @Poziom666 Před 3 lety

      @@MeasureSchool
      If it's possible,
      also a script please

  • @sikendongol4208
    @sikendongol4208 Před 3 lety

    aayo BigQuery

  • @neuralbookkeeping9269

    Bummer, the one reason that I watched this video was to see how to authorize data and then he skipped over the process.

  • @michaelcarbonnier5877
    @michaelcarbonnier5877 Před 2 lety

    I am having some debugging issues around the "var spreadsheet" line
    var projectId = 'GA-userdata';
    var datasetId = 'GA_user_region';
    var tableId = 'daily_users_per_region';
    var spreadsheet = SpreadsheetApp.GetActiveSpreadsheet();
    var values = spreadsheet.getsheetsbyname('Bigquery_ref').getDatarange().getValues();
    var csv = generateCSV(values);