Building an Enterprise Data Warehouse

Sdílet
Vložit
  • čas přidán 5. 09. 2024
  • In this video, I will cover the steps involved in building a data warehouse while telling the story of an actual implementation.

Komentáře • 43

  • @brutedebik1708
    @brutedebik1708 Před 2 lety +2

    when I thought my teacher was the best , then I found James Oliver....wow ....what an explanation ......wow ......i understood it from a better perspective now ....Thank you Sir James

  • @helovesdata8483
    @helovesdata8483 Před 3 lety +11

    I like how you go through a real-life project. I wanted to get an idea of how I would begin a job once I get into this field. This is great!

    • @helovesdata8483
      @helovesdata8483 Před rokem

      I'm returning with more knowledge than previously...lol Wouldn't it be beneficial to start with the business process? How were you able to run the new environment in parallel with the existing, if you are moving the data? I think I'm getting something mixed up here.

  • @danhendo4664
    @danhendo4664 Před 3 lety +3

    Thanks you so much! Your thought process is so well explained, this video is gold.

  • @michaela64
    @michaela64 Před 3 lety +1

    Hi James,
    Nicely done, how you explain step-by-step what is going on in a project. This shows you need to understand business requirements, the architecture which needs to be migrated and the data warehouse architecture, where you want to integrate.

  • @bilalmujahid9239
    @bilalmujahid9239 Před 2 lety

    This video is goldie gold. Thank you.

  • @Ayuk1
    @Ayuk1 Před 3 lety

    Beautiful illustrations. Clear and easy to understand. Thanks alot

  • @hiwotworkneh5101
    @hiwotworkneh5101 Před 4 lety +2

    Awesome video!! Subscribed👍

  • @i_maverickmonica
    @i_maverickmonica Před 3 lety

    Thanks! you explain things in simple words, great solution !

  • @rapo107
    @rapo107 Před 4 lety +2

    James... could you please make a video on edit links on metrics and thresholds on attribute? Thanks in advance

  • @thirumalaip6458
    @thirumalaip6458 Před 4 lety +1

    Thanks for the video. Can we please have more deep dive sessions on building a datawarehouse.

    • @JamesOliver
      @JamesOliver  Před 4 lety

      I don't see why not. Was there any particular aspect of building a data warehouse you had in mind?

    • @thirumalaip6458
      @thirumalaip6458 Před 4 lety +1

      @@JamesOliver Yes more insights on the design and the ETL part. Maybe you can start a series on Udemy on how to build an EDW end to end.

    • @norpriest521
      @norpriest521 Před 3 lety

      @@thirumalaip6458
      Can you recommend a book for EDW design please.
      Thank you.

  • @thangtran145
    @thangtran145 Před 2 lety

    Thanks, you made it easy to understand!

  • @olukimkan3837
    @olukimkan3837 Před rokem

    This is a sharpener, sharpened some rough edges. Cheers

  • @filibertogarced
    @filibertogarced Před 2 lety

    Great vid 👌
    Thanks for explaining everything so detailed 🙂

  • @sangnykungkea8011
    @sangnykungkea8011 Před 2 lety +1

    Can you upload the video demo the process build in SQL please!

  • @NattyWerewolf
    @NattyWerewolf Před 4 lety +2

    You’re a legend

  • @SimohmedRaiss
    @SimohmedRaiss Před 3 lety

    Amazing ! Very helpful

  • @andynelson2340
    @andynelson2340 Před 3 lety

    Wow, this is so informative. Thanks 😊

  • @pathfinder750
    @pathfinder750 Před 3 lety +1

    How does this only have 5k view?

  • @axequalsb8431
    @axequalsb8431 Před 3 lety

    Great Video!!!

  • @NattyWerewolf
    @NattyWerewolf Před 4 lety +1

    Thanks so much. Subscribed !!

  • @Fourtitude44
    @Fourtitude44 Před 2 lety

    good video

  • @jerzykepinski
    @jerzykepinski Před 2 lety

    This is nice. Thanks!

  • @Diamond_Hanz
    @Diamond_Hanz Před 3 lety +1

    omg... this is great!

  • @rezwanakhatun1015
    @rezwanakhatun1015 Před 2 lety

    Hi James, thank you so much for your thorough and detailed explanations and analogies. I really found your video helpful. One question I have on my mind, how long did it take for you to complete building and designing the DWH? What was the overall time frame for this project to deliver this solution to business?

    • @JamesOliver
      @JamesOliver  Před 2 lety +1

      Great question. This was done under a compressed timeline that not only included building the data warehouse but a new reporting environment and making the users comfortable with the new environment through training. The total time was approximately 6 months. However, under normal conditions, this is extremely aggressive but I had no choice so there were many sleepless nights and long weekends. Because I was the main architect doing most of the technical work I was able to save time by cutting out overhead and providing all the direction to the DBA and ETL teams.

    • @rezwanakhatun1015
      @rezwanakhatun1015 Před 2 lety

      @@JamesOliver Thank you so much for your response, really appreciate it!😊

  • @JoshuaWilsonNZ
    @JoshuaWilsonNZ Před 3 lety

    What was total project time from spec to users using the EDW ? Intrigued because I'm about to start building a dwh for the org I work for. That tip about the views was genius! much easier for devs to have something to shoot for that's in front of them, compared to doing discovery work.

    • @JamesOliver
      @JamesOliver  Před 3 lety

      Sorry for not answering sooner, missed this one but I would say make sure that the subject matter experts (ie those that understand the data best) are made to feel like they are part of the project. When building a data warehouse inevitably the devs will have many questions about the data and they cannot be waiting on people for answers or it can significantly impact the timeline. Do the developers have prior data warehouse experience?

    • @JoshuaWilsonNZ
      @JoshuaWilsonNZ Před 3 lety

      @@JamesOliver The org is quite fresh to modern data practices. Undeniably the devs will be enrolled in all the conversations. Its green fields here, likely we would bring in extra skill required. My big concern is the business doesn't have a clear picture on what end state should look like. I have my own vision for it, just wanted a baseline for total time if alignment is succinct across the biz

    • @JamesOliver
      @JamesOliver  Před 3 lety +2

      Yes it can be a challenge for the business to wrap their heads around what this is going to do for them. Funny enough I’m starting up a new Edw project myself and I presented to leadership and made sure I used examples they could relate to. For example, are there a specific report request for an executive that took forever to deliver because IT had to go hunting down the data? Let them know this will bring these requests down from weeks to days or months to weeks with a data warehouse. That should help.

  • @rapo107
    @rapo107 Před 4 lety

    Hi james... can we expect frequent uploads on microstrategy? Please make more videos on mstr.

    • @JamesOliver
      @JamesOliver  Před 4 lety +1

      ramesh pedakotla Yes, they will continue. Just been taking some summer vacation time with family so uploads have slowed for now. :)

    • @rapo107
      @rapo107 Před 4 lety

      @@JamesOliver.. enrolled in udemy for your videos.. 😊

    • @JamesOliver
      @JamesOliver  Před 4 lety

      @@rapo107 Thank you so much for enrolling! :)

  • @NattyWerewolf
    @NattyWerewolf Před 4 lety

    Do you use python for data cleaning ?

    • @JamesOliver
      @JamesOliver  Před 4 lety +1

      I do not use Python for data cleansing but you absolutely could. Typically I would handle data cleansing at the source if possible.

  • @boobkoo
    @boobkoo Před 3 lety

    You forgot to mention that you use Kimball method to build your DW. Also there is other options as well.

  • @rdbtumpy
    @rdbtumpy Před 3 lety

    Too much circumlocution. bored. stopped in the middle.