Processing Slowly Changing Dimensions with ADF Data Flows

Do you want to learn how to slowly change dimensions with Azure Data Factory?
This session will begin with an overview of Azure Data Factory Data Flows and a review of dimension processing patterns, followed by demos.
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -- - - - - - - - - - - - - - - - - - - - - - - -
Next step on your journey:
👉 On-Demand Learning Courses FREE Trial: www.pragmaticworkstraining.co...
🔗Pragmatic Works On-Demand Learning Packages: pragmaticworks.com/pricing/
🔗Pragmatic Works Boot Camps: pragmaticworks.com/boot-camps/
🔗Pragmatic Works Hackathons: pragmaticworks.com/private-tr...
🔗Pragmatic Works Virtual Mentoring: pragmaticworks.com/virtual-me...
🔗Pragmatic Works Enterprise Private Training: pragmaticworks.com/private-tr...
🔗Pragmatic Works Blog: blog.pragmaticworks.com/
Let's connect:
✔️Twitter: / pragmaticworks
✔️Facebook: / pragmaticworks
✔️Instagram: / pragmatic.works
✔️LinkedIn: / pragmaticworks
✔️CZcams: / pragmaticworks
Pragmatic Works
7175 Hwy 17, Suite 2 Fleming Island, FL 32003
Phone: [phone]
Email: [e-mail]

[@abelfelleke7290]

Thank you it neat and briefly explained

[@terryliu3635]

Great intro! Thanks!

[@vishal259]

It would be good if you can upload scripts you have used in demo. It would be a good reference for audience.

[@theownmages]

how would i quarry to get a view of a dataset looked like at a spesific date, if i structured it like this type 2?

[@Sarabjitsethi]

how are u taking care,if same hash exists ?

[@moesmael]

It was a very good explanation, but in Insert Sink, it will not insert newly updated rows with new Keys and new ActiveEnddate. Please make sure about the process, but I would like to thank you very much, it was a very good demo and helpful

[@rohitnath5545]

Why do you think it wont work

[@shivanityagi1073]

Can you please explain how to implement type 3 and type 2 scd in adf?

[@srinin6252]

its great explanation ,can you provide me the source file which you used for current SCD Type one? will try for that

[@saswatibhattacharjee4992]

czcams.com/video/-cGPnND2880/video.html

[@YTEEsenior]

On insert for uniqueidentifiers, how can you create a "new guid"?

[@bobrubocki5305]

Assuming you are loading to a SQL Server DB, you could create a default constraint and use the NEWID() function.

[@jagadishparale8632]

Can you share the files used in the demos

[@reckitt9173]

16:42 Correct me if I am wrong. This step will be prove bottleneck when data count is higher. Instead it would have added at 24:04 as lookup. We need a logic here for a data whose records found can be consider update and for other is insert.

[@kal1leo]

how do I export and import a data factory including all the pipelines,data flows & data sets?

[@rameshchowdary6390]

You can go to resource group where you created your data factory and click on export. It generates json code then click on download. ARM Template will be downloaded to your local machine.

[@abelfelleke7290]

Can you make a video which shows how you transfered those data set files

[@bobrubocki5305]

For this demo, I manually uploaded the files with Azure Storage Explorer.

[@amitnavgire8113]

ITs just too slow and requires a lot of patience to watch this video...