Implementing FBS Project with Azure Part-1 ||Azure Data Engineer End-To End Project

Here we are implementing Cloud Data Warehouse Project with Azure
In this Video will discuss about how to build a pipelines for different loads and how to implement logs in ADF and Logical Apps
Notes::
drive.google.com/file/d/1PkG4...
Logs Notebooks
drive.google.com/file/d/1CCJ2...
Full Load:: The entire Data Set is replaced or overwritten with the new dataset. it will consume a lot of time when data size increases
Incremental load:: Instead of overwriting old data, incremental data load identifies the difference between source data and target data and append the difference to target data. Useful when dealing with huge volume of data.
#dataengineering
#azuredataengineer
#azuredatabricks
#pyspark
#database
#databricks

[@suman3316]

Best Video for Practical Cases...Thanks

[@gowthamg7576]

Best video for end to end practice

[@gowthamb4427]

Thanks for the videos bro. Really amazing video❤❤❤❤

[@DataSpark45]

Glad you like them!

[@shibajena4205]

something i found good in internet

[@prabhatgupta6415]

Bring more sir..u r very good.

[@prabhatgupta6415]

can you plz bring more like this plzz

[@pawansalwe1926]

make one video for pushing the code from lower environment to higher environment .

[@DataSpark45]

ok will try to make and upload it as soon as possible

[@yashoda5794]

can u please Share drive link for used datasets please
thank you!

[@DataSpark45]

drive.google.com/drive/folders/17r7sanydVB3v9dO9S71yPXslLQ_6kG5n?usp=sharing

[@gowthamg7576]

Hi
In this scenario do we need to create a container and folder or it will create automatically

[@lokeswarreddyvalluru5918]

We need to create containers Gowtham.

[@gowthamg7576]

Can we have source files that you have used

[@DataSpark45]

hi, please check it out in the description

[@premsagargadapa2097]

Hi, i think in the description also source files not uploaded. It would be a great help if you provide source files too