thanks for such a clear and simple explanation. Please wear a mic for recording, becuase what you are saying I cannot hear that in laptop mics, then i used my earphone then also your voice is coming very low, then i connected a wireless speaker to listen to you. so, kindly use a mic. Thanks
Can we use the wildcard path for data loading In my scenario I have folders like Inc/table_12072024/data.parquet Inc/table_13072024/data.parquet Everyday new folders getting created inside inc folders and inside that data folder is getting updated So any suggestions how to handle this type of scenario incrementally in dlt tables
thanks for such a clear and simple explanation. Please wear a mic for recording, becuase what you are saying I cannot hear that in laptop mics, then i used my earphone then also your voice is coming very low, then i connected a wireless speaker to listen to you. so, kindly use a mic. Thanks
Thank you, I will
Can we use the wildcard path for data loading
In my scenario I have folders like
Inc/table_12072024/data.parquet
Inc/table_13072024/data.parquet
Everyday new folders getting created inside inc folders and inside that data folder is getting updated
So any suggestions how to handle this type of scenario incrementally in dlt tables
You don't need *, autoloader with file notifications will take care on its own you just need to give path till Inc folder