Microsoft Fabric Lakehouse
Vložit
- čas přidán 16. 07. 2024
- Microsoft Fabric is an end-to-end Data and Analytics software-as-a-service cloud offering by Microsoft. One of the important objects of Microsoft Fabric is Lakehouse. In this article and video, you will learn what Microsoft Fabric Lakehouse is and how to create it, load data into it, and read data from it.
Read my article here to learn more:
radacad.com/microsoft-fabric-... - Věda a technologie
Just wanted to say thank you Sir for your insightful videos
You are very welcome
Thank you!..i am learning from you!... regards from Ecuador
Cheers
Please make a series of MS Fabric, especially for Power BI user 😊 And do you know any pricing table of MS Fabric?
That is on the plan :)
Thank you so much ❤
Awesome video, thank you.
Glad you liked it!
Thanks Reza. That part of adding the table to a destination (Lakehouse) was the tricky part.
Also the "Connect to SQL Endpoint" explanation open new possibilities.
PS.: I still have that shirt from RADCAD I won at Montreal/Canada 2018. RLS Question!!
Yes, SQL endpoint is great
Oh, yes, I remember that RLS session, great time 😃👊 good to see you here
Thx! Interesting demo
Glad you liked it!
This video is awesome. I spent tons of times in searching for the "right" and "clear" information about fabric and this is genuine. Thank you for a great work. One of my questions is, in the first video, you talked about "direct lake" mode. If we can use "direct lake" mode, then why do we still need Lakehouse? I know this a quite weird question. But I am still confused with the "future concept" of fabric. What is the difference between "OneLake" and "Lakehouse" ?
Glad you liked it
OneLake is the storage engine for Fabric. Lakehouse, however is one of the objects that you can create in Fabric, the Lakehouse can keep data in structured or unstructured format, and it will save it in the OneLake.
So no matter if you use Lakehouse or Warehouse, you still use Onelake, because that is the storage engine.
Power BI then provide connection to it using Direct Lake, which is a direct connection to the OneLake.
If you check our few of our other videos about Fabric some of these concepts would be explained more in there.
@RADACAD Thanks. It helps me to better understand fabric ! I will watch the others as well.
Thank You
You're welcome
Really informative. Can you please confirm if the LakeHouse can be used in place of Kusto? If we take about a very huge volume of data and queries?
Very informative, & Gr8 Explanation! Besiar Ziba bood.
Thanks for liking
for dataset modify, what if i enable option on workspace to modify dataset online ( which is new feature from april i believe) this would give option to modify "power bi item" dataset
could you please make an end to end project video on fabric then we would be able to connect the dots and understand the whole process.
an end-to-end project might come in different paths; sometimes it might uses lakehouse, etl, and Power BI. Sometimes it might uses ETL, Data Warehouse, and then Power BI and Machine Learning.
I'll come up with scenarios hopefully in some videos to cover some of those.
Great. Please explain what is the advantage to connect to a dataflow created in a lake house, and to a dataflow, because I understand that we have the two options when creating a lake house. I appreciate your help. Is not clear for my, because I can create A data flow in power bi service too. Thank you so much👍
Can we load multiple tables in the lakehouse in a single go
Thank you Rada
I Tried to connect lakehouse with my SQL Server in my local machin by adding the server name and database name and simpl select some filed but it give me error by the way the steps i did with power query it is working if there is any additional steps for lakehouse
Thanks in advance
Thanks for sharing! Interesting the way you can also create a semantic model in the data lakehouse. Can we create multiple models in the same lakehouse? I'll look forward to your videos showing how that links to data marts.
Thanks
Yes, you can build more datasets with importing data from Lakehouse.
I'll work on the datamart vs lakehouse video sometimes soon.
Thanks for the introduction, Could you please let us know what is going to change for a power BI developer, most of the editing experience would move to cloud?
I guess Power BI web editing experience at some point will be strong enough to do everything in the web. However, the Desktop would still exists I imagine as it is faster to do things there.
Thank you for the great introduction. So is Power BI Desktop, Datawarehouses will be replaced by this feature ?
I don't think so, Data warehouse is still different than the Lakehouse, I might do another video about that subject later.
But most of the Power BI Desktop functionality is coming to web now, Which would make Power BI editing experience anywhere, even from Mac devices
@@RADACAD that's amazing . I like the features .
Thank you Rada
I Tried to connect lakehouse with my SQL Server in my local machin by adding the server name and database name and simpl select some filed but it give me error by the way the steps i did with power query it is working if there is any additional steps for lakehouse
Thanks in advance
Thank you Reza, for the great video. Where can I download AdventureWorksDW Excel file? Could you please share the link?
Thank you Reza for the videos. Could you start a playlist to go over data lake and warehouse by details , and little bit slowly to follow Microsoft updates. I feel MS are going fast.
Sure, we'll have a play list for Fabric. and there will be videos for comparing Lakehouse and Warehouse and Datamart etc.
After published I didn't find dataset only SQL endpoint and lake house
plus no refresh icon
Did you load the data into the Lakehouse?
Could you pls tell me will the SQLend point file be created or not for the semi-structured and unstructured data if we load into DataLake
SQL endpoint won't make sense for unstructured data, it only makes sense when you are querying a data table.
What is the difference between Lakehouse and One Lake?
OneLake is the storage. Lakehouse is a logical object, which stores both structured and unstructured files, but the storage that the Lakehouse uses is OneLake.
Thank you Reza, that is very helpful. When I tried Fabric I was confused by the different objects that were created in the Workspace. It does seem odd to me that you can write new DAX measures and structure your data in the SQL Endpoint rather than in the Power BI Dataset - is there a reason for that?
You're welcome
You are still doing that in the Power BI Dataset, however, the entry point of that seems to be from SQL Endpoint link. I imagine we might have an entry point from the dataset itself in the future too.
Hello Reza, Thank you so much. I cannot get the AdventureWorksDW_2019 excel file. Please help me 🙂
Sure. You can get it from here: radacad.com/files/AdventureWorksDW2012.xlsx
@@RADACAD Thanks a lot🙏🙏
I hope Microsoft Fabric isn't mandatory to use Power BI, Synapse or Azure Data Lake. Some customers can't or won't do that. For example, some customers use an ADLS2 storage account for DEV, another for QA/UAT and another for PROD. One of the promises of OneLake is there is only one account. Also, the data is auto-tagged. How does one override a bad/stupid tag? It will happen. I'm hoping I'm wrong on these, but I have concerns.
Also, if the entry point for Power BI is through this channel only - we'll see adoption drop - not grow.
No
Power BI will go as is. You don't need a Fabric license or pathway to use it. As you said, for some businesses, Power BI itself is enough.
But if you have Fabric, you can do more