Shared & Certified datasets in Power BI
Vložit
- čas přidán 7. 08. 2024
- Let's take a look at the new shared and certified datasets feature in Power BI Desktop and the Power BI service. This opens up a lot of possibilities and helps to reduce data silos.
********
LET'S CONNECT!
********
-- / guyinacube
-- / awsaxton
-- / patrickdba
-- / guyinacube
-- / guyinacube
-- guyinacube.com
**Gear**
Check out my Tools page - guyinacube.com/tools/ - Věda a technologie
One of those videos that literally answers precisely what you want to know. Just outstanding in both content and production quality. Wow.
That's just gold.
Thanks for the video, Adam.
Hey Adam, you are awesome man. the way you explain things is really amazing. keep going 😎😎
I appreciate that very much! Thank you so much for watching. 👊
Great explanation man
Definitely exploring that option
The intro track is a banger...
Thanks a lot ! Have you plan to details the Roles 5Row Level Security) between Shared DataSet ? Is there any Apps to centralize or manage the who get access to what and where ?
Would love to see shared datasets integrated with deployment piplines in premium capacities - so dev/test/prod report collections in various workspace "triads" automatically connect to the corresponding dev/test/prod dataset version in the supporting dataset-carrying master workspaces. Currently using pipelines but manually maintaining versioning across deployment versions and workspaces.
Great news! Game changer!
Agreed 👊 Thanks for watching!
Super Helpful video! Just curious, are we able to build a Dataflow based on a certified dataset from Power BI?
Thanks for this video.. super helpful.. I was struggling to figure out why I could not "share" a dataset.. and closer to the end you talked about the fact that the workspace needs too be a NEW workspace... Is there a way to "tell" that a workspace is in the New mode or old? and can the old be converted to a new?
By the time I am writing this reply the conversion procedures may have been announced. But generally if you right click on a workspace, and you see a lot of menu options, that is an OLD workspace. A new workspace will have far fewer options. To test this, create a new workspace, and then right click it. Then compare with a workspace that has been around a while. I do know that they WILL be announcing a conversion process if they haven't already.
Thank you really much for the video. Could you please show where to select the "publish this dataset to workspace xyz" ?
To publish a dataset, within Power BI Desktop, hit the Publish button on the ribbon bar. It will then allow you to select a workspace from the items you have access to.
Thanks Adam¡
Most welcome! 👊
Does anyone have this working well in combination with deployment pipelines? I need a report connecting to a shared dataset to change connection across the pipeline, as well as report authors need to be able to change connection to the dataset in the dev workspace during the development phase.
Hi Adam & Patrick.. I am looking for a way to apply query merges and transformations on my shared datasets, building relationships between two or more shared datasets and so on... for a specific report. Do you already have a video on that? If so, can you please help me with the link.. Couldnt find any help around that yet. If it's not already out, it will be extremely helpful, if you can make one!
Does shared dataset have any performance catch? Say if you have a complex data model and fairly large amount of users and even considerable number of reports hanging on the dataset. Does that lock data elements when processing a query like database?
In my organization we use Teams to share Datasets. In Power Bi, with the web connector, I can "get data" from these shared Datasets which at the end are in SharePoint365. So, I believe that SharePoint offers the same functional capabilities than these Datasets from the point of view of a Power Bi user. Am i wrong? Do I miss anything?
I mean that Power Bi Shared Datasets offer the same functional capabilities than sharing Datasets from Teams(SharePoint) 365.... maybe just a subtle difference….
How you have shared the dataset from one workspace to another?
I will have to publish it from the desktop to that specific workspace but will publish both the dataset and report will be published?
Hi Adam,
Thanks for the video. Is the dataset still certified after the owner modified a certified dataset?
Chears
I just tried re-publishing from Power BI Desktop. Even though it says replace it, the endorsement still held. The certified endorsement won't reset.
I have a dataset that is consumed by multiple reports. Now I am adding data from last 20 years to same data set but existing reports should only use last n number of years. Is there a way to filter last n years when connecting to shared dataset or my only option is to apply report filter on all reports
Hi, awesome videos, thank you. We have to use PBI Report Server on premise and I can't find anywhere where it talks about introducing the shared and certified datasets into the on-premise PBI Report Server. Have I missed the good news.
txs d
Thanks for the kind words. Shared/certified datasets is a cloud feature only. It won't be available for Power BI Report Server.
@@GuyInACube Thank you for confirming. Another annoying feature in Power BI where the some of the options appear, but the functionality behind it doesn't exist
Adam, great video once again. I have a question on managing the certification of data sets (and now Reports has been added). I am creating a Powerapp Flow and will point my users seeking to certify to a Sharepoint List where they can create an item and that will kick off my Approval Flow. But the question I have on this is if I am Power BI Admin will I be notified by Power BI that a dataset or Report has had a request for certification made? If so, will I then be able to see that Data Set or Report even if I am not a member of the workspace it is in? I'm asking because as of now even with myself as Power BI Admin, I cannot see everything that is created in our powerbi.com tenant, I can only see things shared with me, not everything that's being created.
Hi Adam,
Thanks for the video. I have a question about updating data. When the dataset is updated from SQL tables, do the reports which are referenced to dataset update automatically? Or do we need to update them as well?
There is a potential visual cache on the reports. It's not super long though, but if you hit the report right after the refresh, you may need to hit the refresh button to see the updated data. I want to say it is about an hour.
Hello,
When I view my DataSet it looks like a report How do I get the compact view.
Also after I have published a DataSet what is the best way to change the DataSet? I assume I have to use PowerBI Desktop.
Thanks,
Michael
You guys are the best! I have a question on permissions. When publishing a report that uses a shared dataset out to a different workspace, how do I grant the user the proper access to the underlying dataset without allowing that user to actually be able to access that underlying dataset? In other words, I just want the user to be able to view the Report, but never be able to stumble onto the model.
Hi Taylor, have you tried using the Viewer role in the workspace for the user where the dataset lives? I haven't tried this myself, but it does seem like a viable option, at least to try. The next level up, Contributor, would only allow someone to modify a dataset s/he contributed, not anyone else's. Not quite as good but better than nothing.
Can you add a link to the specified documentation in the video comments above please?
Hey Adam, thanks for the video. Can i ask you something? How's the refresh data working in those several pbi files that i've create with the same dataset? Also, do i need to refresh each of my app? Thank you so much
The dataset will refresh like it normally does. either manual refresh, or scheduled refresh. Everything referencing it will have whatever is available in the dataset. An app doesn't need to be updated for just the dataset. It will pick up the latest data.
That is very cool!!! Thank you so much!!!
Hi!! i have a question, only the person who create the dataset can modified it? like adding measures or managing relation between tables. Will not be cool if anyone can change the dataset, it will become a mess, please let me know, thanks!
Do you remember that I tweeted this icon that appeared randomly in on of my workspaces long before it was announced? The one of the new shared datasets...
I do recall seeing that 😉
Hi Adam, another question about this. You mention in the video that if we want to publish a shared dataset to another workspace, both the old and the new workspaces need to be the updated version on the workspace. How do I know whether my workspaces are the new version, or the classic versions? Is there a flag somewhere? Thanks!
HI Geoff, I am sure you already found this answer, but for others, I thought I would answer. If you click on the vertical ellipses next to a workspace, you will see one of two things. For NEW workspaces, you will ONLY see Settings and Access. If you click on a OLD (CLASSIC) workspace, you will see , Files, Members, Conversations, Calendar--in other words all the things that get created when an Office 365 group is created.
Cool feature! Do you happen to know what gonna happen when dataset owner changes it in some way? Is this going to break all dependent reports?
It could cause issues with the down stream reports. It is something to be careful about. That is also why the Power BI team highlighted some data lineage features coming to help understand what is using it.
Thanks as always Adam. My small frustration with this feature is that if I connect to a PBI Dataset in the Desktop, I often want to extend its capabilities because it doesn't quite do everything that I need - maybe I need to add an extra relationship with a new queried table. But I don't think that this is currently possible; If I choose to connect to an existing Power BI Dataset, I cannot add any other data connections. I wonder why not... is this because it would be a security issue? If we could use a shared dataset AND be able to extend it, man, that would be brilliant...!
Yeah, connecting to a Power BI Dataset puts you in a live connection state. So, you can't do mashup. Live connection doesn't support composite models yet. which is a big ask. It is a hard problem to tackle though. It is being worked on. No idea on timeline.
Hello All-Wise Guy-in-a-Cube! I have a question maybe you can advise on. I have an Office 365 organization. Is it possible to programmatically deploy pre-formatted Power BI reports for different departments without having me create them all manually? In my case I want to pull data from our financial system that shows updated budgets for each department (what they spent, how much left, etc.) and drop them into “budget” dashboards that only that department manager can see. I know I can get the data but not sure if I could dump it into a Power BI “API” in Office 365? And even if I could I’m not sure where the reports would show up? I would like each manager to go into Office 365, open Power BI and automatically see that report/dashboard. Any suggestions on if and how to do this?
Bonjour, thank you for all these videos. I have a question concerning datasets. Is it possible to combine 2 data sets that has been shared with me ? Let me explain ... in my company Business A is connected to several files and months after months they build their data model and produced nice Power BI dashboards. Same for Business B ... I now have access to Datasets A & B, Reports A& B ... I do not want to create new visuals from reports A & B ... I wish to build report connecting to datasets A & B ... I wish to be able to connect the 2 datasets via a combine model defining the connexion ... is it possible ?
You should really make a video on how this fits with and differentiates from Data Flows. Will I for example be able to promote Data Flows or entities? And will there be a unified search function for both shared datasets and Data Flows? These two features seem amongst perfectly overlapping right now
Thanks for the feedback Morten! I'll look at doing a video on it. I do believe the concept of shared dataflows are also coming.
When you mentioned a unified search for both shared datasets and dataflows, what do you mean? search where? They are used differently, so it wouldn't be in Power BI Desktop. We already have a global search on the home page of Power BI. Would love to hear your thoughts on that.
@@GuyInACube thanks for the reply. I mean unified search from Power BI Desktop as that's where most developers start. It might not make sense from a technical standpoint, but it does from a user standpoint as Power BI datasets and Data Flows both originate for the same source (the Power BI Service).
Hi Adam, I’ve created a premium workspace and added a security group with all my users with the viewer role (most of the users don’t have a pro license). I’ve published my dataset with the shared and build option. My expecting was that the users within this SG would be able to see the dataset when they are using the PBI desktop version but this is not the case. Did I do something wrong?
I think near end of video he specifically states that to use a Shared Dataset to create a report, the user will need to have a pro license. Couple of years late...sorry about that.
Hey Adam, I have a promoted dataset someone shared with me however when I try to create a report and publish it in my workspace it only shows the option of the Workspace where the dataset is present. I thought we are able to publish a report to any other workspace using a shared dataset.
BTW, Awesome work on these videos man.
Really dumb question on my part but I assume you caught the part where he said that the Workspace where you are publishing the report TO has to be the NEW experience workspace? Also, you say "my workspace" above--I am assuming you don't mean MY WORKSPACE? Again, dumb questions on my part, but sometimes it is easy to miss a nugget in these jam-packed videos.
Hi Guys,
Could you please show us some demo Ssrs vs Power Bi Invoicing dashboards. Searching for Ideas.
Patrick may have some ideas on that. He actual recreated an invoice within Power BI to illustrate that it doesn't work well, and you probably don't want to use a Power BI report for that.
@@GuyInACube Thanks for that. Would stick to SSRS, but still looking for Ideas in SSRS. Patrick please help.
Hi Adam,
Is there a way to convert classic workspace to new workspace experience?
your global admin should be able to help you here.
Great video. This feature gives a lot more flexibility in AppDesign. But what about shared reports?
What about shared reports? What scenario are you looking for?
@@GuyInACube I want to use the same report in multiple workspaces. So that when I change my report, it's changed in all the workspaces (like the shared datasets). I'm thinking about a library (or pool) of datasets and reports where each workspace (aka app) can consume from.
That capability isn't available. You could potentially have a source report and then use the Clone report APIs to copy it to other workspaces. You would need to trigger that though. won't happen automatically.
In Power BI Desktop, when you create a Live Connection report from a dataset in Workspace A, are you supposed to then be able to publish the report to Workspace B? I tried to but I only see the source workspace as a publishing destination (I do have admin access to other app workspaces) so I'm confused about how to complete the cross-workspace publishing process.
I believe this only works if the data source is in the new style workspace.
@@Xrusader You are correct, thanks so much! I republished the source dataset to a new experience workspace, changed the Live Connection report to that location, and was then able to publish said report across workspaces.
Yes. The source dataset, and the destination report, both need to be in the new workspace experience.
Got it, I posted how to address this when coming from an O365 workspace, for consideration for your next wrap-up: www.oliviertravers.com/powerbi-live-connection-datasets-reports-across-workspaces/
Hi Adam,at about 5:45 in this video, you caution that there are "limits on the number of workspaces that can be created". Do you have any link that calls out how many workspaces will "break" the Power BI Service?Because we have no way to secure individual reports within an app - we're going to end up with one app per report...which will be thousands of apps (and therefore thousands of workspaces). Now I'm really paranoid....Thanks,Scott
HI Scott, on February 21, 2019, Adam did a video that talked all about workspaces, and he did go over the limits there. The first limit is that workspaces NOT backed by premium are limited to 10 gig of content. Second, a workspace can only have 1000 reports on a single dataset OR 1000 datasets. Finally, a person can only be a member of UP TO 250 workspaces. Not sure if any of this has changed since last February. My thinking is, based on the limits, that you may want to think about a workspace repository that has JUST datasets. You could have up to a 1000 datasets in that one workspace. Then the reports can be dispersed across a wider variety of workspaces, all of which have to be new experience workspace. (And the repository has to be a new experience workspace as well.)
I've created a measure that works when I apply it as "Field value" conditional formatting. But when I publish the dataset / data model and then connect to this powerbi dataset I am not able to use the measure for conditional formatting in other reports? Here is the measure that works great as long as I am using it in the report that is directly tied to the imported data model. It's only when I connect to the powerbi dataset to build other reports when I can't use the measure. Can you help?
Bridge Dynamic Percent Conditional Formatting = SWITCH([SelectedCategory],
1, SWITCH(
TRUE()
,[Lost Bridge Sales CY Percent] < -.12, "#ff0202" //red
,[Lost Bridge Sales CY Percent] < -.1, "#ff3D3D" //less red
,[Lost Bridge Sales CY Percent] < -.08, "#ff6464" //less red
,[Lost Bridge Sales CY Percent] < -.06, "#ff9f9f" //less red
,[Lost Bridge Sales CY Percent] < -.04, "#ffd9d9" //less red
,[Lost Bridge Sales CY Percent] < -.03, "#bdfab1" // green
,[Lost Bridge Sales CY Percent] < -.02, "#9EF88C" // more green
,[Lost Bridge Sales CY Percent] < -.01, "#7EF667" // more green
,"#40F21D" //most green
),
2, SWITCH(
TRUE()
,[Same Store Bridge Sales CY Percent] < -.12, "#ff0202" //red
,[Same Store Bridge Sales CY Percent] < -.08, "#ff3D3D" //less red
,[Same Store Bridge Sales CY Percent] < -.04, "#ff6464" //less red
,[Same Store Bridge Sales CY Percent] < -.02, "#ff9f9f" //less red
,[Same Store Bridge Sales CY Percent] < 0, "#ffd9d9" //less red
,[Same Store Bridge Sales CY Percent] < .02, "#bdfab1" // green
,[Same Store Bridge Sales CY Percent] < .04, "#9EF88C" // more green
,[Same Store Bridge Sales CY Percent] < .06, "#7EF667" // more green
,"#40F21D" //most green
),
3, SWITCH(
TRUE()
,[New Current Year Bridge Sales CY Percent] < 0, "#ff0202" //red
,[New Current Year Bridge Sales CY Percent] < .01, "#ff3D3D" //less red
,[New Current Year Bridge Sales CY Percent] < .02, "#ff6464" //less red
,[New Current Year Bridge Sales CY Percent] < .03, "#ff9f9f" //less red
,[New Current Year Bridge Sales CY Percent] < .04, "#ffd9d9" //less red
,[New Current Year Bridge Sales CY Percent] < .05, "#bdfab1" // green
,[New Current Year Bridge Sales CY Percent] < .06, "#9EF88C" // more green
,[New Current Year Bridge Sales CY Percent] < .07, "#7EF667" // more green
,"#40F21D" //most green
))
I am still confused the difference between when to use a dataset vs. dataflow
Once you build a dataset, the model is fixed. Although report writers can connect to and use it, no modifications can be made to the model nor can you accomplish blending with other models. Data Flows, on the other hand, can be consumed by power query and used to construct modified models. Data flows provide a centralized data store which your report builders can pick and choose what information they need to include in their report.
A dataset is the semantic model - the Analysis Services Tabular model. I think of the dataflow as a data source to use within my dataset. To build a report, i have to have the dataset.
I like the feature, but what I do not like that this feature was enabled by default.
Adam,
First, I tried to find a way to message you directly and not bog down the comments section. If there is a way to post a question to you on the side let me know...
So I've built out a "central" workspace that holds datasets which are "built" upon dataflows. This central workspace will hold some general reports but the key asset is the DataSets which teams can utilize and create reports and publish to their own Workspace. am working on creating "Team workspaces" which will utilize the shared central datasets. Here is the challenge I have run into. I'm tThinking it is a training issue but it's not easy to figure out. I've read all the docs pages on the permissions and such. I've watched your videos, but I am still dazed and confused about exactly how to set just the right level of permissions.. Let me layout what I want to accomplish. (* I've got a "logical" diagram which I can share **)
We want a central workspace that will hold the "official" datasets. This central workspace will extract the data from our sources of data, run some ETL, create some measures, calculated columns and do some other magical stuff. Only the a select few "admins" will have the ability to create and or edit the Central Datasets.
We have many teams which are globally dispersed that will need to have their own workspace for their own flavor of reports. Teams will have a "power user" or two who will create dashboards and reports. We do NOT want them to have edit access to the Central Datasets. The majority of the team users will be simple consumers of the reports within their Team workspace.
Sounds "simple". but the challenge I ran into is setting the permissions. The Team admins ( power users) needs permissions that I've got working but I could not tell you why. :-) Seems that the team based Consumers need to have View access in the central workspace? Being a member in their own team workspace does not give them permissions to view a report which is published to their team workspace from a shared dataset in the Central Workspace. why does a consumer of a report found in thier own workspace need to have permissions back in the Central Workspace?
Sorry for the long comment, looking for some clarity... while trial and error or trial by fire is a great learning experience, it is also painful when your users are in the middle of the fire..
Hi Ray, I am assuming (hoping) that you have figured out an answer to this by now, but I am going to take a stab at this in case others have this question and haven't resolved it. From what Adam said in the video, in order to consume a report that has been created using a shared dataset (meaning the data lives in a separate workspace), the user has to have rights in BOTH workspaces (and they need to be NEW workspace experiences). That's first.
THEN, on the Teams side (speaking about the TEAMS application here), any member of the TEAM who wants to be able to view the report that has been placed in the FILES area (a pre-requisite for promoting to a tab in TEAMS), has to be a member of the originating workspace of the report, and by the logic outlined in my first point, I am assuming this TEAM member has to be a member of the workspace where the dataset originates.
Now, here's a wrinkle. If your TEAM automatically created the WORKSPACE being used in Power BI, it is by definition an OLD workspace, based on an Office 365 group, and you can't use an OLD workspace to publish reports based on shared datasets. So that's the first wrinkle to iron out.
THe second wrinkle is that if you are sure that the workspace where you have published the report to is a NEW workspace experience, then you will need to add the Office 365 group the TEAM is based on as a member to that workspace.
And you would need to do the same thing in the workspace where the dataset lives.
As to what levels of membership (NEW workspaces have four member levels now), that I am not sure of. Ideally, you would have the Office 365 Group be a VIEWER only in the dataset workspace, and probably a MEMBER of the report workspace. The trick here is that if you add the TEAM as an Office 365 group everyone in the TEAM has the same level of permissions in the workspaces. (A group can only have one member level designated.)
Just some thoughts to consider--although in your case I am sure you have already figured this out. Would love to hear how you did it.
Hi Adam. Could you do a video on the Build permission? docs.microsoft.com/en-us/power-bi/service-datasets-build-permissions
with data set, you can just connect to one dataset.. you can't add another..
Today that is true. Composite models aren't supported with live connections. It is coming though - docs.microsoft.com/en-us/power-platform-release-plan/2020wave1/business-intelligence/composite-models-over-power-bi-azure-analysis-services-datasets
So can shared datasets replace the need for tabular models?
That's the idea. Really, Shared Datasets are a tabular model. With Power BI Premium, you can use the XMLA endpoint to even connect to them like an Analysis Services tabular model.
I guess the question is why da french toast Microsoft thinks one App per workspace is the right direction...