Deployment Pipelines give you more CONTROL (Power BI Premium)
Vložit
- čas přidán 3. 06. 2020
- With Deployment Pipelines, you can control your application life cycle stages. Keep content in sync at the different stages of your development. Power BI Premium is required.
Documentation:
docs.microsoft.com/power-bi/c...
docs.microsoft.com/power-bi/c...
docs.microsoft.com/power-bi/c...
📢 Become a member: guyinacu.be/membership
*******************
Want to take your Power BI skills to the next level? We have training courses available to help you with your journey.
🎓 Guy in a Cube courses: guyinacu.be/courses
*******************
LET'S CONNECT!
*******************
-- / guyinacube
-- / awsaxton
-- / patrickdba
-- / guyinacube
-- / guyinacube
-- guyinacube.com
**Gear**
🛠 Check out my Tools page - guyinacube.com/tools/
#PowerBI #DeploymentPipelines #GuyInACube - Věda a technologie
Pipelines look really slick! This reduces the headache of manually creating dev and prod workspaces and trying to keep track of everything manually! Great work PBI team!
This video is a textbook example of the proper way to make a Power BI video! Bravo!
What a wonderfully well constructed video! Become your instant fan 😊👍 MS is a bit late as Life Cycle Management should have been there from the beginning but a welcome addition.
Amazing feature! We’ve been waiting for this for a while..
Amazing, thanks for the quick over! Please keep us posted on the updates :)
Tx for detailed info Adam. The first video on this new feature.
Thanks for the update. Love your work!
Very thorough! One of my favorite workspace management features in a long long time. I need to adjust what I cover when I do a video on this now, haha.
Great vid! Thanks! Do the additional workspaces needed for the pipeline cost extra or are they included in the price of the existing workspace?
I like it! If you assign production workspace first there is no way to work backwards.
Really cool Adam. I am working with a Powerbi consultant as contracter while I do most of the work myself. Leave the hard stuff for him ;-) We always have to be aware of who is developing where. In particular since there a acces limitation for the consultant on our network. I think this will kill all those issues and help us controle our dev - test -deploy proces. Great video.
This was awesome, thank you so much
Love your videos guys! Keep em rolling.......... :-)
Very nice and great info Adam thanks a lot
Great video. Thanks.
Adam, how would you do version management?
Good video, Adam. Thanks!
Appreciate that James! 👊
For dataset refreshes, when we publish from Test --> Production, if we have refreshed the dataset in Test does it publish the refreshed dataset? This would be big as we could re-publish on dev/test, wait for refresh completion, then push it into production, rather than doing a full refresh each time and have users have out-of-date info if Desktop .pbix is out-of-sync.
Thanks You GUYS In CUBE .. It is indeed a great and Informative Video.. I am still curious to know about the data flows and excel files
This is awesome !! Cool.. Impressive..
Lightning bold :) 4:58 I can feel that sense of humor:) good job !
Is there any possibility to deploy selective contents from a single workspace in TEST stage to multiple workspaces in target stage?
Does it work with Streaming Datasets, like the type you would use to update real-time dashboards? These are APIs at my organization.
Is RLS get applied between the workspace?
I will ultimately have a Paginated Report in my Production App. Any thoughts on where I publish that from/to? Should I publish that straight off to the Production Workspace/App?
Question on the limitations around excel files: if I have a composite model scenario (using an excel file as an extra data source), will the PBIX report I create utilizing a composite model not properly flow from dev to production?
Great Video and I like the pipelines feature a lot. But what about removing dashboards, reports and datasets. Is this still a manual process by removing the items in test and prod manually as well?
I just finished watching one of the dev camp videos and always play those @.75 speed... I jumped into this one at slow speed, and you sound pretty funny in slo-mo! 😂
Impressive feature !!
Does the Schedule and RLS will be intact ? Also this means, the "Update App" in the workspace will go off shortly ?
Do we have any approval mechanism through email ? for the same . Or a way to notify the managers to review and approve the report ?
This looks great.
If I restrict membership of the Prod workspace member role, I can limit who can promote something into Production, but they can still push stuff around Dev and Test if they're members of those workspaces member roles? Sounds too simple :D
Can we use existing Dev and UAT workspaces for deployment pipelines?
WOW, love it!
Awesome! 👊
Do I need 3 workspaces with premium?
I appreciate the video and the high production quality of it. My only feedback is that I would have loved to see the full diffing functionality. Or is there nothing more to it?
I have a development background and I need help to understand this.
Why did MSFT create such a feature? This is completely normal CI/CD pipeline stuff. They already have 2 such products. There was no need for this. It is such a basic thing and of course they managed to do it differently from all the rest of the SDLC.
Again, high quality production, and I can see why there would be enthusiasm for such a basic and needed feature.
This looks great!! was wondering if it is possible to change embedded canvas app url based on environment?
Hi Adam,
What if I don't wanna create new by-product workspaces, instead I would like to use my existing dev, test and Prod workspaces?
Does it support monitoring versions history, so i would be able to restore any old version?
👍 very helpful
This is cool feature. How does this work with Power ON visual planner?
Lovely. Just missing one piece: source control for the pbix file in DEV. I've seen methods using OneDrive and SharePoint -- what do you recommend? I need a process that will allow me to add comments on each version change.
SharePoint is what I do, howevr 3 year later (since I am a bit late to answer lol) you can check the nw Power BI project Feature, can save the repor as a Pbip file, this will divide your report to 2 folders one of them has a Json like format file you can keep for version change
Great vid, as always! :) what SWs do you (and of course Patrick) use to record videos? I guess you have some video editing, screenrecorder, etc... Thanks
Check out guyinacube.com/tools/ and guyinacu.be/streamsetup. Been using the streaming setup more lately to record. Makes it pretty easy. Using Adobe products for editing and post-production.
Awesome!! Full SDLC..
QQ -- Will it work for the report which is using data flow from other workspace?
Yes reports and datasets are covered by this. Regardless of the data sources. Dataflows themselves are not covered by this directly.
Is there any way to have a many to one relationship on those pipelines? Eg have one test workspace but multiple production workspaces. In my example I have EU and US workspaces which contain exact copies of the same pbix files, just with different connection strings.
Do both workspaces need to be Premium Workspaces?
Awesome t-shirt, looks sick!!!
Is it possible to upgrade an existing workspaces backed up by the premium capacity to utilise the pipeline features?
Yes, but what I really want to know is can you use existing for all 3?
Thank you for this. I am struggling with how to integrate my dataflows into the process of development and testing. I don't have access to any databases, just dataflows. What do you recommend? Does this warrant a video?
How will it work for Paginated reports ?
When you deploy from Dev to Test, let's say, are the datasets deployed in Test automatically refreshed whenever a new deployment happens?
Can we rename the Test and Prod Premium workspaces ? .. as it creates default ones
Just Wanted to know if any feature exist like if we have more than 100 report to publish from test to prod then can we select all 100 report together in one go or we must do individual select and deploy
Both, you can select each
whoa! MSFT invested in a new cool lego logo and microphone :)
Great overview. But leave the bananas for Patrick 😅
Someone knows how to automatically change a live report data source when you deploy? in my case it keeps the previous workspace configuration
If I have a 17 GB dataset, would it copy the entire dataset to production, or just the metadata of it?
What can be developed, tested..etc ?
Is there a way to deploy only certain items? Right now it seems like gets moved. For example, my Dev workspace has a lot of OTHER things that I may not want to see in a Test or Prod environment. Can I move only the reports and datasets I want to see in Test and Prod?
Is it possible to create more than 2 test environments in deployment pipe lines
Yes, I used Pipelines, We are exploring pushing reports with a different type of data sources.
Do you know if they are planning to add support for Dataset rules for datasets residing outside of the workspace you have assigned? We have a single workspace for our Datasets that all of our report workspaces are pulling from, and it does not allow me to set dataset rules.
Hi everyone. Thanks for the awesome content Adam, but even if I updated the configuration rules and added data source rules to provide access to QA or Production databases (SQL Server databases on-premise), reports in QA or Production workspaces still access the development database. Namely, data source rules I added do not take affect. Does anyone have a tip for this problem? Regards.
Adam, is it not possible to change the connection information if you are using a Power BI dataset in a different workspace? After deploying 4 reports to test that all have separate datasets in a different workspace, the "lightning bolt" dialog box will be empty?
What if we have already existing Dev, Test and PROD workspace - now we need to setup the Deployment pipeline on those existing workspace - how we can do that. Thanks in Advance
Aint using Deployement pipelines going to take extra space as the same dataset is transfered to each workspace ?
This is great. We were looking into how to do this programmatically and this is much better. Does this work with incremental refresh?
It does not support incremental refresh datasets, which makes me very sad. :-(
@@micahdail I had a feeling. Incremental is amazing but still not enterprise ready. We have problems with it constantly.
Yet :) baby steps. It is a nice feature for sure. I know the team is working on a lot of enhancements.
@@GuyInACube Great to hear!
Is postgre sql don’t support deployment pipeline in power bi?
What happen when I need to add other Origen Data with other conexión and upload and replace the power BI project to workspace? And How can I return back the other version?
What screen recording software do you use?
Nice video. What if we have more than 3 environments- dev, qa, uat and prod?
Then you need to new-look at your process as seems overly complicated. If it is that technical you should have the skills to manage via 3rd party or self built tools either way something not right
Suppose our team implements a deployment pipeline, but later down the line we change our mind and want to revert back to managing separate workspaces. Is it possible to take the workspaces &/or reports out of the pipelines?
somehow the deployment settings of the newly created prod workspace show that I have no datasets? despite having deployed them already?
More than 3 environments, can I deploy reports using single pipeline ??
Hi "Guys in a Cube". Thank you for this amazing channel. I have a question about the pipeline. I have two series of changes. Both these series are in the test now. But one of them has been tested and ready to deploy to Prod. How can I use pipeline to deploy just one of the changes to Prod and keep the other one in the test?
Hej!
You forgot to mention that you NEED to have permission to create workspace to be able to use the pipelines. Even after a pipeline are created and have all three WS created you can’t deploy without this permissions.
Feels like a mistake by MS and we hope it will be changed soon!
All good
Great! Can we deploy Test to multiple Prod workspaces. For my case, we need to maintain one dev report, but multiple Production env (one for each client). The only difference is the underlying database name.
could you confirm, so i build a dashboard and then this deployment pipelines is just changing the data being fed to the dashboard?
What about using different data source credentials between workspaces, as in the scenario where a developer does not have access to full production data; can this be handled by pipeline rules / parameters or something else?
this is all in PBI service so credentials should be passed via stored credentials configured in the gateway, not individual files. I would imagine this should work if properly configured
1) Do Apps deploy from Dev to Test to Prod? 2) What can my Pro users do with a PPU workspace?
Man , that's beautiful, we can focus on PBI only !!!
Does it work for Paginated Reports?
No it does not.
it will be good if we just select a report from the workspace to work on instead of copying everything to start with. I have over 20 reports that are in production. i would like to use the pipeline for a new report to be done
I'm getting this error. What could be the issue ?
"The workspace can be assigned, however, when the workspace is deployed to another stage, items won't be deployed to the next stage.
The workspace contains the following items:
Unsupported report ,Unsupported dataset"
Hi Adam - please update this video or its description to mention that these features displayed by you are no longer available / have been updated by the Microsoft team.
Hi Adam, awesome job and videos, I'm a fan!
I'm trying to do the same thing with paginated reports using PowerBI Report builder. The problem is that there is no dataset when dealing with paginated reports! I can't change the sources! So, is there a way to use pipelines in a paginated report usecase?
set up the data source in the query as a parameter. then set a rule in each workspace which parameter to use
I have a dataset with dynamics CRM and Synapse together. Synapse instances are different for all 3 environments. Is there a way I can push the SQL authentication creds through the pipeline. Currently I sync in the dataset to higher environment and then publish it. Is there a way to automate it
how can deploy pipeline into already created work spaces? example : i have 3 premium work spaces already created Sales Dev sales QA Sales Prod
Need one help... I have deployed the report using the deployment pipeline.. Have two stages test and production..
I have some changes to be done in power bi pbix.. I have done it and republished it in test ws.. And then deployed to prod.. But post deployment it is showing that dataset don't match
Excellent video, but a question -- what happens if you need to revert? That is, you need to take the version in Prod and move it back to Dev for an emergency patch? When we attempt to do that we get the Prod setting for the Direct Query dataset, and we want it to point to the Dev database since we're in Dev. We tried copying back, but the dataset kept the Prod settings. With a different source data table it crashed the report and we were unable to fix the version for a re-release.
How do you take a Prod version and bring it back (granted, only needed in a pinch) to Dev and get the Dev settings back onto its Dataset?
I'm sad that deployment pipelines are a premium feature. Most of my employer's customers are too small to consider Power BI Premium as an option as it is too expensive for them.
Coincidentally, I set up a whole deployment pipeline in azure devops just 3 weeks ago. For small teams devops is completely free and no premium capacity is necessary. You may use that instead 🙂
tareksalha thanks for this! I’ll look into Devops to create a pipeline.
@@tareksalha Any good videos to showcase this?
@@tareksalha can you show us how you did it? Thank you in advance
@@mruniversemrwhite333 hi guys, sorry, missed the other question. this is a good start: community.powerbi.com/t5/Community-Blog/PowerBI-CICD-using-Azure-DevOps/ba-p/769244
Is it possible to use deployment rules for altering which Power BI dataset a report connects to as it moves through the stages? I thought those connections were supposed to move automatically but they don't. I had a report connected to the shared dataset in the dev workspace, deployed to production, then when I looked at lineage view the production report was trying to connect to the dataset in the dev workspace and it was causing all sorts of permissions issues.
This looks great. But I have a question, I want to deploy a PBIT that when pipelined to a workspace, I want it to automatically link up to a specific database/datasource, save it as a PBIX file and when opened by a user, it opens as that PBIX file with all custom settings working as expected.
Any ideas? Any sites I can look at to make this happen?
Ability to deploy the objects from dev/ test to already available premium production workspace would be useful? Instead of creating new workspace?? Just my use case for my one of the projects we went LIVE recently. Big fan of your work 🧡
I've heard that from a few folks - as well as folks asking for clarification on that point. But, that's how it is currently designed.
@@GuyInACube Thanks for your reply Adam 🙏😊
Thank you so much for sharing this important information about pipeline, do the parameter rules also apply if I'm using fields parameters? It just that I have a report with fields parameters but in the prod stage it is not working the pipeline, why do you think that is happening?
I'd really appreciate if you could help me with this issue I'm having :)
What if test and prod workspace pre exist ?
??
Really cool! Unfortunately useless if you don't want all users to have PPU accounts. I feel like Pro users should be able to access the workspaces. It would be beneficial at that point.
110% agree
Hello I'm using Azure Analisys Services as the datasource of my dashboards (Live Connection) and I have these databases (TabularDev, TabularQA and TabularProd) when I add the rules to change the database for the specific environments in the pipeline it doesn't work, Can someone please tell me what am i doing wrong?
thanks for video. Now i have already Production and Acceptance classic work spaces , if i would like to create pipeline what would be the way? My Assumption is
1.Upgrade Production classic work space to new work space.
2 Use Assign new production work space and create pipeline with Test and Production stages.
3.Now manually deploy Acceptance reports to Test stage
Is this is how i should follow? could you please help me
thanks in advance
Cute sprawl 🤣👍