Process CSV files easily with Power Automate and Dataflows
Vložit
- čas přidán 31. 07. 2024
- Paul Murana, Microsoft Business Applications MVP, walks you through how to process CSV files easily using Power Automate and Dataflows.
Connect with Paul: Power Automate Community
powerusers.microsoft.com/t5/u...
Twitter: / paulie_m
Join the Power Automate Community:
community.powerautomate.com/ - Věda a technologie
This guy is something else. Every video of his I watch saves me days of work. Absolute genius.
Wish I found this video 5 months ago! I got as far as creating my CSV files in Sharepoint, but the next steps of converting those files to a Sharepoint List or something else like this is exactly what I need to complete my end to end automation workflow, saving us a total of 18 hours every quarter. Will test the steps out tomorrow and give it a go, thank you!
Excellent video, using power query in power automate is going to unlock loads of opportunities that were just too complicated before
I've studied Power Platform related info for two years but don't know Dataflows yet. I usually use Power Query in Excel to transform data. This is really useful. Thank you.
It's the same language.
Thank you Paul for this detailed walk through of the whole process for the use of dataflows. I keep coming back to this video as a reference. Appreciate the great work here and also on your own channel.
One question - how does one use environment variables for a dataflow trigger (when refreshed) as the actual id of the dataflow will change and it can't be determined before the trigger step.
I look forward to the day when Power Query is integrated directly into Power Automate. We could then process data within the flow, and output directly to the flow, without the need to use Dataverse as a staging area.
Also keep in my that, contrary to Flows, dataflows cannot run concurrently; that is a problem if you need to process many CSV files, through triggers that happen around the same time.
Finally, ALM for dataflows needs to be improved. The dataflow connector for Power Automate does not have the handy "current environment" reference that the Dataverse connector does. Also, dataflow connections are different from Power Automate connections and cannot be handled through the solution.
Dataflows are getting better and better... but there is still much to do to allow them to reach their full potential.
Thanks for the great video
Very good Paul! Thank you. Please make a video on how to use Power automate to refresh an excel power query?
Is there a way to read a csv file from share point online using power automate?
Thanks so much Paul. Any ideas why my table is not updating records deleted from the source file (CSV)? Already checked the "Delete rows that no longer exist in the query output" is checked when exporting data to the table and the primary key is created. Thx!!
My powerapp is different to this. Has it been updated since? I can't access the data source from dataflows. The only options are to create cloud flows or desktop flows and it's all very different?
Thank you for sharing. It's indeed a nice technique. But as you know, there is a limitation of Dataflow (5000 rows) and if I'm getting 50,000 rows in CSV, How to handle the import? What will you advice in that case? BR
Is it possible to have a dataflow with a dynamic input filename ? so we could call it from power automate by passing the ID of what we want to convert ?
It would be easier if PowerAutomate could transform CSV files into XLSX or something else with a function. It's something a lot of people are trying to automate with multiple step around.
Has the interface changed? When I go to power apps, the menu on the left has a link to "Flows" and I can't open up PowerQuery. I'm talking about at 4:13 in the video. I can create a Dataflow template, but I can't open Power Query.
On the left I see Tables, Flows, Solutions and More. Clicking on more showed the Dataflows option
Paul thank you. Our govt agency is using Enterprise Power Apps including Dataverse. We have a few Master tables which must be periodically updated with a fresh cvs file. Can Power Automate bring in an updated csv file into an existing Dataverse table?
Great video, I didn't know that Power Query was available to be used with PA, just a shame that it appears that a Premium licence is required to get the data back out from Data verse.
Is there any way to get Power Query data flow working online with PA but not store it within Data Verse so that I can just use standard connectors?
You can get data out of Dataverse for free if you use Dataverse for Teams. It supports all of this video's transformations.
@@nigelsmith2165 Thanks, but I don't understand how you would get the data back out of Dataverse for Teams - Would you not still require the Power Apps/Automate premium licence?
great tutorial but, how do i save a .csv as a .xlsx? if anyone can do that simply in Power Automate please let me know...
Hi. Thanks for sharing this content with us. What function do you use to transform the attachment into a csv file? I need to save a csv file from a e-mail into a SharePoint folder and I am failling.
Which function were you referring to?
@@cPathz I used the base64ToString.
I wish I had the "dataflows" option.... 😢
It's ALM supported for this? Can i just add my dataflow to a solution and import it as managed to another environment and expect the power automate in that same solution to still work?
I don’t think so. I haven’t seen dataflow as an existing object you can list and impor into your solution. I had to recreate it in each environment.
@@tristangeoffroy9286 the fact that Microsoft promotes solutions that can't be properly integrated into an ALM pipeline is awful.
My users are actually following these guides. Then they get mad at me when I say "i can't push this to production", it's gonna be like hell to manage
@@theownmages agree any improvement from Microsoft would be highly appreciated and will certainly comes soon
This looks cool, however whenever I try to publish I just get "publishing has failed something went wrong" :(
Also, part of your flow is that a file is created in onedrive after being emailed to you. Won't that create another file called "sessions.csv" which would be renamed to sessions_1.csv or something? Wouldn't dataflow ignore that file?
@@joshcone6971 Create File can choose to overwrite any existing file and keep using the same file name.
It might have failed because you don't have a dataverse license, that's why this failed for me.
@@vicarion I dont have one :(
Thanks so much for wasting all of our time. Why is it so easy to open a file and save it as an xlsx but Power Automate wants to put out these boring videos?