UI Automation in Power Automate for Desktop (Full Tutorial)

Sdílet
Vložit
  • čas přidán 31. 07. 2024
  • This video tutorial shows how to do UI Automation in Power Automate for Desktop. Using drag-n-drop and no code, it's easy to click buttons, fill in text, and extract data from the applications. The advanced part of the tutorial demonstrates how to create dynamic selectors.
    COURSE MATERIALS:
    📂 andersjensen.org/microsoft-po...
    VIDEOS FOR YOU:
    🔹 Power Automate for Desktop Tutorial: • Power Automate Desktop...
    🔹 Power Automate Cloud Beginners Guide: • Microsoft Power Automa...
    👨‍👩‍👧‍👦 Discord: / discord
    - Join my network with 2800+ RPA Developers, where we solve RPA problems, network, and help each other upgrade our careers. It's free!
    FOLLOW ME:
    💼 LinkedIn: / andersjensenorg
    📸 Instagram: / andersjensenorg
    👨 Facebook: / andersjensenorg
    🐦 Twitter: / andersjensenorg
    💌 Email Newsletter: andersjensen.org/email-newsle...
    MY MONITOR (Amazon affiliate):
    🖥️ Samsung 49-inch CRG9 Curved Monitor = geni.us/MDpejc
    - If you are buying this, I can recommend the Mi Monitor Light Bar = geni.us/3Wwad
    0:00 Intro
    1:37 Open Application in Power Automate for Desktop
    The Run application action needs to be used to open an application in Power Automate for desktop. First, fill in the Application path.
    2:17 Close Application
    Use the Terminate process action to close all instances of an application.
    5:25 Click UI element in window
    To click a button in an application the Click UI element in window action is used. Find the button in your application and press Ctrl + the left mouse button. It's best practice to rename the UI elements to make the process easier to maintain and update.
    6:26 Create a Dynamic Selector
    Dynamic selectors are very powerful, as they allow us to move away from a static solution. We use a variable in the selector.
    10:58 Extract data from window
    The Extract data from a window is used to extract data from a window. Create a UI element, and the result will be stored in a variable.
    12:48 Get subtext
    Use the Get subtext action to manipulate text and get a part of the text. Remember that the character position is zero-indexed.
    #office365 #powerautomate #microsoft
  • Věda a technologie

Komentáře • 67

  • @andersjensenorg
    @andersjensenorg  Před 2 lety +6

    Is this video helping you? 😊 You can help me a lot, by then giving it a thumbs up 👍 Thank you. Kind regards, Anders

  • @engineerjunaid5029
    @engineerjunaid5029 Před 8 měsíci +1

    Brilliant teacher Brilliant method Thanks for such amazing tutorials

  • @ASO-xh5vu
    @ASO-xh5vu Před 2 lety +2

    New subscriber. You are the only person who takes educating people in this software seriously. The is absolutely no serious content about this that is consistent. Please make more content about Power Automate. Thank you so much Anders!

    • @andersjensenorg
      @andersjensenorg  Před 2 lety +1

      Hey ASO, wauw what a nice comment - thanks a lot 😊 I will definitely creat a lot of Power Automate for desktop content within the next weeks. Have a great day. Kind regards, Anders

    • @ASO-xh5vu
      @ASO-xh5vu Před 2 lety

      @@andersjensenorg You are welcome Anders. Seriously the comment is sincere. Especially desktop. There is a huge gap. As a learner I found it hard to learn the software until I found your videos. It's impossible someone doesn't understand the tools that you are explaining. So there is also the educator skill there... You are the best. Cheers,

  • @brucekleine1775
    @brucekleine1775 Před rokem +1

    Thank you Anders for your step by step tutorial. Very helpful!

    • @andersjensenorg
      @andersjensenorg  Před rokem

      You're very welcome, Bruce Kleine - your support helps me a lot 😍 You're more than welcome at my Discord, where we're 5000+ RPA developers networking and solving problems: czcams.com/video/xWFz-S96XGo/video.html

  • @dpwood44
    @dpwood44 Před rokem +1

    Quick and easy! Really enjoyed this one.

    • @andersjensenorg
      @andersjensenorg  Před rokem

      Hey dpwood44, I'm so happy to hear, thanks a lot 🙌🙂

  • @markjudeestrera
    @markjudeestrera Před rokem +1

    Thank you Anders new subscriber. Very concise and well explained.

    • @andersjensenorg
      @andersjensenorg  Před rokem

      Hey Mark. I'm so happy to hear - thanks a lot for the nice words. Kind regards, Anders

  • @craignorton8678
    @craignorton8678 Před 2 lety

    Another great video from Anders.👍

    • @andersjensenorg
      @andersjensenorg  Před rokem

      You're very welcome, Craig Norton - your support helps me a lot 😍 You're more than welcome at my Discord, where we're 5000+ RPA developers networking and solving problems: czcams.com/video/xWFz-S96XGo/video.html

  • @ALVINMAN452
    @ALVINMAN452 Před 9 měsíci +1

    Very good Quality. Great Video. Thank you.

  • @sazzarello
    @sazzarello Před 4 měsíci +1

    Excellent Video! I have spent alot of time developing my Excel Power Query skills with Leila Gharani, but I wanted to see what this Power Automate can do or me. I have followed along to a number of your CZcams videos and am very satisfied with your ability to teach these concepts. TY for sharing! You are the number one in this area on CZcams.

    • @andersjensenorg
      @andersjensenorg  Před 4 měsíci +1

      Thank you so much for the nice words. When you're done with these videos, I recommend learning the best practices from this video. It's a complete project, that teaches you everything, step-by-step 😊 Kind regards, Anders

  • @LapaConsult_Ex_Macraris
    @LapaConsult_Ex_Macraris Před 2 lety +1

    Thank You! this video help consolidating basis of UI

    • @andersjensenorg
      @andersjensenorg  Před 2 lety

      Thanks a lot, Macrais. All you nice viewers being active here in the comments helps my channel a lot 😊 Have a great day. Kind regards, Anders

  • @grzegorz2852
    @grzegorz2852 Před 2 lety +1

    another great video! Thanks man!

    • @andersjensenorg
      @andersjensenorg  Před 2 lety

      Thanks a ton, Grzegorz 🤩 Have a great day. Kind regards, Anders

  • @lakshmitalwar3401
    @lakshmitalwar3401 Před rokem +1

    Very useful. Explained very well.

    • @andersjensenorg
      @andersjensenorg  Před rokem

      Thanks a ton, lakshmi talwar 🤩 Have a great day. Kind regards, Anders

  • @PitakYT
    @PitakYT Před 2 lety +1

    Thank you so much. Great Video!

    • @andersjensenorg
      @andersjensenorg  Před 2 lety

      Thanks a lot, Pitak N 🤗 Your feedback helps me immensely. Kind regards, Anders

  • @thepragmatic6383
    @thepragmatic6383 Před 2 lety +2

    You are very professional as an educator, Very well explained.
    It's sad that the module (UI Automation) isn't free for home users.
    But I can use these same functions with an AutoHotkey script.
    It's just a little more complex, but much more powerful.
    Allows you to navigate and control the functions of third-party applications by switching from one to another.

  • @maurovmorais
    @maurovmorais Před 2 lety +1

    Thanks Anders!!!

    • @andersjensenorg
      @andersjensenorg  Před 2 lety

      Thanks a lot, Mauro 🤗 Your feedback helps me immensely. Kind regards, Anders

  • @ahmed462462
    @ahmed462462 Před rokem +1

    Very helpful 💪💪💪💪💪

  • @ayushmoudgil9345
    @ayushmoudgil9345 Před 2 lety +1

    This might potentially change my future as I am looking to switch careers, and by following you I hope i can make it happen!!!

    • @andersjensenorg
      @andersjensenorg  Před 2 lety

      Hey Ayush. Thanks a lot - there will be more videos this week 😊 I can recommend going through them step-by-step and doing all the actions with me instead of just passively watching. You can just rewind or pause the video. It's designed for that. You're welcome at my Discord; the link is in the video's description. Here we're more than 2700 RPA developers helping each other and networking (and it's entirely free). Have a great day. Kind regards, Anders

  • @alfredpereira9152
    @alfredpereira9152 Před rokem +1

    Nice teaching

  • @DonnieDish
    @DonnieDish Před 2 měsíci

    🎯 Key Takeaways for quick navigation:
    00:25 *🎯 Handling Static UI Elements*
    - Understanding UI elements with static attributes,
    - Importance of static attribute values in automation.
    01:01 *🔄 Transition to Dynamic UI Elements*
    - Introduction to dynamic UI elements,
    - Challenges posed by dynamically changing attribute values,
    - Need for handling dynamic UI elements effectively.
    02:04 *🛠️ Strategies for Dynamic UI Element Handling*
    - Recognizing dynamic web or UI elements,
    - Adapting CSS/UI selectors for dynamic attributes,
    - Customizing Controls Repository for dynamic element management.
    Made with HARPA AI

  • @sridevisatheeshkumar
    @sridevisatheeshkumar Před 11 měsíci +1

    in windows11,terminate process shows "CalculatorApp"

  • @SrdjanS_Automations
    @SrdjanS_Automations Před rokem

    Hi Andres,
    Is there an option to use "Simulate Click" in Power Automate? (I don't want to lose control of the mouse in the automation)

    • @andersjensenorg
      @andersjensenorg  Před rokem

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 4900+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): czcams.com/video/xWFz-S96XGo/video.html Kind regards, Anders

  • @anantchirmade600
    @anantchirmade600 Před rokem

    I am trying to add an UI element from an app but in that app the element chooser just shows Full Pane as element instead of small element inside the Pane. Due to this I am unable to click on that item specifically.
    Do you have any idea how to solve this

    • @andersjensenorg
      @andersjensenorg  Před rokem +1

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): czcams.com/video/xWFz-S96XGo/video.html Kind regards, Anders

  • @mbhagyasri88
    @mbhagyasri88 Před 2 lety +1

    Thanks Anders. This is something i wanted to try . Quick ask, can I ope. Word file and update data from excel? With this command

    • @andersjensenorg
      @andersjensenorg  Před 2 lety +1

      Thanks a lot, Sudhansu 🙌🙂 Just to get it right do you want to fill in different word docx with excel data? Can you elaborate please. Have a great day. Kind regards, Anders

    • @mbhagyasri88
      @mbhagyasri88 Před 2 lety

      @@andersjensenorg thanks for so quick responding was watching another videos of urd to convert CSV to XLS files. Yes i want to write excel data to word file placed in a folder on desktop or SharePoint

  • @KeinNiemand
    @KeinNiemand Před 4 měsíci

    Is there anything else that can automate GUI like this (as in without relying on exact pixel coordinate or image recocnition to know where to click)? Power Automate can't be automated in the free version.

  • @joshuacammeraat6047
    @joshuacammeraat6047 Před 4 měsíci

    Hi Anders,
    I’ve got a problem and I don’t know how to fix it. The element ID is different everytime I open my page. So now the ID is “370”, but if I restart the page the values are different. So how could I make this work, so that the ID updates all the time, so it clicks the right button on the page.

    • @andersjensenorg
      @andersjensenorg  Před 4 měsíci

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): czcams.com/video/xWFz-S96XGo/video.html Kind regards, Anders

  • @adityaprasad6795
    @adityaprasad6795 Před 4 měsíci

    Hi I have stucked one of the project using power automation desktop if its possible you can explain one to one

    • @andersjensenorg
      @andersjensenorg  Před 4 měsíci

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): czcams.com/video/xWFz-S96XGo/video.html Kind regards, Anders

  • @arijitmajhi4311
    @arijitmajhi4311 Před 9 měsíci

    I am not able to close the calculator using the Terminator process

    • @andersjensenorg
      @andersjensenorg  Před 8 měsíci

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): czcams.com/video/xWFz-S96XGo/video.html Kind regards, Anders

  • @i_lost_my_hitpointsdkpd1024

    Hey I have a question. Is there a way to do this in the background so people can do something else on the computer at the same time?

    • @andersjensenorg
      @andersjensenorg  Před rokem

      Hey friend. It depends, if you want to work in the UI (that is, do clicks etc.), then no. You would have to set up a secondary PC, virtual machine etc. You're more than welcome on the I Love Automation Discord for more help on this topic: czcams.com/video/xWFz-S96XGo/video.html Kind regards, Anders

    • @i_lost_my_hitpointsdkpd1024
      @i_lost_my_hitpointsdkpd1024 Před rokem

      @@andersjensenorg alright thank you

  • @moh-rezahmadi177
    @moh-rezahmadi177 Před 11 měsíci +1

    Please don't lower your voice tone during your speech. Thank you for your efforts and generousness.

    • @andersjensenorg
      @andersjensenorg  Před 11 měsíci

      My pleasure. Do you think the volume level is too low? Kind regards, Anders

  • @sudhajgvir4560
    @sudhajgvir4560 Před rokem

    How to convert 3columnd into rows by using set variable

    • @andersjensenorg
      @andersjensenorg  Před rokem

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 5800+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): czcams.com/video/xWFz-S96XGo/video.html Kind regards, Anders

  • @nadsgamingliveofficial
    @nadsgamingliveofficial Před 2 lety +2

    Hello Anders, Saurabh here I have just dropped an email to regarding problem which currently I am facing. Can please check your mail box. Your all videos are helping us can you please find the solution of problem. Thanks.

    • @andersjensenorg
      @andersjensenorg  Před 2 lety +1

      Hey Nads. Thanks a lot 😊 I'll reply to the email in 5 minutes. Have a great day. Kind regards, Anders

  • @SSAstrologer
    @SSAstrologer Před rokem

    Some blurred