Microsoft AI Builder Tutorial - Extract Data from PDF
Vložit
- čas přidán 3. 08. 2024
- In this step-by-step tutorial, learn how to use Microsoft AI Builder to extract data from a PDF document. Along with extracting text fields, tables, and text boxes, you can use AI Builder to determine text sentiment, identify objects in images, and much more. Once we extract data from the PDF you can automatically insert the data into a spreadsheet, Microsoft Teams, or any other connector. You can leverage your new AI model in Power Automate and Power Apps.
We begin by entering the fields we want to extract from the PDF. Next, we upload sample documents into a collection. With the documents uploaded, we tag the documents to teach the computer what data is contained within and where the data is located. We then train our model based on the sample documents and tagging. We then upload a sample document to ensure that the model works as we expect. Lastly, we create a Power Automate flow that leverages the model. At the end, you'll be able to automatically extract data from a PDF document.
👋 Additional resources
- Microsoft AI Builder License details: powerapps.microsoft.com/en-us...
- Get to AI Builder using Office.com: www.office.com
- Introduction to Power Automate video: • Power Automate Tutoria...
- Introduction to Power Apps video: • How to use Microsoft P...
⌚ Timestamps
0:00 Introduction
1:02 Caveats
1:25 Get to AI Builder
2:17 AI Builder overview
2:42 Choose info to extract
3:38 Create collection
4:22 Tag documents
5:06 Train & publish model
6:04 Use model in Power Automate
8:26 Run test
9:15 Wrap up
📃 Watch related playlists
- Playlist with all my videos on Power Automate: • Power Automate
- Playlist with all my videos on Power Apps: • Power Apps
🚩 Connect with me on social
- LinkedIn: / kevinstratvert
- Twitter: / kevstrat
- Facebook: / kevin-stratvert-101912...
- TikTok: / kevinstratvert
- Instagram: / kevinstratvert
🔔 Subscribe to my CZcams channel
czcams.com/users/kevlers?...
🎬 Want to watch again? Navigate back to my CZcams channel quickly
www.kevinstratvert.com
🛍 Support me with your Amazon purchases: amzn.to/3kCP2yz
⚖ As full disclosure, I use affiliate links above. Purchasing through these links gives me a small commission to support videos on this channel -- the price to you is the same.
#stratvert - Věda a technologie
You’re amazing. Your voice is soothing. Your flow is perfect. I can’t stand watching anyone else explain things to me. They suck lol.
Ce frumos e sa te avem aici... Asa învățăm programare...
Content creator, thank you for uploading.
Greetings to all the respected viewers here.
Wow, what an exiting topic! Please more on automatisation and Power Automate! Or maybe web scraping, data visualisation etc..
It is really cool for accountant who deals with tons of PDA Invoices from different companies in different layout. And it looks like Bluebeam Revu for construction users to identify the specific location to extract key drawing title and reference number.
Hi 919pang, I'm a construction user of Bluebeam Revu trying to extract Specification pages relating to Acoustical Ceilings and ACT types from the Architectural drawings. Is this something that can be done?
Thank you sir, finally i understood the purpose of power automate ❤️
This is ABSOLUTELY FANTASTIC! I really like the lighting you used in this video. Your improving in no time Kevin! You're having Better Audio, Better Video, Better lighting every once now and then! That's really great. Keep producing these amazing videos!
Thanks Vendanth! I’m using a three point lighting system for this. I like the outcome 👍
@@KevinStratvert How are you recording your audio? sounds really good!
@Satvik Garg he does not reply to all comments
i just finished watching your tutorial on the cbk bread maker then got this AI video suggestion. What a variety lol. keep it up👍
That Manager of yours looked like a real tough guy. Must be real hard to work with this guy?
Felicitări, eu m-am uitat și la programare în Python. Te felicit, Kevin.
Awesome video as always. Learning a lot from you. Keep it up!
Many thanks Kevin! It would also be helpful if you have a series videos of this AI builder (i.e. beginner to medium or advanced) 👏
Are you sure he doesn't have that already?
the one and only thing to identify if this cool man is real its " Tooodaaaay"
Am glad that am not the only one who noticed it
😂
I love his voice vibes and “TODAY!”
Kevin is the man! Such great videos
This is a powerful but EXPENSIVE software!
$500/month for 1 million credits. Anyone in your org can use it. It’s steep, but when you consider people no longer will spend time on these manual tasks and can instead focus on more value adding activities, it’s likely worthwhile. It’d be nice if there was also a basic free tier for just a few credits each month to experiment with.
@@excelrobot very true! Especially if you compare it to existing solution (having someone manually do the work).
@@KevinStratvert the pricing model makes it hard to start of in small scale though. Otherwise I agree, once scaled up its super affordable.
@@qaazz you get a 30 day trial and I believe you can extend it a few times if necessary. That can help jump start things while keeping costs low.
Wow this is highly impressive Kevin! I started an LLC, can you sign up using a tax ID? Thank you for this practical video.
Really useful stuff! Your channel is helping me a lot at work.
Great videos Kevin, definitely gave me some great ideas for my work, thanks and please keep the videos coming :-)
Loved the topic. I built an automated pdf for performance appraisal and was wondering how to get all those data into an excel in a single click of button. I think I got the answer.
Looks pretty useful gotta check this out Kevin I really like your vids you explain so well if someone else was in your place I never would have understood it or checked it out. You don't deserve a million you deserve more keep up the hard work.
There's a lot more to getting setup with a business account and all the services connected to get to the point of creating a model. I appreciate your video for showing me what's possible though.
This is great. The MS Power Plattform is so mighty. So many possibilities. It's just started to roll put in our company. Please do more videos about it.🙏
More to come!
@Satvik Garg what does that have to so with my comment? 😅
Just blew my mind. 👏👏👏👏
Thanks for the help!
That was epic, thank u sir!
Gr8 man! Gonna try 2 use it.
Crack! Excelente video, seguro que lo implemento en la empresa!
Wow now this is an interesting feature....
You have very talent
excellent tutorial, relevant and timely tutorial. Please create a video on process advisor
This is amazing Kevin, I was thinking Can you please make a JavaScript crashcourse Thanks a lot
I would really appreciate some JavaScript course from you Kevin
Thank you......
very nice and informative video :) thanks for your efforts
This is amazing!
Super Kevin awesome tutorial as always.
Thanks for the note Edson!
very useful, thank you
Awesome Video; thank you for sharing!
Great video thanks
Thanks
0:00 - Hi Kevin. 👋 9:20 - 766th thumbs up from me to the formidable video for sure. 👍 Cheers.
I found this very usefull
Hey Kevin, I follow your content from Nigeria. Great content! please let's have another video for using AI Builder in Power Apps
Hi Kevin thanks a lot for this video, it's amazing and really useful. I wanna know, if can i combine the AI Builder with Power Automate Desktop?
You are the best
Hmmm. Interesting topic. Gotta test this out. Thanks for the walk-through.
It's very useful . It seems you are very tired or something wrong with you because your eyes seem not more energetic Try to sleep and take a rest more if U do not wanna stay in bed . Thanks for all your Vids
I cried on you 1m special video
Tooodayyy.
Happy start of every video
New subscriber here! I was searching YT for some Teams tips & tricks and your channel was one of the recommendations! I'm so glad I chose to watch your videos because right now I can't wait for my next Teams presentation and flex everything I learned from you! haha! Thank you for all the great content, I am looking forward for more!
Hello Kevin..!! I love the way you teach something. I love the photos app of windows 11. Can you please check that and let us know, if the default photos apps of windows 11 can be installed in Windows 10 OS?
Nice Todayyy Kevin!! But make videos on Coding with Html css js
Amazing your tutorials are so easy to follow. Could you possibly do a tutorial on krita?
I have Krita on my list. Stay tuned!
Thanks for this amazing video. I have one question. How do we put the extracted data in to excel directly? Is there any way to directly feed the pdf to the model and get the output?
Hm Power Automate is not an option for you?
I love you bro
beautiful
Very nice very good
Mr kevin please prepare video for data anlysis
More to come!
Great 👍
The Subject Filter is just what you’re telling it to look for, you don’t need it to be AI filter as the next step has no idea what that filter is. If all the emails with the attachment have something similar in the subject line, use that. If it’s a single purpose mailbox where it ONLY receives these emails then don’t use a filter, just make sure you select Require Attachment
I hope another form tagging method is developed - Maybe with default field boxes for forms 2-5. If you have complex forms with 50+ fields, you have to enter the tags 250+ times- Very time consuming.
From some demos I watched, it looks like based on your input from the first form, you’ll be able to simply confirm any subsequent fields on the remaining forms. However, I didn’t see that when I walked through this. My guess is they’re working on this feature for the exact reason you call out.
I already trained one model, very useful..but sustainability is difficult, for a mere of budget..
Great
Do u think I could use it to generate an invoice from a spreadsheet when info is filled in?
Mail merge can help you to fill in an invoice with data from a spreadsheet. You can also pull it off using Power Automate.
Good vedio
OCR tools does all of that already 15 years ago, without any AI. I really don't know where AI or learning is needed to automate the recognition of fixed text parts on PDF documents...
Agree. "AI" in this case is just branding for modern OCR features, then tied to a flow.
can this do a linear, area and volume measurements? currently i can only summarize my measured data from pdf to excel...
hi Kevin, in your 5:09, do you need to tag manually for all 5 document?
Love your vids Kevin! Quick question; can this only pull info from PDFs that are sent with Outlook, or does it work with Gmail? I've finally gotten around to saving & sorting all my financial statements but my accounts are with Gmail.. 🤔 thanks much!!
Power automate also connects with Gmail, so it’ll work there as well 👍
How to insert the youtube video in power point?because its been updated the power point?
Kevin can you try making a storage partition video ?
That would be so useful for the people who have low c drive storage..
Hi Kevin, would be nice if you could do a video on MS Syntex and highlight the difference between the two products. Ms Syntex also uses AI.
I’ll add to my list. Here’s a good article: www.withum.com/resources/is-ai-builder-enough-or-do-i-need-sharepoint-syntex/
0:08 No waay!🤖 0:14 How can it be complex with you here?😎 0:40 Not him again! Do you even have a manager?🤷♂️ 0:48 Apparently no.😂 9:15 I learnt something new and obviously enjoyed :) 9:19 Liked even before watching👍 9:22 Who hasn't subbed. I think your boss hasn't 🙄! Kevin this was an amazing tutorial! Your walk-through is always amazing and you explain very well!!
You forgot: "delivery method: pigeon" 9:05 😀
How could I miss such a funny element? Thanks for filling the gap.
"Crate"? As in build a box around? Or "create"? As in make something new?
Hey Kevin, can you make a full detailed course on Microsoft Excel and how we can use it to make good income.
wait so it went from 500 to 20 dollars?
the thumbs up SHINED WHAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAT
Hello, thank you for the video. Is there a way redact the text from PDF using AI and power automate?
I have a field that appears multiple times on a page, but AI Builder only allows me to tag it once. It also doesn't recognize the range as a PDF table.
Can we extarct signature and do a match?
cool
Wow!!!
Kevin, if i wanted to take the pdf info and have it input into an online portal what option do i choose?
Hey Kevin, what do you use to do screen recordings? Camtasia, OBS, something else?
OBS Studio
@@KevinStratvert How do you do that Zoom in thing so well?
@@Tim-Shows key frames using davinci resolve.
Hi, you should upload a video on how to add chapters to your video.
What if you have multiple formats of PDFs, but same set of output data your want to extract? Can you train them in one model?
You can set up multiple collections. Each collection contains a different format / layout. You can then train one model.
Kevin which screen recorder you're using?
Which app you are using to edit video?
Obs studio for screen recording and davinci resolve for editing.
Can you suggest a C# IDE for a low end PC?🤔
Nice video, I´ll give it a try. I have a little diferent story. Do you think this case is also possible: Extraction of Advertisements from PDFs:
The most complex and crucial aspect for us involves extracting advertisements from various publications such as brochures, city maps, senior guides, or official bulletins. These are often published online in PDF format. We want to extract the ads from these PDFs and directly store them in a CRM for the respective companies, making them accessible to our sales staff. It is essential not only to export the data from the advertisement but also to see the image.
This process should be automated, as manual effort is not feasible. Is there a tool that can identify, highlight, and extract advertisements in PDFs, and also offers integration that reads these ads and assigns them to the respective companies?
Do you think that´s possible?
wow this is great. Can i do this with a document that lays out a table with product information and order numbers
for example at my shop i have someone write down manually onto a piece of paper the product in column A and the number of that product they want to order in column B.
can i take this manual hardcopy piece of paper, scan it and upload the information directly into excel? any help on this will be amazing
Hi Kevin, I have a requirement like I need to extract the data from Resume one and need to import the data to Resume 2, Can we do this by implementing Power Automate, if yes let me know how can we do this? Thank you
can you make an example on how would you process this info into Microsoft GP for business ?
Does this still work if the forms are always in different formats, that aren't super similar?
Is there any open source maybe AI LLM powered project after two years?
Hi, Can we duplicate the text after tagging the one already in table. For example i have taken a table, in that my first row first cell is having the data like "Test-1", can i duplicate this and use it in same table? If yes, please suggest me the process.
Can you please make a video - I have unstructured outlook mails from which i want to extract information like, customer name, Product number, email id.. Etc... Using GPT PROMPT... by AI BUILDER.. Because i have too many information in one array ( customer id, company name, date created in one array) so indexing is not working
Hey Kevin, do you know how to remove the background from a photo in power automate?
where can this be found with the new layouts? I couldn't find the area to do this
Really Good. But Can we convert bunch of(more than 500) pdfs in to single excel?
I have more than 500 pdfs of invoice. I have to verify the bill generated in the invoce before sharing with customers. so I want to create single excel file from values present in all pdfs.
How to acheive this?
Hey can this AI builder open a pdf which is available on share point with a link.Clink on the link (pdf will open ) and then identify what is needed and put it in excel?
What if my PDF contains more than only 1 page and I want to extract the information from all of them?
Kevin in your previous video you told us that you can add an animated background for windows 11 can this also work on windows 10 and/or mobile/tablet. Also if you upgrade to windows 11 remove the version. Please create more videos on simple coding or programming. Also, I just discovered something called Microsoft editor can you explain that to me too. Other than that, all is good. So I'd recommend keeping up the hard.
Animated background works on win 10 as well. More to come on coding. I have a video on Microsoft Editor. It’s similar to Grammarly.
@@KevinStratvert ok thanks
Kevin