ChatGPT Vision: The Best Way to Transform Your Paper Notes Into Digital Text
Vložit
- čas přidán 16. 07. 2024
- If you've ever found yourself torn between the tactile feel of paper and the convenience of digital notes, there's now a solution for you.
ChatGPT's new feature called Vision allows it to “see” your handwritten paper notes and digitize them with near-perfect accuracy.
In this step-by-step guide, I’ll show you how to turn your handwritten notes into digital text so you can edit, search, and preserve them forever.
📖 Check out this article for more examples and recommendations:
hukulabsai.substack.com/p/gpt...
📚 Use ChatGPT to create personalized summaries of your favorite books: • The BEST Way to Summar...
CHAPTERS:
00:00 - 00:39 Intro
00:39 - 01:24 Why ChatGPT Vision is Different
01:24 - 02:35 6 Steps to Follow
02:35 - 03:11 Mistakes and Limitations
03:11 - 04:08 3 Possibilities ChatGPT Vision opens
04:08 - 04:41 - Conclusion
-----------------------
Building a Second Brain is the proven method to organize your digital life and unlock your creative potential.
We're on a mission to help you increase your productivity, and lead a more fulfilling life with more ease and less stress.
🔎 WHAT'S YOUR PRODUCTIVITY POTENTIAL?
Take our Productivity Pulse Check to evaluate your daily habits and find out where you can make improvements.
Take the quiz now: fortelabs.typeform.com/pulsec...
🧠 HOW YOU CAN BUILD YOUR SECOND BRAIN
Order the book: www.buildingasecondbrain.com/...
Take the course: www.buildingasecondbrain.com/...
📬 JOIN THE FORTE LABS NEWSLETTER
Level up your productivity and life with new essays, videos, event invites, and other resources every Tuesday. Join 125k subscribers exploring the frontier of modern work, experimenting with new ways of doing more with less, and discovering what it means to fulfill our human potential.
Subscribe here: fortelabs.com/subscribe
🐥 FOLLOW US ON SOCIALS
Always get the latest updates and insights around Building a Second Brain.
Twitter: / fortelabs
LinkedIn: / tiagoforte
Facebook: / fortelabs
Instagram: / fortelabsco - Jak na to + styl
1. As others have reported, there does not seem to be a “vision” option available in ChatGPT 3.5. So the transcription method described in this video appears to work only in the paid chatGPT 4.0 application.
2. However, the good news is that Google Lens (a free part of the Google search application) does a pretty good job transcribing handwritten notes. Take a picture of the page that has the notes, then store the picture in your phone’s photos. Then let Google Lens upload that picture. One of the Lens options allows you to copy the text identified by Lens from the picture. Paste that text in a word processing application of your choice. It’s not perfect, but it is serviceable.
I am working with an iPhone. I assume that an Android would work substantially the same way.
Thank it worked 😊
Thank you for this, I found Google lens also works if you photograph it directly rather than just import the photo. What it doesn't do is to understand what you've written. I pasted some handwritten notes about using Wix to develop a website that I'd made from a CZcams video, but Chat GPT wrote it's own version which left out some of the detail I'd recorded, but because it had drawings in the notes I think it couldn't understand that part of my notes. Still, it was pretty good. Might have to start paying for Chat GPT!
It seems that the idea works with Bing copilot as well, once you enable the GPT-4 option. However, I have not tested explicitly how well it performs relative to the Chatgpt app with a GPT-4 subscription.
bless your soul, sire
0:00 Intro
0:39 Why ChatGPT Vision is Different
1:24 6 Steps to Follow
2:35 Mistakes and Limitations
3:11 3 Possibilities ChatGPT Vision opens
4:08 Conclusion
Just gave it a try on a handwriten diary in cursive script: GPT4 confidently produces complete hallucinations of what's on the page. I mentioned this to GPT4 which in turn produced another different "reading", that had as little to do with the actual text as the first.
Since I can decipher the text 99.9% of the time, I propose this as a future benchmark for AI, when it catches up. For the time being I'll stick with speech-to-text with google now on android, which is in the high 90ies, accuracy-wise.
I just sent this to my Mom who does all her interior design biz notes by hand, awesome!
with my Remarkable 2 I’ve replaced all my old handwritten notebooks, while still getting the greater creative capacity that comes with handwriting. It converts all my notes at the push of a button And keep a file tree as complex as Microsoft word. Absolutely changed my productivity
Nice! I've used Remarkable 2 and unfortunately writing was very laggy and the device - faulty :( I had much better experience with Onyx Boox Note 3, but ultimately I moved back to paper notes and journalling 😅
@@Jaszkinwhy did you move back
Fantastic stuff. So glad I'm set free from my tablet.
Wow, you jsut saved me a bunch of time, thanks!! I am just passing my old notepads to digital.
This is the kind of thing libraries should provide. An automatic book scanner with an LLM running locally, saved to a usb stick
awesome tip, im gonna try this with my old bullet journals =)
You have made some significant upgrades to my notetaking journey. Thanks Tiago for your help.
As an IT Pro, I'm truly impressed at your adept adoption of AI in your content!
thank you this is so much help full
I've been able to do 3-4 pages at a time with no problem.
I write in all caps handwriting, and I have to tell it "transcribe to regular case" and it does it perfectly usually
Just gave this a try on the normal free chatGPT version without expecting anything to work and YO IT ACTUALLY WORKED! This will make the marking of student essays that much more easier! :D Elated.
thanks for that - i will try it
Bro this is gold. Thank you
Thanks. I learned something new.
Man, thanks for the tipp, I just tried this.... it's amazing.....and scary at the same time.
This is the sort of thing I have been wanting for years. Thank you for making me aware this now exists ✌️ Look forward to trying it out. One thing I will say though. Digitizing notes in no way means they will last forever. If anything physical notes are always going to last longer if kept well. You just never know what could happen in the future 😂 All it would take is a massive solar flare or global crisis and the digital world we live in is gone. The digital world isnt as failsafe as many believe. Of course its very unlikely. But just thought id raise that point. Paper will always outlast digital at least in the sense that digital can fail. Still great to be able to digitize notes for the utility of it though ✌️
Good stuff! Sadly, I think it is limited to text only and won’t capture drawings so it has to be done manually.
Great.............Very helpful video.
one thing id add to the video, you can do all the regular prompting you do in gpt! so you can leave unfinished equations, or drawings on the page, and have chatgpt think about them, solve them, describe them!
Hi! Any thoughts on privacy regarding some of those personal notes/images being OCRed by GPT? Where are they stored (whose servers) and who else, besides me, can access them? Thanks!
I would not consider scanning private notes because ChatGPT is designed to take whatever has been scanned or collected by it and use it to answer other peoples questions which would likely mean that they keep that information on their server
@@ServantStatusMinistries Thanks!
@@PGSG-7075 You're very welcome!
@juanpineiro2911 If you’re using the paid version of ChatGPT, you can also change your settings such that your chats aren’t used to train the model
@@PTewogbola Awesome. Thanks!
Rocket book is great as well
Alternatively, you can use an e-ink tablet as Supernote A5x and A6x2 🤓
Thanks Tiago. I’m a small caps writer. iOS does horribly with it. I’ll give ChatGPT a go. Perhaps I have to include my writing style in my prompt.
How do i connect my notes to the folder structure on my computer for storing artifacts and files that aren’t notes?
Is our data then used to train Chatgpt further?
I do this too. I use OCR apps available on the google playstore. I got excited with this video, but unfortunately it's only available for Plus, which I can't afford at the moment. OCR apps work just fine, but I have to be mindful and use my best handwriting though 😅😅
Love this!! I currently have the free 3.5 version of Chat GPT, and a Samsung phone. Will it work for me, or is it only for IOS and paid Chat GPT? :/
HELP Downloaded ChatGPT, can’t find Vision. Found reference to you digitising notes. Doesn’t work. Do I need to buy GPT+ ?
I cant upload pics on the app😢? Doesn’t someone have the same problem
I can't upload photos with note to the ChatGPT 3.5.
Neither can I. :(
Major fricking omission in this guide. Wasted my time
Chatgpt please advise on a decent youtuber to follow who can give me accurate advice on how to use you
V useful, thanks. However, the Nuwa pen might be the solution (though expensive), since it records handwriting on any paper, from a notebook to a scrap of paper (i.e. it doesn't have to be in a dedicated notebook) and uploads it digitally. it's to become available later this year.
But have you used it - all of the digi recording pens I have tried have been bulky and poor. I saw this one, but didn't pull the trigger and go-fund as I have spend hundreds of GBP over the years.
Man it recognize even my shitty hand written words and letters. Awesome
What languages does this work in?
Hopefully soon they will able to digitize drawings as well.
Is this a payed feature for ChatGPT4? Do I need to get Plus? I don't see where you can upload the picture?
Great idea but it doesn't work on paid feature either
Man its for ChatGPT 4
3.5 can't do these!
Any alternative solution for this?
I tried using IOS build in camera transcription. It gave me a lot of errors, but then I pasted it into ChatGPT 3.5 from notes and it corrected all the errors. Even in danish. I was impressed.
Yep! It's easy... just pay for GTP4. 🤯.
It's definitely worth it. And if you don't have $20 extra every month, you have issues and need to get your priorities straight.
Use Google lens copy to text then paste to word thats what I do
Does that work with hand-written text?
Being a maths teacher, i have never seen a perfect app to convert handwritten maths calculus equations to text like this. Is there any way to do that. I am taking about calculus, matrices like equations. This one is good for normal note taking
MathPix uses ML to do this. Very good.
@@petercinque1421 Thank you so much
What's another option since this does not work for average person?
We can not upload photos
Looks like this is limited to Plus members only?
Yes, I tried it on my free account. But its says tha GPT Vision is only available for plus members.
❤️
Options not available -- iPhone -- latest IOS -- latest ChatGPT
A second brain: The world's first real one
I'm building exocortex. It
=> takes text, audio, video, image input
=> remind you to follow up on tasks
=> automatically organize notes
=> does research for you
=> execute tasks
Imagine as a developer that you can record a voice note and your Jira board is updated with tasks for your next sprint. Or you're a writer and you take a picture of a scene you want in your novel and you have 10 show not tell storylines ready.
Yes you, you're like me. Your mind is oversaturated with ideas. Why not dump it on your second brain and forget about it. It will give you a breakdown of what you need to do tomorrow. With one click, it gets your idea up and running.
Best of all, you will never forget anything cause you never needed to remember, your second brain syncs with your calendar and informs you.
Up for a chat?
Interested.
Interesting but it gives Big Tech (and thus Government, Digital Agencies, or Private Investigators) access to anything we have written: health records, financial records, personal journals, ect. This tech would be great for non-sensitive work related stuff, but NOT personal.
Agreed. That was my first thought: why would I share these notes with unknown readers?
it did not work with my notes; it saw the photo of the notes as an image
Is this for paid chatgpt version only?
Yes
Pretty cool but privacy is important so I’ll stick to the good old Moleskine.
Did not work with my handwriting
It’s gonna take 1000 years
Yeah right?
is it free or paid?
Part of me thinks, coool. And part of me thinks, why would I help them take over the world?
Yeah, no it can’t think. It can pattern match or predict.
The only beef I have with this is the amount of energy consumption the AI servers are gonna have if we all decide to do our digitalization through chat-gpt....
Average person can write 20 words per minute. If you spend 2 hours writing continuously per day without breaks, that’s 2,400 handwritten words per day. If you write for 88 years till your last breath, that’s 211,000+ words. You can fill an A4 page with 150 words. You need at least 1400+ pages per lifetime. That’s seven 200 page notebook. However you might write significantly more during retirement, give up halfway, or unexpectedly pass away. Life is unpredictable. Ten 200 page notebooks don’t take up a lot of storage space.
You forgot that there are 365 days in a year... 211,000 words is only 2 hours a year. If you wrote for 2 hours every day for 88 years, you would have 38,596,800 words. Or 1,286.56 A4 notebooks.
20 words per min
20 words * 120 mins (2hrs)
2400 words / 1 day
2400 x 365 days = 876k
876k a year
Let says u started at 20 and died at 90, that's 70 years
That's 61.3 mikl
To add to the context, I print at ≈30 wpm, with cursive even faster. And I'd estimate 150 words per page if you skipped lines. A college-ruled sheet for myself is usually 350 wpp.
It’s not the space things take up, it’s being able to search for something contained in the notes.
@@FBombinHornFanexactly this
Cool but not brand new
Too much ai
It simply doesn’t work. Gpt just makes a rubbish transcription…
Ridiculous. This is not a game changer, this level of accuracy has been available to the average person for over five years. It does know better than Google docs and has an abysmal user experience