Python Pandas now has AI (GPT-4). It's good and could take your job
Vložit
- čas přidán 28. 06. 2023
- Visit brilliant.org/PythonProgrammer/ to get started for free and get 20% off your annual subscription.
Thanks to Brilliant for sponsoring this video :-)
Pandas AI combines Pandas, the python data analysis package by Wes McKinney, with generative AI. It creates something that enables data analysis with very little code. Should we be worried?
You can find out more about pandas ai here pypi.org/project/pandasai/
and here
github.com/gventuri/pandas-ai
Learn Data Science (affiliate)
🎓 Data Quest - bit.ly/3yClqbZ
Learn Python with Giles
🎓 Exploratory Data Analysis with Python and Pandas - bit.ly/2QXMpxJ
🎓 Complete Python Programmer Bootcamp - bit.ly/2OwUA09
📚 My favourite python books for beginners (affiliate links)
📗 Python Crash Course 2nd Edition amzn.to/33tATAE
📘 Automate the Boring Stuff with Python amzn.to/3qM1DFl
📙 Python Basics - A Practical Introduction to Python 3 amzn.to/3fHRMdb
📕 Python Programming An Introduction to Computer Science amzn.to/33VeQCr
📗 Invent Your Own Computer Games with Python amzn.to/3FM3H4b
🆓 Free Python Resource
python-programming.quantecon....
(This is a great introduction to python)
⚙ My Gear
💡 BenQ Screen Bar Desk Light - amzn.to/3tH6ysL
🎧 Sony Noise Cancelling Headphones - amzn.to/3tLl82G
📱 Social Media
/ gilesmcmullen
/ gilesmcmullen
👌 SUBSCRIBE to ME!👌
/ @gilesmcmullen
#AI #python #dataanalysis - Věda a technologie
I feel like this video is more about the editing than the subject.
yes, but it is well done. i’m here for it.
Love me some good editing 🎨
short and sweet as it should be
Chanel should be named “learn if you can while I interrupt”
Here's the thing: do people hire you for analysis because they don't know how, or because they don't have time / desire to do it themselves? Most people don't know how: they don't think analytically in general, they don't know what to analyze, they don't know how to do it technically...
None of those things change just by you knowing being able to get it done faster with AI. You would need a complete societal transformation and radical education reform in order to get people to not need you to think analytically for them.
Beyond that, it's just like debating between Python and R, or any other language / tool stack: it will still be the analysts using the tools.
Another way I've put it is that for the foreseeable future, you still need humans to care what the results are. And if things change so much that humans are totally worked out of data-driven management entirely, you're really not going to care about the job anymore.
What this kind of indicates is, you need a lot more theory than practical code now. I have experienced this recently where I helped someone who was great at writing the code but didn't have as much theoretical knowledge. The LLM would not know what to investigate or what to do in which order for example when your model has much higher than expected accuracy, which after debugging can turn out to be your data is not labeled correctly. The LLM can't debug that but we did.
Honestly need to see how a nonprogrammer uses these tools to judge it properly. Currently programming experts are showing us the value of these tools, but the proof will be in seeing if low/no level programmers actually want to engage with these. E.g. most of them were lost at pip.
I was stump at pip, then I used ChatGPT to get me pass that 🙂, now installed Panda and working like a pro
i mean at pip most people would look it up on google anyway right?
You could just use GPT-4 with Data Analysis to avoid the hefty API calls via Pandas AI and reduce costs. Then keep your code to be independent of OpenAI even though its availability is quite high but not 99 percent. Just a thought. But can see the power of using the API within a notebook.
I wonder if something like pandasai could be applied to Wireshark/Nmap, and looking for any irregularities in network traffic.
2013-2022 is the last 10 whole years of data (if it includes 2013 data). The borough only showing Kens&Chels is, of course, an error.
Can AI keep you still while talking and make your screen with the code in focus?
AI could take your job...
Casually askes everyone to learn math and stat from the sponser....😂
I've just made up my mind to try and learn Python now, and I'm sort of worried? I'm concerned that by the time I've got the basics down, there will be too many data analysts, and/or AI would be capable of running data for those who don't know coding, which would make the entire endeavor moot.
It might be valuable while you are learning python to also learn about prompting these kinds of tasks. Like I am also learning Python but the other day I decided to use chatGPT to write the script for me and then learn how to prompt it so that it followed the steps I wanted and showed the results in the way I wanted to see them, it was much faster then me writing the code myself but I think there will be value in learning how to get the AI to build the right thing, someone had a quote it was something along the lines of "your job will not be taken over by AI it will be taken over by a person using AI" so better to be the person using the AI
@@Indy_rawr Thank you, appreciate the response. :)
Learning core Python and some ways to handle your files-it’s stupidly helpful.
When you say learn Python, have you experience in computer science or other languages? I would say it is always worth learning the concepts and problem solving skills.
As for AI, It is scary, but will ultimately be another tool that we have to adapt too. You may be at the right time to be a part of the shift in Tech and learn how to prompt well (which may be a skill in itself, as a fellow above me has commented).
To even ask the question is to be interested in Tech and I think learning it will help you (Python is a great language for learning, because of it's simplicity of syntax). I see you said you have made up your mind, may I ask what made you decide to learn Python?
We have lots of data, what data would you like to analyse? Remember, AI won't do it until you tell it.
Just a couple of thoughts, I'm confused about it and I've done 10 years+, lol, Not sure if that helped or not. All the best.
@@sadhappy8860 As I see it, and correct me if I am wrong in this since it looks like you have more experience than me in this field. We are headed in a direction where it will be more useful to know how to structure an app or a database than to code it. Since we can prompt ai to code for us knowing what a properly laid out database or app looks like will be more important than being able to code it ourselves.
For example the first scripts I made with AI I had a task in mind but not so much how it would work. I ended up with something that did what I wanted but it took 3 scripts that needed to run in a certain sequence. If I had a better idea about how the structure would need to be and the steps to get to my goal it could have been done in 1 script. Hope that makes sense...
So many of the python libraries have their own specific syntax for doing the same or similar things. The numpy syntax a bit different from pandas, which is different to pytorch etc, so we end up with a large confusing syntax to perform data analysis. LLM tools help as co pilots, but we end up losing our syntax memory. I am surprised it has taken so long for an AI/ML tool to arrive to inform us on the best model, technique to use for data modelling and AI, and encode it for us. I am glad I do not have to make a living from having experience in the use of these low level libraries.
That's the question. Do we need to memorise syntax anymore? There was a time when we needed to remember phone numbers. Not anymore. So the question is, is memorising anything becoming obselete? Will it? If it will, to what extent? Honestly, we have more questions and barely any answers. E.g. I loved notetaking while lectures. Now honestly, record the video, summarise using chatgpt. Not perfect as my own notes, but 80-90% there with 10% of the effort. So is it worth the effort anymore?
Great content, I love your videos! So much fun in the: "Im youtuber, money is no a problem to me" 😂 Keep it up!🎉
Work data without code? most analysts I know don't know how to work with data. I had to explain what a median was the other day. Keep in mind this was over email, so they could have Googled it first! but yes this is a cool step forward.
Please how do we install pandas AI?
look at the code at the start of the video
You asked for just the top of the iceberg so I wouldn't worry too much, these tools end up taking longer than they save you today.
Brilliant this video's sponsor ❌️
This channels sponsor ✅️
AI is a valuable tool that can assist in solving real-world problems, but it cannot fully replace humans. By leveraging AI and machine learning algorithms, professionals can enhance their work and make their jobs more secure.
Short term thinking yes right now ai cant replace but a big but give it 1 2 years and all the ai Projects are far more capable of replacing a human just Look at the Smartphones
In do time there want be any jobs for humans to do as ai is advancing you can’t say that it willl never replace human because if ai keeps advancing I. The rate it has been within 5 years no more jobs for us the governments will literally need to come up with new systems for humans to make money because of this
Cope sir
It's just a matter of time. Humans are not the pinnacle of intelligence in the Universe, my friend. We're just another rung on the ladder, that will shortly be passed.
People said AI will never be able to create art. It's now banned from art competitions because it's too good.
People said AI will never create music. It's now banned from the Grammys.
Every time we doubt it, AI proves us MASSIVELY underestimating it's potential. And it's still just in its infancy; it's basically just a newborn right now, and already a threat to our hundreds of thousands of years to get to this level of intelligence.
So don't overvalue that carbon based meat brain in your skull, while underestimating our newly born silicon cousins. They're increasing their intelligence exponentially quicker than us.
Keep coping. AI will replace a lot of human jobs.
So this is pretty much almost the same as desbribing your problem and dataset to chatGPT itself, but you do not learn coding in the process, would not say it is useless, but mehhhh. Also I am surprised it failed with the 10 years thing.....
definitely will NOT take my job 🤣
The idea here is not to teach humans, but to create a tool that wont need pesky things such as fair wages, vacations and breaks. to hell with the humans.
SciKitLearn? It is not 2011 anymore. Cmmn guys.
Noteable plugin for GPT4 is far superior to this python panda AI. With Noteable plugin you don't have to know anything about coding you use natural language processing at your chatgpt plus prompt
I believe this man is in the early stages of Parkinson's disease.
Why?
@@thombaz because he shakes like michael j fox
First person to comment, don’t take human jobs AI.
well as i said ppl manage to open Pandora's Box
there is no turning back
Ai will first it will take our jobs then our lives since we become obsolete
the more your job is routine and can be computed easier you will lose your job faster, complicated ones will be the last ones
Man your video is making me dizzy with all of the cuts. Just because you can cut to another view does not mean you should.
First Comment 🎉🎉🎉🎉
Clickbait cringe
That is why I install DeArrow extension to prevent clickbait titles and thumbnails; and just unsubbed from this channel after 2 years. Tired of all the short form videos and clickbait.
@@krimsonsun10why are you here commenting then
Is this similar to pd.sketch.howto / askto?