Google Sheets Database with Python Web Scraping
Vložit
- čas přidán 8. 09. 2020
- We can use Google Sheets as a database for our Python Web Scrapers. In this video tutorial I will show you how to add new rows under each other to a Google Sheet from your Python script.
-------------------------------------
twitter / jhnwr
code editor code.visualstudio.com/
WSL2 (linux on windows) docs.microsoft.com/en-us/wind...
-------------------------------------
Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases
mouse amzn.to/2SH1ssK
27" monitor amzn.to/2GAH4r9
24" monitor (vertical) amzn.to/3jIFamt
dual monitor arm amzn.to/3lyFS6s
microphone amzn.to/36TbaAW
mic arm amzn.to/33NJI5v
audio interface amzn.to/2FlnfU0
keyboard amzn.to/2SKrjQA
lights amzn.to/2GN7INg
webcam amzn.to/2SJHopS
camera amzn.to/3iVIJol
gfx card amzn.to/2SKYraW
ssd amzn.to/3lAjMAy - Věda a technologie
Thanks a ton, your video helped me in reducing the code by almost 60%, I am a non programmer and was writing my script just by googling and CZcams. A massive thanks for the easy-going and straightforwardly understandable video with no clutter
dude thank you so much!! I get excited everytime you post a new video. Really high quality stuff mate.
I ran into this error "ImportError: No module named gspread". But i fixed it by running this into my python interpreter
import pip
pip.main(["install", "gspread"])
just in this happens to somebody else
This came at the perfect time. Looking forward to watching more of your videos
Straightforward and concise. Thank you for this.
Great lesson with the right content and easy to follow ! Thx a ton.
Very useful and real life example! Thank you John!
I find it really easy to learn from you. Thanks for making content!
Excellent, John!! Really helpful. Cheers
Obrigado pelo seu video. Ajudou muito na automatização de minha planilha. Show. Parabéns.
This is fantastic! Thank you!
Perfect, thank you for your effort and time Mr Rooney
Speechless as usual one word for you pal ,awesome!!!
Thank you!
something new for me, thanks a lot, great channel!
SIR THIS IS THE BEST TUTORIAL EVER!
Im hosting a website using heroku but my manual database keep clearing after a few hours, but this is the perfect solution for that, tysm!
Great thank you!
Great stuff. Thank you sm
Thank you very much for helping me
Hey John, thanks for your videos, they're easy to understand and follow. After watching your Google News scraper video, and this video on how to scrape to Google Sheets, I'm wondering if you could make another video on "How to Scrape Google News to Google Sheets". I tried figuring it out myself but I only managed to get the first news article. Additionally, if its possible, a video on "How to append scrape data (i.e. Google News) to Excel"), or to create a new Sheet within an existing doc. If you could do any of those that would be amazing.
Thx mate! Great vid
Thank you John!
Thanks You from deepest of my heart. ❤
Your video has been very helpful. Thank you so much.
Thanks for watching !
great video. keep going!
Very nice.
Thanks!
goated video
very interesting
i fuckin love you man, thank you!
By any chance you think you could do a video about automating scrapers with cronjobs, and maybe even using launchd on Mac OS if you happen to know anything about that? Really glad I found your videos... They're really well done and very helpful.
Sure I have a video about running scrapers in the cloud and cronjobs planned
@@JohnWatsonRooney Awesome! Can't wait.
Nice video thx! Is possible to automatic update the information scraped from a website? or you have to run the code ?
That is fantastic! Thanks for the video! I'm trying to find a way to automate the update of the sheet. I know google sheets have that, but the way it scraps are too basic. If there is a pyton way it would be wonderful!
great actor
Excellent tutorial! You mentioned something cron jobs. Do you have any tutorials about how to set those up?
Great video. Any chance to do a tutorial on how to create a trigger when price change?
Yes I could look into that
Thank you so much, I do get an error that says I need to requests more quota but it doesn’t really effect it bc I still get what I want with it.
Hello John, I got this error copying from your video "list indices must be integers or slices, not str" Do you know why?
Just amazing, did you know how to extend the matrix with a For loop?
btw john is it possible to make the product['date'] as date object to append in google sheet?
Thanks that is very helpful. I am looking to know how to import several row with several values (i.e I have a .csv with 400 rows and I want to upload these 400 rows into GSheet automatically) ? Right now it only insert the latest value of my .csv
Thanks !
did you find out?
hi! where did yo get the info? i was surfing throgh the official gspread webside (i think) and i didnt see the append_row command (for example)
Hey can we use the saved data in google sheets to render into django page through pandas liabrary
Wow
Hey john, do you need to have to import 'oauth2client.service_account'? my google sheet is not updated as the script tells
Hey good question! It’s been a while since I’ve done this but as far as I remember that wasnt needed as the g sheets import handled it all.
Does this auto run each day, or does that have to be done manually? Thanks!
what do I do if FileNotFoundError: [Errno 2] No such file or directory: 'hey.json'
I followed every step
Double check the json file is in the correct directory?
@@JohnWatsonRooney yes it is
Can you make a video about google Sheets web scraping with ezsheets module
Guys Don't forget to enable google drive api to not get any errors
What if I wanted to create a spreadsheet from spread
Hello, how can I get the example code sir?
hey sorry this is old now i don't think i have this specific code anymore
it doesnt work for me. I cant update the cell. Did i a mistake?
Can we Automate Google sheets with Python? I mean, If we want to automate reports and send Email to the management, can we do that? If yes, how? Can you please help with the same?
More haste less speed on the typing sir.
Hi John it seems google api change the way we write things up, here's what I had to write to get it to work: sh.update([['third']], 'A1')