Selenium Tutorial - Python Selenium Full Course for Beginners 2022
Vložit
- čas přidán 8. 07. 2024
- 🌐 NodeMaven Proxy Provider: go.nodemaven.com/scrape
💥 Special Bonus: Use "Michael" at checkout for an extra +2GB of bandwidth.
🤖 2captcha Captcha Solving Service: bit.ly/2captchapromo
Welcome to my Python Selenium Full Course for Beginners. In this video, I have compiled my Python Selenium Series I made into this 2.5 hours full course Selenium tutorial. The video is designed to learn everything necessary about Selenium to be able to complete big projects either your own or professionally. I decided to put the work in and teach you everything about Selenium because documentation is boring :D. I have over 3 years of experience professionally completing projects for thousands of dollars, and all the knowledge required to do so yourself is shared in this video.
AWS Lambda is serverless, event-driven compute service that lets you run code for virtually any type of application or backend service without provisioning or managing servers
Playlist: • Python Selenium Tutorial
Code:
github.com/michaelkitas/Pytho...
github.com/michaelkitas/Selen...
github.com/michaelkitas/Selen...]
Heroku:
Buildpacks:
heroku/python
heroku/google-chrome
heroku/chromedriver
Environment Variables: CHROMEDRIVER_PATH=/app/.chromedriver/bin/chromedriver
Join our Discord: / discord
Gecko Driver: github.com/mozilla/geckodrive...
Chrome Driver: chromedriver. chromium.org/downloads
GitHub Repo: github.com/michaelkitas/Pytho...
Download Visual Studio Code: code.visualstudio.com/download
Download Python: www.python.org/downloads/
Selenium Library: pypi.org/project/selenium/
Append to JSON file functionality: www.geeksforgeeks.org/append-...
Undetectable ChromeDriver: pypi.org/project/undetected-c...
Selenium Wire: pypi.org/project/selenium-wire/
Infinite Scrolling Demo: intoli.com/blog/scrape-infini...
Donate
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
PayPal: support@websidev.com
Bitcoin Wallet: bc1q05j8gcnq4mzvgj603cxdc8xxck4jgnu2ljsrt4
Ethereum Wallet: 0x5e7BD4f473f153d400b39D593A55D68Ce80F8a2e
Social
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Website: websidev.com
Linkedin: / michael-kitas-638aa4209
Instagram: / michael_kitas
Github: github.com/michaelkitas
Business Email: support@websidev.com
Intro (0:00)
Setup, Web scraping & Testing (2:19)
Grabbing Elements From HTML (9:26)
Pagination & Saving Data To JSON File (21:53)
How to bypass/solve reCAPTCHA using 2captcha API (37:38)
How to bypass/solve normal captcha using 2captcha API (47:00)
Bypass Detection using plugins, settings & proxies (56:05)
Save & Reuse Cookies (1:06:30)
Capture, Block & Mock Requests using Selenium Wire (1:13:39)
How to bypass/solve hCaptcha using 2captcha API (1:27:25)
Scrape Websites with Infinite Scrolling (1:39:34)
How To Deploy Python Selenium Script in Heroku via CLI & GitHub in 2022 (1:50:52)
How To Deploy Python Selenium Script in AWS Lambda in 2022 (2:09:37)
Top 8 Web Scraping Tips Every Beginner Should Know (2:23:22)
Tags:
- Python Selenium Tutorial
- Full Course Selenium
- Python Selenium
- Web Scraping Full Course
- Python Selenium Web Scraping Full Course
#python #selenium #webscraping
Hello michael ! I'm crying right now ! You saved me from all of those old selenium tutorials.this is perfect for me and just...THANK YOU
I am glad my tutorial is helpful, thank you for the great comment 🙂
great course, it explains everything someone would need to make a fully functional selenium automation!
Some of it was hard to follow. Because you were doing things without explaining what you were doing, or what they do. Yet it’s better than the pile of outdated tutorials on YT.
I agree, probably will redo the series soon with more detailed explanation and also include more basic functionalities.
I like your videos! Thx for content !
Thanks man god bless you.
One of the best channels to learn web scraping. Thanks man
But whenever I try to load up defafult browser it opens but the bot doesn't do anything. Any thought?
@@almahanadalmahdhour551 Can you share code?
thanks a lot mate
12:55 pay attention to the second "find_element" there's an s at the end so it's find_elements
Thank you
Hi Michael,
vielen Dank, alles gut erklärt, warum klappt die Installation nicht wenn IPv6 aktiv ist? Chrome wird gestartet mit URL data, die URL wird nicht angezeigt
This is absolutely wonderful! I was initially looking for how to build bots using selenium and python. I thought you covered it in this course. please could you try to do a tutorial on bot creation using selenium and python?
Thank you! What kind of bot, should I develop?
@@MichaelKitas You can screen video about bot development funamentals with Python, Selenium
hi Michael. Your course is very helpful. Could you make a separete videoon how to organize all the files in vsCode and best practices when it comes to test Automation with selenium webdriver and Python, How to reuse the code and so on.
Yes, great idea, thank you!
This course is amazing . I am really enjoy it. Good explanations.
I have an error with the images. Some images are found and others are not. The selector is the same. I don't understand what the problem would be.
Can you help me with that ?
I can't say without reviewing the target website. Are you sure they are the same selector?
I got an error at 13:41 that object of type 'WebElement' has no len() while printing the lenth of items.Can't find the solution help if anyone know
Try logging without len, for some reason it didn't find the elements. Maybe try a different selector?
Hi Michael, Ur Video is great. i have question. Can u tell me how to getting current request header with using selenium. Why i need request headers not respone bcs on request headers have authorization and i need to get that. Do you know how to get that? thanks. Hope you can reply this and give solution
Check the answer to this: stackoverflow.com/questions/62262261/how-to-get-request-headers-in-selenium
You can use selenium-wire
Hey Michael! What do you think about using Pycharm?
I switch around multiple languages (Python, Javascript, Swift/Kotlin e.t.c) and VS Code is personally better for me. I don't like using multiple IDE. But if you primarly use Python, Pycharm is a good option
“I’m watching part 6 right now. I just want to ask if this video is a compilation of all the videos above.”
Correct, thank you for watching!
you're amazing, Could you please make a course in micro service from scratch in python?
Great idea, maybe in the future
Using selenium on kali nethunter, and I got FileNotFound error when I am trying to use undetected_chromedriver. What should I do??????😢
The `FileNotFoundError` typically occurs when Python cannot locate the file or directory specified in the function call. In the context of using `undetected_chromedriver` with Selenium, this error often arises when the system cannot find the ChromeDriver executable.
To resolve this issue on Kali NetHunter or any Linux system, follow these steps:
1. **Install Chrome/Chromium**:
First, ensure that Google Chrome or Chromium browser is installed on your system, as ChromeDriver requires it to function.
```
sudo apt update
sudo apt install -y google-chrome-stable
```
Or for Chromium:
```
sudo apt update
sudo apt install -y chromium
```
2. **Download ChromeDriver**:
If you haven't done this already, you'll need to download the ChromeDriver executable that matches the version of Google Chrome or Chromium installed on your system.
You can download ChromeDriver from the [official site](sites.google.com/a/chromium.org/chromedriver/). Ensure you choose the version that corresponds to your Chrome/Chromium browser version.
3. **Set the Path to ChromeDriver**:
The `FileNotFoundError` might also be because your script doesn't know where to find the `chromedriver` executable. You can specify the path directly in your script.
```python
from selenium import webdriver
import undetected_chromedriver.v2 as uc
options = uc.ChromeOptions()
# Other options can be added here
driver_path = '/path/to/chromedriver' # update this to your chromedriver path
driver = uc.Chrome(executable_path=driver_path, options=options)
```
Alternatively, you can add the ChromeDriver directory to your system's PATH variable, so it's automatically detected.
4. **Correct Permissions**:
Ensure that `chromedriver` is executable. You can set the appropriate permissions using the command:
```
chmod +x /path/to/chromedriver
```
5. **Update undetected_chromedriver**:
Make sure you are using the latest version of `undetected_chromedriver`. You can update it using pip:
```
pip install -U undetected-chromedriver
```
6. **Check Your Code**:
Lastly, review your code to ensure you're using the correct syntax and functions provided by `undetected_chromedriver.v2`, as there may be differences from standard Selenium functions.
By following these steps, you should be able to resolve the `FileNotFoundError` and successfully use `undetected_chromedriver` with Selenium on Kali NetHunter.
Sir can you tell me why selenium python is closing after executing code whether its correct whether its wrong and is there any way to keep selenium open sessiin alive
First, remove "driver.quit()" as this line closes the browser. If it still closes then use "time.sleep()" at the end of the code to keep the browser alive for x amount of seconds
@@MichaelKitas both did not solve the problem in my case
hi Michael heruku has stopped for free, Could you please using another hosting for upcoming lectures
Sure, will try to find another one as well
Thanks bro, can you make video about bot python by request
Sure, I am making a video on that soon 👍
@@MichaelKitas thats awsome