Massively Speed Up Requests with HTTPX in Python

In this video, we learn how to massively speed up web scraping with asynchronous requests in Python, using the httpx module.
◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾
📚 Programming Books & Merch 📚
🐍 The Python Bible Book: www.neuralnine...
💻 The Algorithm Bible Book: www.neuralnine...
👕 Programming Merch: www.neuralnine...
🌐 Social Media & Contact 🌐
📱 Website: www.neuralnine...
📷 Instagram: / neuralnine
🐦 Twitter: / neuralnine
🤵 LinkedIn: / neuralnine
📁 GitHub: github.com/Neu...
🎙 Discord: / discord
🎵 Outro Music From: www.bensound.com/

[@frostiiify9505]

Nice! I have never worked with HTTPX, so this is really interesting to me. Would love to see more!

[@suomynona7261]

I’m happy you still posting! Thanks for what you do.

[@tamgaming9861]

Ich habe mit einem 2 Jahre alten Video von dir gestartet - und hatte gehofft dass du immer noch postest ... klasse das du es tust!

[@justas3000]

Big ups for all the stuff you do man! All videos are very clear, concise and on point. Keep it up

[@oguzhantopaloglu9442]

I agree, he makes videos about libraries that nobody fucking knows a thing or two about and those libraries are actually awesome

[@sumitsingh-CANDY]

❤ just learned new thing !!

[@ahmadowaihan9349]

this video was very helpful! exactly what I needed :) keep it up! (this vid was suggested to me at random lol)

[@noertri618]

Python 3.11 + httpx = 🔥🔥🔥🔥

[@tony_jin]

Thanks a lot for the video! Does "httpx" work with webdriver from selenium?

[@aryankothari4634]

Have you covered python queue.Queue() with threading?

[@dot_dot_pwn2650]

You're awesome dude, loving your new pace. Keep up the great work.

[@makankananian3838]

are the async requests that we gather in the same order as the URLS list??

[@Jelvix]

Awesome video! We talked about a similar topic on our channel a few videos ago!

[@praveenkumawat2662]

wow, it works amazingly. Thanks for sharing this

[@swarnodipnag]

Love from India. 4th comment.. daily viewer .. python lover ❤️🫂

[@ken6349]

does this cause 429 error? (too many requests error). if done in bigger scale

[@oguzhantopaloglu9442]

This is INSANE!

[@benlong1062]

This was a good one, really interesting.

[@clxymox]

very interesting, it is possible to also have the url that we are testing with the return 200

[@throwyourmindat]

Hi ,
I tried executing HTTPX POST method, but it is returning 419 instead of 200. the calls are similar to what I used to do with request.Session.. can you please create a view on POST call. what is the trick to make it work ?

[@RavanaMad]

The difference between accepting GET or POST requests is defined on the server side. GET carries request parameter appended in URL string while POST carries request parameter in message body which makes it more secure way of transferring data.

[@throwyourmindat]

@@RavanaMad thanks it's been 7 months now. It was https post specifically. I have figured out already

[@AhmdsYT]

4:29 using httpx

[@davehawkins5265]

Great video!

[@2ru2pacFan]

Thanks!

[@InvestLarge]

Comment for the algorithm :) Perfect video lesson

[@pamdemonia]

Very cool.

[@connectrRomania]

Is this efficient on getting access to different ip camera addresses

[@jaspreetsingh9688]

Can you solve rubik cube with python if yes then please make video

[@miguelhyto54]

4:30

[@agnichatian]

books to scrape is huge malware site now