Scraping Dark Web Sites with Python
Vložit
- čas přidán 8. 04. 2024
- jh.live/flare || You can track down cybercrime and manage threat intelligence or your own exposed attack surface with Flare! Try a free trial and see what info is out there: jh.live/flare
🗨️ Scraping onion sites across Tor hidden services in an automated way -- quick crash course on some of the command-line tools or Python libraries that can help you create your own custom monitoring tools for cybercrime. 💬
Learn Cybersecurity - Name Your Price Training with John Hammond: nameyourpricetraining.com
📧JOIN MY NEWSLETTER ➡ jh.live/email
🙏SUPPORT THE CHANNEL ➡ jh.live/patreon
🤝 SPONSOR THE CHANNEL ➡ jh.live/sponsor
🌎FOLLOW ME EVERYWHERE ➡ jh.live/twitter ↔ jh.live/linkedin ↔ jh.live/discord ↔ jh.live/instagram ↔ jh.live/tiktok
💥 SEND ME MALWARE ➡ jh.live/malware
🔥CZcams ALGORITHM ➡ Like, Comment, & Subscribe!
Respect ngl, this man took his full setup to a hotel across a long trip just to make this video available for us.
His full setup equalling a laptop and microphone?
@@kyleheaney3734 laptop, mouse, microphone, camera
Here, have a like for the hotelroom video.
Dislike button ⬇️
By far my favorite channel for authentically practical guidance
Thank you .
(Here from linkedin btw) This is badass. Great work on the video, seriously.
Definitely work that subscribe (I already was), and a thumbs up!!!! 👍👍
collab w bro
I'd love to. Dudes a legend. @@user-bc4gp4nr5v
@@user-bc4gp4nr5v dp
This is an amazing video, and the hotel room was the perfect fit for a darkweb video. 🙌🙌
More videos like this! This is extremely useful and really applicable to many things. Love basic concepts that can be applied to many things.
You shouldn't recommend torpy since it only supports v2 addresses... which haven't been supported on tor since July of 2021, and they haven't had a new commit in 3 years. Essentially, torpy will not or should not work with tor anymore and until they start updating the project ( unlikely ) or someone forks it, it shouldn't be promoted.
Damn 2021 was 3 years ago
@JH - Excellent information 👏👏👏. I can use this Python "web scraping" utility right now.
Absolutely love this. Really am grateful for helping me expand the knowledge and projects ideas 🙏🏼
Looks like john is recording somewhere else.
Thank you for the video 😄
Interesting, I’ll watch later🎉
Love your videos.
00:04 Automating web scraping of dark web sites using Tor
02:15 Enabling control port and authentication methods for security.
04:24 Monitoring dark web for security threats and data exposure
06:32 Scraping dark web sites can provide valuable information for businesses and individuals.
08:35 Using Python to scrape dark web sites
10:47 Accessing dark web sites using Python Requests library.
13:00 Exploring a ransomware gang's exit scam and law enforcement operation on a dark web site.
14:57 Scraping Dark Web Sites with Python
16:52 Configuring control Port for authentication and IP manipulation
18:37 Explore dark web marketplaces for insights.
Did you use some sort of website or an AI to write this? It's weird that you did it in around 3 minutes for a 19:28 minute video.
@@KwiatekMikiObviously.
@@KwiatekMiki speed matter
AI
Great info thanks.
Here after the video and it was good.
Amazing vid u could use libraries aswell like selenium or beautifulsoap
Great Work John! When are you coming to Germany?
sponsor transition smooth, on point and relevant
Had this on my second screen. There was a Sponsor?!
@@neutrino2211_ mans becoming a smooth operator
Sadly this isn't practical for the dark sites I want to read. They get hammered and have too many anti bot protections. I'd love to keep up in an RSS reader or something.
This dude is a genius.
My issues are with finding all the different onion links that could be used to scrape, tor links themselves are hard to find, is there anyway of automatically crawling for onion links to scrape?
would it be possible to write a scraper, where you feed it with an adress and he is searching for adresses in this adress and stores them in a data base besides a bunch of information. At the beginning you manually feed it with links and later it is just constandly running and storing links in its database... and here we go.. torch 2.0? Is it more or less working like this? A search engine?
Oh I missed the first like :( , anyway I love you John :D
All you ever need it a for loop and curl
Would Microsoft Defender for Endpoint do the same job as Flare or better?
Hi. I want to extract the data (result history) on a virtual gaming site. can you help me?
omg if you add a voice obfuscator to your demeanor, i see a different david bombals special guest but since i love it i wont be spilling anyones beans today. after all not all of us need a alter ego that lives on the other side of the fence but for some it helps tremendously. now for the word ubiquitous, can we pick a new word this year finally>? everyone has played it out.
How do I know the python library is not injected with malicious code?
i’d like to have a tor crawler to index all the sites and their pages. then that could lead to the rest
Can you explain activating ssh with proxy on the victim’s device to configure the firewall?
How would this work when darkmarkets require captcha to view there site? Thank you in advance
nice new darkweb video
Hey John, I am a victim of someone hacking my multiple accounts gmail microsoft Facebook twitter etc maybe through my phone or somehow they got access to my Google password manager, Is there any safety steps I can take other than changing password and adding 2 factor authenticator app? Any help is appreciated.
Use a password manager like keepassxc to store passwords and generate random ones, don’t re use passwords
11:18 why RequestsTor needs cport=9051 but there was no 9051 in curl command (08:40)?
As he explained at 8:40 curl does not care about that port, it is not where the proxy resides. cports stands for control ports, and that's what 9051 is for.
Curl only needs the proxy, which is on port 9050, and at 11:18 he indeed did give RequestsTor port 9050 as the proxy port.
Edit: as for why RequestsTor even needs the control port, no clue
Totally not hateing u!
Man sad, man see video, man happy
Man gay
😂😂😂
GREAT WORK
Enjoy your trip and don’t forget to visit Morocco you going to like it 👍👍👍👍 🇲🇦🇲🇦🇲🇦
Blud is on the run
at first i was confused on how to scrape the or site but after watching it i got it
not going to lie - i relate better with legacy setup pf john hammond, +1
Bro really making a tutorial on how to make a dark web crawler to find illegal websites
In a hotel, might as well do some darkweb work ;) lmao
Hotel room videos feel oddly relatable...
upvote for a bathroom video next :D
bro i got like 30 ads in this video what's going on
That’s called “CZcams.”
I got zero its called "ad blocker"
@@TheRealLoganJosh No. They *can* select when. I didn’t get that many ads in this video which proves the creator made zero input on when, where, and how many ads would play on this video. It was CZcams doing typical CZcams shit.
were you sponsored by flare or did you like flare
Of course he were sponsored.
You set it to zero so the police won't show up at your door right?
Scraping mhm
Interesting video. Great advertisement Segway. Incredibly useful info, dreading what you could actually do with this.
Hello. Could this technically be used as a free proxy?
Pythons scare me
I immediately know people gonna use this for ummm Effed up means 🤢💀
Sorry for a millisecond though of Seth Rogen
The "Torpy" Project seems pretty dead to me. Sad.
John notice me before I leak your public IP 🥺
Pm tranquilizer
please 1 video how to hacked gmail password please please new video
🙏🙏🙏🙏🙏🙏
Say bye bye to that hotels wifi network.
you have way too many ads. This aint a vevo music video lil bro.
LOL you are wild showing people this. You know what's within that. Now you're going to get some little kid like "Let's go get the bad guys" and accidentally come a cross a site which will scar them for life. Well done. HAHA.
Nice one CZcams, changing the bell to either ALL or PERSONALIZED automatically defaults back to NONE. At least with Edge, maybe try a different browser though.
Don’t use flare it will leak more info from you and gather it and pin it to you and you don’t want that don’t fall for this use your own infosec tools
Websocket ko bina authentication ke kaise implement kare? Mujhi 403 error de rha hai maise /ws ko permitAll kiya tha
damn
Dm
This is soo old school
so not trying to be buzzkill but mine didnt work
Super duper 420 eyes 😂
Old market of edg ppl y can by weapons womens any thing y can build empire with it...😂😂like the real map of world y know map lead to treasure sow they give the wrong map😂😂😂evwn earth map
I really don't like y'all nsa ...... I will be getting biofuels release record
R u on crack
use vim instead of nano if you have balls.
Hello, I want to get into the the software engineering but because of financial sitiations I am having issues paying for tuition
So if there is anyone who is willing to help by offering to pay for small tasks so I can afford to pay monthly payments for a student loan please let me know
Please stop it! Advertising on you channel is overwhelming and even though I was considering being a member I considering to put you channel on my black list in the end.
And now millions of script kiddies are going to waste tor bandwidth... nice.
i like woman_SytsOnMyFayce