The Truth About Devin AI and Website Scraping

👋 Hi everyone! In today's video, I'm thrilled to demonstrate the next level of testing for Devin, focusing on scraping my website, m.vin. We'll explore whether Devin can handle the task of extracting all content, converting it to markdown, and zipping it for download. Watch as we navigate through basic to deep web scraping phases, showcasing each step in detail. The Truth About Devin AI and Website Scraping
👨‍💻 What to Expect:
Initial setup and scraping request to Devin.
Progression through website pages and converting them into markdown.
Challenges and solutions in deeper web crawling.
Final results and how to handle them for SEO optimisation.
🔗 Make sure to subscribe and hit the bell icon to stay updated with our latest videos on artificial intelligence applications. If you find this video helpful, don't forget to like and share it to help others!
🔗 Resources:
Patreon: / mervinpraison
Ko-fi: ko-fi.com/mervinpraison
Discord: / discord
Twitter / X : / mervinpraison
Timestamps:
0:00 - Introduction to the video
0:17 - Overview of the scraping task for Devin
0:38 - Initial scraping setup and execution
1:20 - Reviewing the scraping process and outcomes
2:03 - Adjustments and deep crawling exploration
3:07 - Detailed results of the deep crawl
3:57 - Tips on specifying content extraction for better results
5:25 - Upcoming topics and SEO optimisation tips
#DevinAiSoftware #DevinAiSoftwareEngineer #Devin #DevinAi #Ai #ArtificialIntelligence #SoftwareEngineer #AiSoftwareEngineer #SoftwareDevelopment #DevinSoftwareEngineer #CognitionAi #CognitionLabs #Cognition #DevinEngineer #AiSoftwareEngineerFeatures #DevinSoftwareAi #DevinArtificialIntelligence #DevinSoftware #AiSoftwareEngineerDevin #WillAiReplaceProgrammers #WhatIsDevin #DevenAiSoftwareEngineer #WorldsFirstAiSoftwareEngineer

[@swatantra26]

Devin trying hard to change narrative..pure PR..I see more and more influencers been roped by Devin to do positive spin..

[@karkonda5653]

Hi Marvin, Thanks for all your very informative videos. I have used some of your RAG workflows with good success. I have a suggestion about letting your subscribers know the best way to take an AI project based on open source LLMs to production mode i.e any alternatives to Ollama etc. 🙏

[@TreeYogaSchool]

Great video - you are really helping and inspiring me a lot.

[@MervinPraison]

Thank you

[@IdPreferNot1]

Does your website have any anti-scraping measures. Can Devin scrape a site with a site with even minimal anti-scraping implemented?

[@m12652]

Last team I managed had a guy tweaking the scraping scripts every week or two to get round the blockers and layout changes. It's normal... what would be more useful would be to scrape competitor prices, offers and product details without having to scrape entire pages. Our scraping code wasn't intelligent btw... the devs simply browsed, got the xpaths of the objects of interest and hard coded them. Fragile to layout changes etc. and labour intensive as hell so any step forward's a win in my book.

[@MervinPraison]

True. In regards to this implementation you don’t need to worry about xpath changes

[@chandrasuriya5766]

Could you pls ask devin to create a fullstack social media website clone with react and backend django rest framework?

[@AestethicSounds]

Deep crawler super demanded feature, but Mervin how did you got access to Devin? Please share with us ❤

[@MervinPraison]

I requested access as everyone did, but I believe luckily I was chosen one of the many

[@7polletes]

Hi Marvin, what was the cost for all this work with Devin?

[@MervinPraison]

Preview version is free 😊

[@gazania1530]

Can you give me devin website i want to use it ​@MervinPraison

[@mincraftrddp]

Bro, why do only you have access? Nobody else has it on CZcams. I've tried writing to them countless times, but they won't give it to me either.

[@MervinPraison]

Probably Lucky . Even I didn’t expect

[@mincraftrddp]

@@MervinPraison Ask him to create something complex, like a 3D game. Let's see how he handles it.

[@good_vibes_20]

​@@mincraftrddpwait till you find out what it can do! I'm excited for you! It's a master conductor.

[@user-gr8on2pc5y]

hello,
Mervin Praison
can you please make a video of devin AI building a discounted cash-flow model to make a valuation of a publicly listed company like Tesla to see if it is under-priced or overpriced and let devin use data from the SEC FILLINGS like the 10K, 10Q reports and other financial data from yahoo finance in a spreadsheet either in excel or google docs
thank you

[@MervinPraison]

Can you please provide more details in regards to discounted cash-flow model?
Do you want a fine tuned model ?

[@HyperUpscale]

What is this DEVON mentioned 4 times in the video description?

[@MervinPraison]

Thanks for letting me know. Fixed now :)

[@user-en4ek6xt6w]

Thanks for the video

[@MervinPraison]

🙏

[@anujgupta3131]

That means ai is not fake.... Am i right mr marvin
Mr what's ur opinion over youtubers video on devine debunking

[@deretano_fondelli]

Most likely fake

[@ingenierofelipeurreg]

Pls share link to subscribe to devin