Just Use Pydantic

Pydantic is great for data validation and parsing, giving us a much better option that standard for working with data in Python. In this video I will show you how to create Pydantic models from shopify product json where we don't want to include large amounts of the data. by adding in to our models only the fields we are interested in we can omit the rest of the data and avoid having to write and rewrite complex indexing and gets on our dictionary, improving readability and usage
Scraper API www.scrapingbee.com/?fpr=jhnwr

[@oerickmuller]

Awesome content, concise and helpful. Thanks!

[@graczew]

Good content as always. 👍👍👍

[@JohnWatsonRooney]

thanks mate i appreciate it

[@ericxls93]

Will try this! Thank you. I have use the Spotify rest, but somehow I find their API super convoluted… getting sales and refunds by day is an industry 🤦‍♂️

[@aktiecase]

this is so good, thank you

[@user-mh2zy2gs4w]

I have tried the same method using the dataclasses. I got issue that when declaring the `Product` dataclass, it requires to declare all the attributes in the JSON response, not just `ID` and `title` like in your example.

[@ErikS-]

brilliant example!

[@HermannWinter]

excellent 👍

[@ricardor8044]

What font do you use ? It looks so unique

[@julians.2597]

it's great, but it very slow, by an order of magnitude more than plain classes, simple namespace, named tuples, dataclasses, attrs, etc.
So use it for parsing and validation for which it's made and great, but don't use it as a general purpose data structure.

[@techatival]

Sholdn't be the price mapped to a float instead of a string?

[@thebuggser2752]

Neat!

[@Julian-sn9vc]

Hi! Great video on scraping Shopify data into Pydantic Models! I'm considering using Pydantic with an API and SqlAlchemy for my project. Could you create a follow-up video on mapping Pydantic Models to SqlAlchemy models and then writing the data into a database? This would be incredibly helpful. Thanks!

[@JohnWatsonRooney]

Great thanks! Sure i will do a follow up to include sqla!

[@Hellbending]

Might be worth doing using fastAPI then ;)

[@hoeszyslak6989]

just save your self tons of quality of life issues and use attrs and cattrs instead of pydantic + you get good performance while still keeping your project entirely python... the new pydantic uses rust to solve some problems that attrs already solved ages ago. And it's more reliable because NASA uses it on it's mars rover.

[@MrPsychoTreatment]

Hi John, great tutorial! Is there any reason to use Pydantic over Dataclasses?

[@AnthonyBecker9]

Pydantic gives you powerful data validation and error messages.

[@younesboukroun3060]

pwerful yeh

[@SAMWELLFPS]

please do a Bet 305 odds and how to scrap it

[@roshansirohi3191]

I m not getting didi website data getting 501 response can u give me suggestions please

[@yafethtb]

Can we do this with dataclasses instead?

[@JohnWatsonRooney]

Yes but you don’t get validation

[@yafethtb]

@@JohnWatsonRooney is it like __post_init in dataclasses?

[@user-mh2zy2gs4w]

I have tried the same method using the dataclasses. I got issue that when declaring the `Product` dataclass, it requires to declare all the attributes in the JSON response, not just `ID` and `title` like in your example.

[@ZainAli-hq1gu]

upload the on your repo