You don't need NoSQL (use MySQL)
Vložit
- čas přidán 24. 07. 2024
- To learn more about PlanetScale, head to planetscale.com/youtube!
MySQL has first party support for JSON documents and it can be a really nice escape hatch from the rigid structure of a relational database.
To learn more, check out some videos from our free course:
* planetscale.com/learn/courses...
* planetscale.com/learn/courses...
Or some of our blog posts:
* planetscale.com/blog/indexing...
* planetscale.com/blog/the-mysq...
The SQL for the products table shown in the video is available here: www.digitalocean.com/communit....
---------------
00:00 MySQL supports NoSQL
01:15 When to use JSON
04:20 JSON versus TEXT columns
07:00 Efficient JSON storage
07:45 Creating JSON objects with SQL
11:00 Extracting JSON from the document
14:40 JSON arrays
17:20 Querying on JSON columns
18:50 Query an array's items
19:40 Indexing JSON documents
22:48 Generated columns
26:00 JSON blob storage
27:09 Making JSON invisible
29:00 Updating documents in place
---------------
💬 Follow PlanetScale on social media
• Twitter: / planetscale
• Discord: / discord
• TikTok: / planetscale
• Twitch: / planetscale
• LinkedIn: / planetscale - Věda a technologie
This channel pumps out quality database content every week. Definitely deserves more subscribers.
😮💨 I appreciate that
Done!
good point! I just subscribed
Done. Was really a noob mysql Developer hidding behind Eloquent. Now I can review some senior dev codebases. Thanks Franco.
I'm absolutely loving this long-form content, Aaron. So easy to just put each one of these in my `favorites` list. So much value.
Thank you Len! They're a lot of work so I'm glad to hear that
I have never used, and probably will not, but I have to admit, that's incredibly powerful. Super educational information as usual. I think the only thing missing in some videos would be some real-case measurements and testing. For example, there could be two tables: one with JSON elements and another without. We could compare the speed of SELECTs from a million table data. I think this will not only be useful but also very informative about what kind of tables or schemas are more suitable for specific case scenarios. For example It could help us make informed decisions when creating product items attributes in a shop, whether it's better to use JSON or just columns.
MYSQL is really powerful ;)
I don`t really often leave comments but you deserved it)) Ngl, I`ve never seen neither more useful, nor "pleasant-to-listen" tutorials in MySQL topic. The way you, Aaron, explain things to us is out of this world, do love it!
Keep it up, I`m completely sure many people will find it useful!
What a great start to my week, thank you so much!
Three minutes into watching this, and I'm already loving the wonderful variety of use cases you have come up with! Feels like a NoSQL approach within a relational db
Thanks! Kinda crazy right?
@@PlanetScaleright
those videos you make are really great. I worked with mySQL since 15 years ago but I still learn something new and really enjoy the format and your delivery of these topics!
Means the world to me, thank you
This series of videos are incredible, been watching all of them and it really helps me out. Thanks for your work, keep it going.
Thank you! Nice to know it's helping people
Excellent video and resource link to Digital Ocean. I was living in dark ages using MySQL version 5.2x. I upgraded to 8.0.35 and experimented with everything you mentioned in the video. It opened my eyes on how to use MySQL with JSON moving forward. I was using a text field for that before and did not know about all the JSON related functions of MySQL. Thank you very much.
I did exactly that in a postgresql db. This is fantastic, much more solid and fast
Dude you're one of the best teachers I've ever run across on the internet or in person. Thanks for what you do. I love your videos.
This is one of the nicest things I've ever heard. Thank you internet stranger, I really really appreciate it
I love your courses and the way you explain about things. Please keep doing it!
I really enjoyed this tutorial. I'm new to DBs as a whole, getting this insight into how JSON-Documents can be handled independently of a NoSQL-DB will surely be useful. I will hopefully be doing a project for changelog-storage in the near future, where this might come in handy!
I just stumbled across this video and I haven't finished it but I already love it!
I'm still learning about databases but I thought NoSQL was hands down more powerful and scalable than SQL tables, and my previous experience with SQL tables has been a drag, but this is showing me a side of SQL tables I didn't know existed. Thanks!
Wow, i been using MySQL all of my career and this video blown my mind. So much value as always Aaron.
We often have an "options_json" column where we set configurations of things that we don't directly search often. An example would be on our forms builder, the forms settings someone picks we use to generate the form, or even on questions if a certain question type is required or has visibility requirements, etc. It saves scanning a ton of extra columns.
Right, I had kinda assumed that, while you could, you wouldn't really want to search using JSON data columns. I've just been using it for mostly what he mentioned, metadata, settings, and I like the idea of tenant-specific data structures as I'm currently working in a multi tenant app that we're building out integrations for.
Awesome video content as always! Love seeing a video from this channel pop up in my feed ❤
Excellent tutorial. Eloquently and clearly explained and demonstrated.
I saw the field type a few months ago and it blew my mind.
It felt like everything NoSQL was "known good for" just "vanished".
I can just keep using MySQL for most of my stuff :D
I still didn't know about some of the things you showed, so thanks
This is so good, you do an amazing job !! It’s crystal clear, we learn a lot, thank you very much ! 👍
I'd like to add to this. Some of the reasons for using NoSql are being able to store the data in RAM like using Redis for cache etc and also NoSql is scalable. Both of those also possible in Sql databases. You can definitely configure your db to be stored in the memory and you can definitely have a cluster of Sql database. It is harder to scale up relationships with both Sql and NoSql. NoSql just defaults to having no relationships what so ever. That's what makes it easier to scale. If you do introduce relationships in your data, you'll have the same issues. Needless to say Sql databases are perfectly capable of not using relationships
I really liked your tutorials and content. It feels like I learned new functionalities every single video. Keep it up dude!
Thank you!
Unreal the quality of content you are putting out. I've made the decision to not use NoSQL db's for certain services thanks in part to this video. Keep it up. Super informative.
Awesome features at MySql. Thanks for this impressive lesson! Regards from Brazil.
Awesome first contact with your channel :) thank you for the quality content!
🫡 glad you enjoyed it!
This video widened my understanding what can be done with MySQL. Thank you !
I love this channel so much. Aaron, you are the best
🫶 that means the world to me
I know all of the mentioned JSON function but I really didn't know about array range path and the member of operator,
I used json column in many cases but the most useful one was in this scenario:
I have 2 tables, one for user notifications and the other for email queuing, each notification/email has a specific template and parameters according to its type and language,
the problem is that a user can change his display language any time and he should still be able to read his notifications and emails (that are not sent yet) in the selected language,
as you can see here it's not possible to store the notification/email in its final shape, or store it in every possible language,
so I stored all the params needed to render the notification/email in a json column and then merge them with the template at runtime.
Thanks Aaron! it was a great video as expected 👍
That's really clever. I like that example, thanks for sharing!
excellent vid man. keep em coming. great stuff
Currently using a relational DB for a private project after a while of using exclusively MongoDB in the professional context, and this video has a perfect timing to solve one of the issues I had: having a list of (unknown amount of) tags for any row. Currently I am using extra link tables but a json column would do the job in a more elegant manner imo.
Thank you!
Tags are a great use case for sure. Glad it was helpful!
Managed to get me glued to the screen for more than 30 minutes. Cool video
Yesss that's a feat! Glad you liked it
a clear and practical story, told by a passionate and skillfull db teacher
Incredibly useful tutorial. Thank you for putting it together.
After playing around with this today. Some useful notes for MariaDB users:
1.) The ->> operator is a shorthand for JSON_UNQUOTE(JSON_EXTRACT()) in MySQL 5.7.13 and later. However, MariaDB does not support this shorthand operator. You're stuck with JSON_UNQUOTE(JSON_EXTRACT(`jsonObject`, '$.your_key')).
2.) When attempting to create STORED or VIRTUAL columns; instead of STORED use PERSISTENT:
eg: ALTER TABLE your_table ADD COLUMN your_column VARCHAR(255) AS (JSON_UNQUOTE(JSON_EXTRACT(`jsonObject`, '$.your_key'))) PERSISTENT;
3.) The INVISIBLE column feature is not supported in MariaDB. It's a feature introduced in MySQL 8.0.23, which allows you to make a column invisible. In MariaDB, you can't make a column invisible directly.
I almost never touch databases as a frontend, but the videos you make are super interesting.
I’m glad you’re giving me a glimpse into my backend friend’s world and hopefully I can help work with them better
Love to hear that! Thanks for telling me
Great video, thanks!
A few months back I watched your full MySQL course and have drafted an improved version for part of our app utilizing a JSON column.
We have 3 (currently) types of specification/schema from APIs which we need to store for reference before normalizing.
Currently they have all been saved in the same table with column name variations and lots of NULL values for N/A columns, etc 😢
One improvement would be to use separate tables for each type.
Another would be to store each raw specification in a JSON object which is what I've experimented with.
I've used a dynamic cast on the eloquent model to hydrate the data into the appropriate DTO when fetched.
I've also made the JSON column invisible :)
Some common high level stats are in the non JSON columns, and the raw data is there if needed.
Seems like a tidy solution for our needs.
Mazedaar video banate ho Aaron bhai
really thanks for covering this JSON topic.
I had fun. This was amazing. THANK YOU. Trying to manage so many EAVs was killing me, and the idea behind that was having a future analytics integration. This is much easier.
Glad to hear it!
Great content, Aaron.
I have been using the JSON type for quite a long time, but wasn't aware on the index part of that topic (and never was in need of it, yet).
Aside from the typical log scenario (API Tx/Rx), I have been using JSON for event stream data, basically the same, but from an event sourcing view on the domain.
Mmm I like that. Event stream is a great example.
Mindblowing 😮, doesen't know any of this JSON functions. Thank you for sharing!
Didn't know you could create an index on a json array, very useful, and making those blobs invisible is a good tip.
I have so many ideas on how I'm going to use this for supporting custom user defined fields in a CRM I'm building! Thank you!!!
Niiiice! Do report back!
I just love your videos explaining MySQL ♥
🫶 thank you!
Friendly and kind developer you are, sir
complex topic very well broken down, thank you
I had my space ship game allow (no require) players to design their own spaceships, and I stored the designs as a json blob.
But I that was before I knew it could be a json column rather than a text blob. So this is awesome!
Nice! Glad it helped
I didn't expect to watch this whole video. You got me excited about JSON. I've already been using it for some metadata columns, stored as TEXT, for a PHP Laravel project . And as we want to use only Db-agnostic query operations, we've shied away from JSON-specific operations that might not be implemented in any major Db drivers we're using. But after watching this I'm going to dig more into the latest Eloquent query builder helper functions as well as possible common raw syntax that might be shared between our supported RDBMs.
Yessss I'm so glad to hear that you stuck around! You've correctly pointed to a good caveat with JSON, it's not exact across all vendors. But! Might as well use the full power of the DB you've chosen, versus sticking to the lowest common denominator. Excited to hear what you get up to!
OMG, this is mind blowing!!! ❤❤❤
Love this content! My use case for the JSON column type is storing additional data on a task table. We have an automation pice in our platform with workflows that contain stages that contain tasks. Each task type can have different data associated with it. Saves me from having a bunch of nullable columns or cluttering up the database with extra tables for task data. I use Zod to validate the inputs as they go into the table so I get the flexibility of JSON and some schema validation.
Ooo nice thinking to use Zod on top of it.
@@PlanetScale for the Laravel folk, you can do the same by casting your JSON column to a DTO. You will have schema and type validation.
Really good stuff here!
Today(after weeks) I realized that this is an official channel...
I have never seen such a great quality content from an official channel...
🥰 love to hear that.
Amazing video once again! I knew JSON support existed but didn’t know to that depth 😮
Topic suggestion: would love to see a deep dive 30m video on foreign keys: performance, alternatives, when to use vs when too much (ie a massive join table with FKs can be slow inserts), db support (and why?!), cascade behaviors as related to app logic (why null on delete can be bad for app logic), etc. maybe this is covered in your MySQL for devs vid, but can’t remember
Also I find these videos to be a gold mine - any thoughts on doing a (cliche but useful) chat bot or similar product to be able to natural language query your video content?
I don’t have a use case today for JSON, but might want to search PlanetScale or Aaron’s video catalog to see snippets from all indexed videos and jump to specific pieces to re-watch… not sure if others are asking too but might be worth a
Yeah this is a great great great idea. I need to beef up our content on foreign keys. Added to my list!
Also suuuuper interesting idea about a chatbot! Could totally do it, I think
I would love to hear more about subqueries next time, when to use it and when not to use it, as well as the drawbacks.
Nice, I'll do a whole video on that
Radzio jest fajny! Dzięki za video!
Nice video.
Would be good to see some performance numbers on the queries, specially when using them on predicates
Wow this is great content. I have to do some database queries at work and loving these tips and tricks.
Thank you!
This guy is a good dev rel, kudos
Thanks. Excellent tutorial.
Interesting! I am just learning dev and my first foray into it is with WordPress. I know WordPress plugins like Elementor use JSON for the pages you build in them and I wonder if they use this feature of MySQL.
Thumbs up for pointing out the nuances, learning this the hard way as senior engineer could be painful...
In my case I used the JSON column to make sure to get steps that must be followed. This could be changed from task to task, so I realized I could use it instead of just having another NoSQL DB running and waisting resources for this purpose when I can use the same MySQL DB. Of course, this depends on its use and how many times this table will be read and/or written. If iit comes to be a bottleneck for my case I would change it to a single microservice for this purpose but this is far beyond the usage now.
Amazing content! Thank you!
Nice, that's a great use case! Thank you for sharing.
Once again, I am in love with databases and planning to be the SQL Chad. Database with this guy, amazing. Great Content, do MORE. 🌟😃
🫡🫡 more on the way
This is absolutely gold.
🫡 thank you!
Excellent, thank you
Great content! Love it!
Btw, what is this tool you are using to interact with the db?
It's pretty nice to have json in sql. Although still figuring out how to do a where in on a json array.
You are the only guy who derailed the nosql train with already battle tested mature technologies ❤❤❤❤❤
why am I enjoying this content so much lol
🙈 I dunno but please keep watching
great video !
thank you so much
Json in a MySQL field makes so much sense that I have a hard time imagining people that don't see this as an advantage.
Unless you need to store BIG data managing a Json in a MySQL solves so many problems in development and is very flexible if in the future you want to move your Json to a noSQL instead of adding undress of tables and filed and get mad with conversation.
thank you editor
Brilliant !!!
Another idea for JSON data: audit history. For example, don't just have a created_at and updated_at for a user, but also history which contains a log of when the update happened, what changed and who initiated the change.
Audit history is a good one! I actually use JSON for that exact use case in an app I built.
Your videos are great
This info is super useful, at work we are evaluating ditching MySQL for PostgreSQL and get a NoSQL. I know nothing about NoSQL, is it possible to do a second part of this video explaining how these MySQL features compare to NoSQL?
All you need is one table with one row with one cell to store an entire nosql database. Winning!
Mega brain idea
Is there a way to set up a mysql database to natively push updates to tables/rows much like some cloud providers offer?
is this more or less applicable for Postgres' JSONB column support as well?
What about wide column store like Scylla DB? I think hy no SQL he is referring to mongodb. The problem with relational dbs is scaling horizontally
The dollar sign and the array handling are actually part of JSONPath and can be used in jq and other fun tools. I would expect having full JSONPath syntax there.
Oh neat! I didn't know that. Thanks for sharing
I assume that you, as every person on the planet, would like to retire someday. Against that idea, I'd like to ask you never to stop making videos. I love all of them!
It's not happening any time soon 🫶🫡
Thank you a lot!
🫡🫡
I'm soooo gonna use it. I'm not sure about performance wise, for example, you have 100.000 product rows and you want to query their options or another case what about joins between a json attribute with another table.
A use case for that:
- again a product row with json column for its options but you don't want to store the actual name of let's say the color but it's id because if you change color value you have to update all the products that contain this color
03:23 isn't using bits BITINT UNSIGNED (64 booleans per column) better than json because takes less space on disk?
Can you make a video about using json in mssql
been using jsonb for 5 years now, good thing like on postgres, I can index json keys.
Thanks for the explanation. This looks very useful. One question though: When you store a column and subsequently update the value in the JSON blob, will the stored column be updated or should an update command be run on the stored column as well?
Stored generated columns are updated during write time automatically! In fact if you try to update it yourself it'll throw an error
sometimes even if a schema is well defined, putting some properties (like additional data with low redundancy and that isn’t used in queries) in a json blob is a good alternative to enormous tables or one to one relationships.
Holy crap, that 'set invisible' bit blew my mind 🤯
Feels like that could be a standalone video huh! Wild right
Which editor was used here? Looks good and very good tutorial!
Thank you
Wow, never knew this was possible!
Wow .... Head Wall! Link to your videos to team tomorrow.
Incredible, I wonder how this compares to PG's JSONB🤔
Same actually. What are you most curious about: functionality or performance?
I think when it comes to databases like queries, performance really matters
@@PlanetScale performance benchmarks video would be nice
@@PlanetScaleperformance comparison with json postgres please, also with jsonb
Very Very good 👍
So something like an asset register might also be a good case for this hybrid use of MySQL? JSON for the descriptive portion of an asset/component.
Yes, that sounds like it might be a good use case!
I remember in the postgres documentation they describe a scenario where you have many stores in your relational data, and each store is asked to create a survey tailored to their customers - every store has a survey, but they are all unique. I thought it was a good example of data well suited to json (and in postgres, jsonb)
Great video, I am just starting to learn mySQL and postgres for work and this is really helpful as we have a JSON object in our database that I've been asked to generate a useful table for.
Can I ask what software you are using in this video to write your queries and get the show the table results?
It's TablePlus! czcams.com/video/7V_CJBPZPes/video.html
I tried working with json data in mysql, besides the syntax being clunky (compared to postgres) I found it to be super slow compared to structured data, I was processing millions of rows and anything related to json added a significant load on the database sometimes to the point of rendering it useless
I wrote this comment before finishing the video so maybe it's irrelevant
You’re assuming the reason for using a NoSQL database is wanting to store and index json data. I find often it comes down to scaling writes and data volume.
Is there any technical reason at all to use MySQL instead of PostgreSQL? Does MySQL have any redeeming qualities that would make someone choose it over psql?
So how about how to migrate from NoSQL mongodb to Mysql MariaDB