Introduction to NoSQL • Martin Fowler • GOTO 2012

Sdílet
Vložit
  • čas přidán 28. 08. 2024

Komentáře • 390

  • @hynjus001
    @hynjus001 Před 8 lety +93

    Martin Fowler is just amazing

  • @nikitadrozdovskii2140
    @nikitadrozdovskii2140 Před 2 lety +48

    I wish I could add an extra "like" every time I agree with what he is saying or he blows my mind with how he puts all the concepts I learned separately into one global picture.

  • @giorgosargyriou5856
    @giorgosargyriou5856 Před 9 lety +158

    I don't know if I am young or new in the subject, but that's what I call "perfect teaching". This guy is amazing!
    For many years I was disappointed from my professors and their (in)ability to teach contagiously. This man justifies my (so called) nagging.

    • @jameswainwright5217
      @jameswainwright5217 Před 8 lety

      +Giorgos Argyriou He's very impressive.

    • @NJ-wb1cz
      @NJ-wb1cz Před 8 lety +4

      +Giorgos Argyriou You have to keep in mind, that he is not only teaching, but also promoting. As in, he sort of glosses over the fact that the vast vast majority of your real projects will never ever need NoSQL as your primary data storage, and using NoSQL database where you really need something relational is a far more expensive mistake, than the other way around.

    • @NJ-wb1cz
      @NJ-wb1cz Před 8 lety +4

      ***** Yeah, he promotes NoSQL in general, not as a replacement - but that's what people inevitably take out of such well constructed presentations. The fact is, most developers already use relational DBs for everything and to insert NoSQL in your workflow you have to replace SQL in some way.
      Now, if you are using filesystem or in-memory hash table as your storage engine - then yeah, NoSQL could extend your horizons with very little performance hit. Otherwise you are incurring these massive penalties on architecture or feature set or extendability or stability of your applications in the name of mythical features or performance levels that you don't actually need.
      He doesn't spend much time explaining, which NEW problems are now solvable, and which of the old ones are definitely NOT - he spends most of the time straight out praising NoSQL.

    • @NJ-wb1cz
      @NJ-wb1cz Před 8 lety

      ***** See, you're doing it even worse.
      People think "fast and scalable? well duh, I need fast and scalable everywhere!" Except you don't mention, that "fast" could mean "slower than MySQL or Postres on real workloads", and "scalable" could mean "scalable far beyond what you'll ever need or use", and you also don't mention "forcing simple data structures", "rigidity of data representation", "inability to make deep changes", "inability to use any sort of advanced cross-cutting analytics", "unpredictable performance on very similar tasks from business perspective", etc.
      So no, if the purpose is truly to have a fast and scalable database, then you have to return to planning stage and completely change your decision process to better reflect actual needs of your application and not some generic marketing-talk.

    • @NJ-wb1cz
      @NJ-wb1cz Před 8 lety

      ***** So... why then reply at all if your answer is misleading and incomplete, and people shouldn't take it into consideration?

  • @kirankartheek5858
    @kirankartheek5858 Před rokem +8

    Its just mindboggling to imagine about the level of clarity Martin speaks with. There are some people who attract you with their oratary skills and I pledge this guy is one such kind

  • @andriinikitin6139
    @andriinikitin6139 Před 3 lety +6

    This video gave me more than 2 days reading articles and watching other vids non-stop

    • @Markcarleous1903
      @Markcarleous1903 Před 11 dny +2

      Its 10days and still reading, he is amazing put all of the high level stuff in a clear manner now I can read all of them individually

  • @hnasr
    @hnasr Před 7 lety +47

    21:40 most important part of the presentation. How to make a choice between relational and nosql...

  • @TheMako101
    @TheMako101 Před 2 měsíci +1

    Amazing that 11 years later his talk is still massively helpful and a great intro to NoSQL DBs

  • @cliveboulton
    @cliveboulton Před 10 lety +10

    The best NoSQL talk I've come across.

  • @pawel753
    @pawel753 Před 4 lety +19

    40:40 the best explanation of CAP theorem I've ever heard (+ previous example of booking a hotel room at 37:52)

  • @marcdraco2189
    @marcdraco2189 Před 8 lety +33

    Just great! What a gift to be so fluid and yet so comprehensive.

  • @kevinzhang8974
    @kevinzhang8974 Před 8 lety +19

    Excellent presentation. Simple, plain English and examples to help understand the basics of NoSQL concept. Thank you Martin! Kevin

  • @MoizRaja
    @MoizRaja Před 9 lety +8

    Martin Fowler is very good at "distilling" complex stuff into easy to understand concepts. Excellent talk!

  • @slavikzorin6906
    @slavikzorin6906 Před 10 lety +5

    Martin is the most lucid speaker on pretty much any complex topic in computing. I love this 50 minute talk. A great intro into the NoSQL movement. I did think that the explanation as to why NoSQL may succeed where OODBS failed was no so convincing and would have loved to hear more on this particular topic. Highly recommended!

  • @EssamAlmuqri
    @EssamAlmuqri Před 10 lety +3

    It's been sometime since I started looking for what is NoSQL and what the fuzz all about. I think this video is simply my answer.

  • @brandonhunter3036
    @brandonhunter3036 Před rokem +3

    10 years later and this was very accurate.

  • @saggie1984
    @saggie1984 Před 7 lety +3

    Glad that I found this video. Explains almost everything you need to know about NoSQL. Speech is absolutely perfect.

  • @decki86
    @decki86 Před 8 lety +41

    if only everyone teaches like this...

  • @nagaraj-ol3xe
    @nagaraj-ol3xe Před 8 lety +6

    One of the best intro about NoSQL Dbs and especially the CAP theorem

  • @vijayamurugand6407
    @vijayamurugand6407 Před 10 lety +4

    Martin your talk made me understand a hell a lot about NoSQL Which can't even gained after 2 years of practical experience. If someone had kind of presentation for SQL it might have been used better in the industry. It's best!!

  • @DoNuT_1985
    @DoNuT_1985 Před 10 lety +5

    I was just thrown into NoSQL for a project a week ago and found this very interesting, as well as entertaining.
    It's really hard to get rid of all these ORM-related paradigms first, but I love the relief that comes with simplicity.

  • @pdxholmes
    @pdxholmes Před 10 lety +1

    Great introductory talk. The best part of it was that he didn't take a giant steaming dump on relational models which a) still pay most of our bills in direct or indirect ways, and b) still absolutely have a place in the world of data. I think his premise of 'polyglot persistence' is absolutely where things are headed. I've already seen some pretty neat implementations using RDBMS as the final authoritative backing store, but having clustered MongoDB instances as mostly-fresh satellite caches.

  • @parishchic97
    @parishchic97 Před 2 lety +6

    This was a fantastic presentation! I am fairly ignorant to all of these concepts, and I am walking away with a better understanding of each. Thank you!

  • @anandakumarsanthinathan4740

    Brilliant presentation. Today is the 16th of December. His birthday is two days from now. Happy birthday, Martin Fowler.

  • @nishikanttayade7446
    @nishikanttayade7446 Před 3 lety +2

    He is THE BEST teacher I ever had!

  • @shrutighughal8171
    @shrutighughal8171 Před 8 lety +4

    That's much better explanation of CAP theorem than what you typically find online...

  • @PlatformsLLC
    @PlatformsLLC Před 11 lety

    Martin Fowler has done more to help me be a better coder than anyone else alive. His book on refactoring is the single most useful practical programming text I've ever read. Thank you sir!

  • @delpher1983
    @delpher1983 Před 7 měsíci +5

    It's 2024 already but it feels like we're still don't know mush on how to actually use nosql properly.

  • @westfield90
    @westfield90 Před 5 lety +1

    I found this to be one of the best presentations I’ve ever seen. It was very clearly explained. I wish he would do a follow up now 6 years later and revisit this space and how has it changed or is it still pretty much back where it was in 2012, As a complete Noob I’m wondering what has changed in the past six years.

  • @xxy2109
    @xxy2109 Před 9 lety +2

    Great intro. To sum up, NoSql is being used because of the big data and impedance problem of relational database. There are 4 categories: Key-value, document store, column family and graph. The first 3 are aggregate-oriented and all 4 are schemaless; NoSql are good for using one kind of aggregate constantly and it needs to handle trade off between consistency and availability(or response time), which usually is a business decision. NoSql is not only good for big data, also for easier development.

    • @indikaGreat
      @indikaGreat Před 8 lety

      +Xiangyang Xiao Nice summary. thanks

    • @robertshilt3431
      @robertshilt3431 Před 7 lety

      This is great. I heard that UnitedHealth group is hiring a MarkLogic
      NOSQL Development role, let me know if you want to hear more.

  • @brynncurry6112
    @brynncurry6112 Před 9 lety

    Great breakdown of NoSQL. I appreciate the part of the talk where you show the graphic of using multiple data storage types to meet a systems needs using polyglot persistence. This video has made me think even deeper about the full systems interaction between the different data stores.

  • @TheOceanLoader
    @TheOceanLoader Před 10 lety

    Great explanation of the different models of NoSQL databases. Martin Fowler does his usual breakdown of complicated subjects into informative presentations.

  • @lalanashree3962
    @lalanashree3962 Před 5 měsíci +1

    Wholesome video, which covers every topic of NOSQL !!!

  • @FeelsDonkMan
    @FeelsDonkMan Před 4 lety +1

    Fantastic talk, really interesting. Going through something similar now. I think one of the other things about aggregate databases is that because there's no explicit schema, documents can end up in unexpected states, unless you verify everything before an update via the implicit schema which is not very feasible. You basically can't tell how something went wrong in your documents at that point which is pretty worrying.

  • @srinivasanisetty6894
    @srinivasanisetty6894 Před 8 lety

    Splendid method of introducing to the concept of NoSQL. Must watch for anyone new to this domain. Thankyou Martin.

  • @ZFlyingVLover
    @ZFlyingVLover Před 8 lety +2

    If it's a 'strategic' or 'tactical' project you STILL need to consider how the data will be used. You don't just select NOSQL for the sake of using something new.
    If you select nosql for a stategic project w/o understanding how the data will be used you better line up your next job fast.

  • @Sebastinator
    @Sebastinator Před 2 lety +1

    This dude is amazing! Will watch all his conferences!

  • @MessiahTheMessengerOfGod

    Martin Fowler, is a great man. The conference is perfect !

  • @scottgardner4421
    @scottgardner4421 Před 11 lety +1

    Very clear presentation about the history of databases & comparing relational vs. NoSQL. It's entirely logical that one application should utilize separate database technologies to serve the various storage needs of the app, i.e., a relational database for transactional data (subject to diverse queries) & NoSQL for more linear aggregation (polyglot persistence). However, I think emerging from this will be individual solutions that, under the hood, utilize multiple persistence technologies.

  • @somethingrookie
    @somethingrookie Před 7 lety +1

    It was really great listening to this. Clear cut concept for a beginner. Thanks a ton :) and a down thumb for the audience.

  • @onteigening
    @onteigening Před 10 lety

    Fowler is one of the best OOPSLA speakers I've heard.

  • @jordanradkov2910
    @jordanradkov2910 Před 10 lety

    Great Vid. I often find myself losing focus during such tech talks, but that was not the case here! Props to Mr. Fowler !

  • @laexpearl
    @laexpearl Před 10 lety

    Great talk on NoSQL by Martin Fowler. Incredibly articulate.

  • @pinkylover911
    @pinkylover911 Před 2 lety +2

    not only an excellent instructor but also super funny

  • @ckakunje
    @ckakunje Před 6 lety

    Always feels good to listen from the Guru.

  • @JohnDB101
    @JohnDB101 Před 4 lety +1

    Quite a lot of content out there trying to explain NoSQL. This video really knocks it out of the park. A must if you are new to NoSQL. Loved his quip on "who wants to be seen wearing XML in public".

  • @MrOptimystic
    @MrOptimystic Před 10 lety +1

    Great Talk. Highly recommended to spend an hour to learn some new stuff.

  • @johnhammer8668
    @johnhammer8668 Před 7 lety +1

    The problem is once I listened to the amazon engineer talk where he advised to use sql till u reach 10 million users as Postgres sql and MySQL are very stable and one will find all the answers to the problems since it has been for a long time. Thus I wonder which will save time.

  • @SudarshanKrSingh
    @SudarshanKrSingh Před 6 lety +2

    Excellent introduction of NoSQL :)

  • @Selvanavy
    @Selvanavy Před 11 lety

    What a great presentation.. He absolutely knows what he talks..

  • @sigmundkreuzer9655
    @sigmundkreuzer9655 Před 10 lety

    A great presentation over the different NoSql approaches. Thanks for sharing.

  • @johnnyodonnell4952
    @johnnyodonnell4952 Před 8 lety +11

    The king

  • @LucasKjaero
    @LucasKjaero Před 8 lety +1

    Good talk, and I agree that it's good to know multiple ways of storing data. He explains things well. However, I question the recommendation of using the immature and experimental technology for your mission critical systems: it's probably better the other way around.

  • @venknar
    @venknar Před 9 lety

    Awesome talk and good introduction to NoSQL storage solutions. Must watch for getting to know the basics of NoSQL

  • @jayeshchandrapal
    @jayeshchandrapal Před 11 lety +1

    Very well thought out, and steady continuous stream of presentation. Thanks for sharing.

  • @anand94087
    @anand94087 Před 10 lety

    WoW ..great explanation about NOSQL and I realized the importance of NOSQL vs RDBMS

  • @ghutchison1
    @ghutchison1 Před 11 lety

    Awesome video. I was working on a talk about how to introduce database technology into a second course in Computer Science for High School teachers and Martin's talk gave me some excellent ideas.

  • @MrRahulKumarKandula
    @MrRahulKumarKandula Před 8 lety

    Such a Brilliant talk. Got the hang of NoSql databases. Thanks so much.

  • @craigbryant3191
    @craigbryant3191 Před 4 lety +2

    In surveying the NoSQL landscape, I see three broad classes of database:
    1. The Object Databases, who weren't invited to the party because no one thinks they're cool anymore and it's clear they're not going to dethrone SQL.
    2. The Graph Databases, who are very interesting and do things SQL isn't good at, but are...kind of bewildered that they've been inducted into this "movement" when they're just trying to find neat ways to calculate Six Degrees of Kevin Bacon.
    3. The Aggregate Databases--a perceptive and illuminating category--which are really a reactionary group, in that they want to go back to a world before RDBMS and revive the hierarchical data models of the 1960s and 70s. They have all the problems of the old hierarchical systems (it becomes nightmarish the moment you want to look at the data from some different angle, child records that refer to the same thing in the real world can't be kept consistent with each other), plus the brand-new one of inconsistent formats, because schemas are an intolerable restraint on developers coding things however they want from day to day.
    There's probably a good use for every one of them--sometimes you just want a really good hash table!--but NoSQL came to prominence at a particular moment when RDBMS was struggling to cope with scale and distribution. And that looks to have been a moment, not a trend.

  • @NirdoshChouhan
    @NirdoshChouhan Před 11 lety

    I learned lot out of it. Earlier concept from what all option available really good.Thanks Martin fowler

  • @IsidroMoran
    @IsidroMoran Před 11 lety

    Best noSQL intro ever seen

  • @michaeldeng1981
    @michaeldeng1981 Před 11 lety

    Every developer must see this.

  • @DavidRossIsHere
    @DavidRossIsHere Před 10 lety +1

    "I can only ever remember what it means on Tuesdays." Oh man that joke died so hard I was pissing myself laughing.
    Fantastic presentation BTW. This should be the first point for everyone to understand NoSQL.

    • @goph999
      @goph999 Před 10 lety

      so what did you understod?

  • @feraudyh
    @feraudyh Před 11 lety

    Very clear as usual with Martin Fowler

  • @eicoz
    @eicoz Před 2 lety +2

    Nice presentation from past 👍🏻

  • @alvinkpoto2993
    @alvinkpoto2993 Před 7 lety

    Beautiful Presentation and excellent demonstration of skills and knowledges

  • @fethiourghi
    @fethiourghi Před 4 lety +1

    Martin Fowler, thanks you are the best

  • @colloredbrothers
    @colloredbrothers Před 5 lety

    I see his name pop up constantly as an authority figure on architecture, its quite amazing actually how well respected he is, seeing him talk for the first time I don't doubt that that respect is well placed.

  • @sunilphanimanne
    @sunilphanimanne Před 6 lety

    The best ever session that I have seen!

  • @mingfai22
    @mingfai22 Před 11 lety

    Every modern developer should watch it

  • @csl1384
    @csl1384 Před 4 lety +9

    46:30 "I've got some friends who work at *The Guardian* newspaper ... the article for them is a natural aggregate ... for them spreading that article accross relational databases is a *pain in the neck* ..."
    Later: "some NoSQL databases are *immature* , we don't have the tools, the experience, the knowledge to work with them well; we've got decades of experience with sql databases"
    Fast forward to 2018 (www.theguardian.com/info/2018/nov/30/bye-bye-mongo-hello-postgres).
    The Guardian: " *Bye bye Mongo, Hello Postgres* ... We decided to purchase OpsManager - Mongo’s database management software - along with a Mongo support contract - to help with the cloud migration ... Due to editorial requirements, we needed to run the database cluster and OpsManager on our own infrastructure in AWS rather than using Mongo’s managed database offering. This was non-trivial, as *Mongo didn’t provide any tooling* for getting set up easily on AWS - we needed to hand write the cloudformation to define all the infrastructure, and on top of that we wrote hundreds of lines of ruby scripts to handle installation of monitoring/automation agents and orchestration of new DB instances ... Since migrating to AWS we’ve had two *significant outages due to database problems* , each preventing publication on theguardian.com for at least an hour. In both occasions *neither OpsManager nor Mongo’s support agents were able to help us much* , and we ended up solving the problem ourselves ... Automatically generating database indexes on application startup is probably a bad idea ... OpsManager *didn’t really deliver on its promise* of hassle-free database management. For instance, actually managing OpsManager itself - in particular upgrading from OpsManager 1 to 2 - was *very time consuming* , and required specialist knowledge about our OpsManager setup. It also *didn’t deliver on its “one-click upgrade” promise* , due to changes in the authentication schema between different versions of Mongo DB. We lost at least two months of engineering time a year doing this database management work. All of these problems, combined with the *hefty annual fee* we were paying for the support contract and OpsManager, left us looking for an alternative database option ... Since all our other services are running in AWS, the obvious choice was DynamoDB - Amazon’s NoSQL database offering. Unfortunately at the time *Dynamo didn’t support encryption at rest* . After waiting around nine months for this feature to be added, we ended up giving up and looking for something else, ultimately choosing to use Postgres on AWS RDS.
    “ *But postgres isn’t a document store!* ” I hear you cry. Well, no, it isn’t, but it does have a *JSONB column type, with support for indexes on fields within the JSON blob* . We hoped that by using the JSONB type, we could migrate off Mongo onto Postgres with minimal changes to our data model. In addition, if we wanted to move to a more relational model in future we’d have that option. Another *great thing about Postgres is how mature it is* : every question we wanted to ask had in most cases already been answered on Stack Overflow.
    Lesson learned, the hard way.

    • @user-ph4zo2sr5v
      @user-ph4zo2sr5v Před 4 lety +1

      Start relational, stay relational. People really do love wasting time and money. There are obvious use-cases for non-relational databases, but it is very doubtful that's where you should begin when building out a domain. As noted, Postgres supports JSONB columns. Best of both worlds.

    • @craigbryant3191
      @craigbryant3191 Před 4 lety +1

      Yep. We're still here, us relational folks, and our stuff...just works. The world is full of developers who just want to hack away, and hate the discipline relational databases impose on them. We'll still be here when all their stuff breaks again, like it always does.

  • @draco2848
    @draco2848 Před 8 lety

    Thank you Martin for your awesome talk.

  • @geethadilipkumar-cw7mq
    @geethadilipkumar-cw7mq Před 2 měsíci +2

    Super delivery

  • @Anuj197612
    @Anuj197612 Před 11 lety +1

    Very nice and neatly laid out

  • @pratheekn87
    @pratheekn87 Před 8 lety +1

    Very well explained !! Cheers to Martin's energy ! :-)

  • @user-zr1fk1mg9e
    @user-zr1fk1mg9e Před 11 lety

    Easy to understand and follow. Thank you! Mr.Fowler.

  • @sidriya
    @sidriya Před 11 lety +1

    Excellent overview all around! Thanks, Martin Fowler. Also, love the way you strip false defenses and run religious wars out of town. :)

  • @syaredzaashrafi1101
    @syaredzaashrafi1101 Před 7 lety

    pause video at 0:23, click the gear icon in bottom right of video. Select speed, then set the speed at 1.5. then play the video. this video is more entertaining to watch it like this

  • @dwolthuis
    @dwolthuis Před 10 lety

    Thanks for this introduction to NoSQL Martin. Just FYI, this blog entry www.tincat-group.com/mewsings/2007/01/otlt-metadata-piece-not-apartheid.html shows a NoSQL graphic half-way down. It was written prior to the introduction of hash tags. It is conceivable that others came up with nosql independently after we did (Tom, Ashley and me) and had not seen our graphic prior to that point, but Tom has the domain names, so there is a thread of the NoSQL movement that arose just slightly earlier out of the NF2 (non-first normal form, pre-relational) world, recognizing we did not popularize it. We figured that we passed it into the UniVerse and it was picked up.

  • @vadityag
    @vadityag Před 3 lety +1

    Most important learning is at: 27:38

  • @ramizazadaliyev1210
    @ramizazadaliyev1210 Před rokem

    @50:00 indeed, Excel is engine of the business. I don't know how many times developer complained "we should ban the use of excel in this company, the excel spreadsheet is not requirements"

  • @sreehariraghav
    @sreehariraghav Před 11 lety

    Excellent presentation. Like all his books, this presentation is also very clear,simple yet detailed. Thanks for sharing.

  • @DorukDenizKutukculer
    @DorukDenizKutukculer Před 11 lety

    This talk is much more fun with subtitles on. Lovely :)

  • @flyisland2009
    @flyisland2009 Před 11 lety +1

    use different database to solve different problems

  • @shikhashah8253
    @shikhashah8253 Před 3 lety +1

    Best explanation! Thank you for such good content!

  • @AriKhuu
    @AriKhuu Před 11 měsíci

    this talk is amazing thank you for sharing!

  • @TaleVerse
    @TaleVerse Před 5 lety +1

    I am starting thinking if teaching is also a god gift. Wow, I was bored and now, I am curious and interested like a good movie is going on.

  • @srinivasakadiyala7677
    @srinivasakadiyala7677 Před 9 lety

    Thanks Martin for a nice orientation to NoSQL.

  • @joelmamedov404
    @joelmamedov404 Před 8 lety

    Although ,I disagree with some statements.
    But, overall it is very good presentation, as always well-articulated.
    Thank You Martin.

  • @MajikSo
    @MajikSo Před 8 lety +1

    This is undoubtedly a master in his field but I struggle with listening to the tone of his voice. He sounds as if he was the wisest guy ever born.

  • @babakmousavi1258
    @babakmousavi1258 Před 8 lety

    I worship Martin fowler

  • @DoubleGauss
    @DoubleGauss Před 11 lety

    The guy doesn't stutter, stumble or lose his place once. It's one continuous and steady stream of thought.

  • @zantrua
    @zantrua Před 11 lety

    I love the /dev/null database. It's so fast and web-scale.

  • @nitingupta82
    @nitingupta82 Před 10 lety

    Very Nice Presentation on NoSQL, Thank You for Sharing.

  • @mitpifa
    @mitpifa Před 8 lety

    Impressive presentation. Thanks, Martin.

  • @SimplilearnOfficial
    @SimplilearnOfficial Před 9 lety +8

    informative!!

  • @olumuyiwaagboola6523
    @olumuyiwaagboola6523 Před 8 měsíci +1

    Great talk

  • @barsvelioglu2276
    @barsvelioglu2276 Před 4 lety +1

    Brilliant talk

  • @ohad7
    @ohad7 Před 7 lety

    Excellent lecture. Thank you for sharing.

  • @iainkiloh7694
    @iainkiloh7694 Před 6 lety

    great talk, i like the way he aims the talk at all levels, and does it very very well. very much appreciated. I guess you have to be british to get the humour!

  • @Pjblabla2
    @Pjblabla2 Před 2 lety +1

    Very nicely explained