How ChatGPT Works Technically | ChatGPT Architecture

Sdílet
Vložit
  • čas přidán 23. 04. 2023
  • Get a Free System Design PDF with 158 pages by subscribing to our weekly newsletter.: blog.bytebytego.com
    Animation tools: Adobe Illustrator and After Effects.
    Checkout our bestselling System Design Interview books:
    Volume 1: amzn.to/3Ou7gkd
    Volume 2: amzn.to/3HqGozy
    The digital version of System Design Interview books: bit.ly/3mlDSk9
    ABOUT US:
    Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

Komentáře • 260

  • @sameerizaj5458
    @sameerizaj5458 Před rokem +356

    Sir i'm being very honest your 5 to 7 minutes video always taught more than the week of study,these viusal are so helpfull and also i love the fact whatever word you use you first explain the meaning behind that make's thing more easy to understand

    • @happyruimi
      @happyruimi Před rokem +13

      You should probably drop the course if you learnt more in this 5 min video than you did in 4 weeks...

    • @user-dh7ut3wh7w
      @user-dh7ut3wh7w Před 7 měsíci +7

      @@happyruimi People love learning superficial stuff that makes them feel smarter lol

    • @omgmaw
      @omgmaw Před 4 dny

      Sar sar sar

  • @cexploreful
    @cexploreful Před rokem +51

    Love the way you animate the presentation! Everything went so smooth and clear!

  • @ferdous_khalifa
    @ferdous_khalifa Před rokem +18

    Thank you so much for creating this insightful CZcams video! Your hard work and dedication to providing quality content are truly appreciated. You’ve managed to convey the information in a clear and engaging way, making it easy for viewers like myself to understand and enjoy. Keep up the fantastic work, and I’m eagerly looking forward to your future videos!

  • @satychary
    @satychary Před rokem +20

    As always, CLEAR AS THE BLUE SKY - Alex, EVERY one of your explainers is pure gold, including this one! Thank you for making this.

  • @jonosutcliffe1
    @jonosutcliffe1 Před rokem +3

    The best summary available. I needed a good summary for non engineers about how it works and I wish I'd found your explanation before creating my presentation. Very nice work, thanks!

  • @chrismachabee3128
    @chrismachabee3128 Před rokem +3

    This is a very good video. It is the best nuts and bolts video I have seen and you've about think I have even heard of and I've been listening to everything I can, so fine job, well done and thanks.

  • @moneycrab
    @moneycrab Před rokem +6

    Thank you for this! So clear and helpful

  • @ramaati18
    @ramaati18 Před 2 měsíci +1

    Wow! The best animation in slides i have seen in any tutorials! Every word you utter during you presentation is golden and easy to learn easily and quickly!⭐️⭐️⭐️⭐️⭐️!

  • @sudzam
    @sudzam Před 11 měsíci

    Wonderful explanation! Just enough detail to explore sub-topics in detail.. Thanks.

  • @DevCoder
    @DevCoder Před rokem +8

    Man you explained everything in a simple and clear way. Thank you very much for this helpful content

  • @Tony-dp1rl
    @Tony-dp1rl Před rokem

    Knew this was coming on your channel, great little intro to the topic for sharing with people, thanks.

  • @goneni1504
    @goneni1504 Před 5 měsíci

    Excellent. Concise but thorough and clever. Thanks a lot. Love the burger analogy.

  • @thydevdom
    @thydevdom Před 10 měsíci

    A few months ago I was looking exactly for this kind of video. Thank you!!!

  • @OsamaAdel
    @OsamaAdel Před 8 měsíci +1

    I turned to be more complicated than I first thought. However this is natural, since its capabilities are fascinating and growing from day to day. Very nice video, thank you a lot.

  • @MrKelaher
    @MrKelaher Před 7 měsíci

    Great video, helps to clear up some confusion by "going behind the curtain"

  • @deepflyball
    @deepflyball Před 4 měsíci

    New sub here. Thanks for such a clear explanation. I really enjoy the way you explain things and the graphics you use. Looking forward to more videos. Happy New Year.

  • @rlewisf1
    @rlewisf1 Před rokem +1

    Very useful and professional presentation. Thank you.

  • @arthurcolle2778
    @arthurcolle2778 Před rokem +38

    Excellent video, covers all key concepts - RLHF, PPO, etc... and how they relate to the GPT models. Great content!
    +Subscribed

    • @jeroenvermunt3372
      @jeroenvermunt3372 Před 8 měsíci +1

      Those are concepts for reinforcement learning, I missed the key concepts of the LLM itself. I found out via other sources that the actual key concept of the LLM itself is multi-head attention

  • @moiserwibutso4899
    @moiserwibutso4899 Před 3 měsíci +1

    Thanks for this amazing explanation. The visuals are so fantastic 👌

  • @KumarBodana
    @KumarBodana Před měsícem

    Excellent video! Best explanation I've seen on ChatGPT

  • @rubbish9231
    @rubbish9231 Před 10 měsíci +4

    As a software engineer I learned how to become a good chef. I asked gpt for it's implementation and informed me well

  • @wernerkallmann9105
    @wernerkallmann9105 Před rokem +1

    Excellent explanation. Thank you very much.

  • @pawandhailPWRIES
    @pawandhailPWRIES Před 11 měsíci

    Excellent tutorial, very insightful !

  • @betweenprojects
    @betweenprojects Před rokem +4

    I am amazed by the results. A great wordsmith/people pleaser but factually about as reliable as a first year undergraduate in a bar.

  • @bobbyandthomas
    @bobbyandthomas Před 8 měsíci +1

    Thank you for explaing so nicely!

  • @inber
    @inber Před rokem

    Great explanation, much appreciated. I learned a lot.

  • @jntaca
    @jntaca Před rokem +8

    I follow a lot of divulgation tech channels.
    You are the most clear and concise of all.
    Thanks for your work !

  • @jdrake411
    @jdrake411 Před rokem

    I found your review very useful, thank you!

  • @richardglady3009
    @richardglady3009 Před 8 měsíci

    Thank you very much for this great explanation. As a non-computer expert, the information was well presented and very understandable. Thanks.

  • @rajneeshverma4026
    @rajneeshverma4026 Před 6 měsíci

    super simple explanation and very insightful.

  • @nguyenhonghanh2043
    @nguyenhonghanh2043 Před 9 měsíci

    Thanks for the video, I find it very helpful.

  • @L_Christ_BR
    @L_Christ_BR Před rokem +3

    Estou impressionado com a tecnologia utilizada pelo ChatGPT-4! É fascinante como a Inteligência Artificial evoluiu nos últimos anos, permitindo que máquinas possam entender e responder às nossas perguntas de uma forma quase humana. No entanto, é importante lembrar que, assim como qualquer tecnologia, a IA também pode ser perigosa. A capacidade de aprender e evoluir rapidamente significa que as máquinas podem se tornar imprevisíveis e tomar decisões que podem ser prejudiciais para os seres humanos. É crucial que os desenvolvedores de IA levem em consideração a segurança e a ética em suas criações, para que possamos aproveitar os benefícios da tecnologia sem comprometer nossa segurança - Texto criado pela IA

  • @debashishbramha
    @debashishbramha Před 3 měsíci

    Excellent analysis.Thanks from India.

  • @JBoy340a
    @JBoy340a Před rokem +1

    Very nice and clear explanation.

  • @SanjaySingh-jo3py
    @SanjaySingh-jo3py Před rokem

    Voice to slide !! Perfect, Sir 🙏🙏🙏🙏🙏

  • @imagai.store.2323
    @imagai.store.2323 Před 10 měsíci

    been searching like this one, thank you so much sir

  • @dionisos8152
    @dionisos8152 Před 11 měsíci

    Congratulations, this video is very clear and useful.

  • @rahuldinesh2840
    @rahuldinesh2840 Před rokem

    This is classic presenation. Thanks.

  • @bitsnbytes4406
    @bitsnbytes4406 Před rokem

    Great video! Thank you very much.

  • @kennethroark917
    @kennethroark917 Před 11 měsíci

    This is gold. Thank you!

  • @micbab-vg2mu
    @micbab-vg2mu Před rokem

    Great explanation - thank you

  • @lloydwyngard7233
    @lloydwyngard7233 Před rokem

    Great video, very informative thanks!

  • @hanimahdi7244
    @hanimahdi7244 Před rokem

    Very nice work, thanks!

  • @darissalzburger
    @darissalzburger Před 2 měsíci +1

    I rarely comment the videos, but I had to comment yours. Amazing explanation and visualization. Thanks

  • @yuli.kamakura
    @yuli.kamakura Před rokem

    Very exciting, easy to understand

  • @SubashiniBala
    @SubashiniBala Před 5 měsíci

    Pretty insightful content !!
    On the side note, I liked that you have brought up an example with Indian prime minister

  • @ganeshkameswaran7123
    @ganeshkameswaran7123 Před 11 měsíci

    Nice explanation, thanks!

  • @szamee83
    @szamee83 Před 5 dny

    Excellent. Thank you

  • @williambrackett7100
    @williambrackett7100 Před 6 měsíci

    Fantastic explanation!

  • @dineshchandgr
    @dineshchandgr Před 5 měsíci

    amazing explanation. thank you

  • @rajeshkumarsahu7605
    @rajeshkumarsahu7605 Před rokem +1

    Have learnt a lot from your vlogs and posts. Thanks Alex!

  • @thanhlv2
    @thanhlv2 Před 10 měsíci

    Great video. Keep doing your great work 👍👍👍👍👍

  • @user-jq2up3ft6f
    @user-jq2up3ft6f Před rokem

    Great Job, Thank you!

  • @exxzxxe
    @exxzxxe Před 10 měsíci

    Very well done!

  • @santi044
    @santi044 Před 5 měsíci

    super well animated video

  • @MandarPophali-yy1yz
    @MandarPophali-yy1yz Před rokem +1

    This is great summary. Can you have quick summary on differences between BARD and chatGPT?

  • @alexharvey9721
    @alexharvey9721 Před 8 měsíci

    Great video. Clear and broad while still short - that's a sub from me, thanks!
    Sometimes it seems like a lot of steps to fine tune the usefulness of statistical representations instead of just going to the effort of trying to understand cognition. I wonder how responsible it is. But I guess morality has never stood in the way of bucketfuls of cash!
    The irony is many of those who developed the tech are incredibly thoughtful and morally grounded, while those in control are employed for their moral flexibility.

  • @MrDanieluy
    @MrDanieluy Před rokem

    Brillant resumee and presentation !

  • @FlareGunDebate
    @FlareGunDebate Před rokem +10

    Bitwise operation, if/elseif/else, and neural network are orders of complexity in flow control. ChatGPT is huge in terms of parameters but it isn't any more sophisticated than modern translation software which relies primarily on tons of user data.

    • @divotiontogod
      @divotiontogod Před rokem

      right, most people fail to understand and see how chatgpt is not able to for example write a clear code, it generates always a buggy code, and one has to elaborate more on minuscules of requirement for it to change it answer to a more better one. plus its answers are not mathematically correct, ask a few complex math questions and you will know!
      AI can never beat humans, ill iterate, even the dumbest human!

    • @williamtim5893
      @williamtim5893 Před rokem +3

      The information age creates the data for the AI age

    • @FlareGunDebate
      @FlareGunDebate Před rokem

      @@williamtim5893 yeah OpenAI is neither open source nor artificial intelligence

  • @sheryll9966
    @sheryll9966 Před 4 měsíci

    Great content!

  • @VictorAntonioLive
    @VictorAntonioLive Před 9 měsíci

    Exceptional video!

  • @williebrits6272
    @williebrits6272 Před 5 měsíci

    Awesome, well done

  • @terryliu3635
    @terryliu3635 Před 6 měsíci

    awesome video!

  • @ldohlj1
    @ldohlj1 Před rokem

    Thanks.
    Please do one for Stable Diffusion too

  • @praveends06
    @praveends06 Před 11 měsíci

    Beautify articulated.

  • @modolief
    @modolief Před rokem

    Superb, as usual

  • @marciabrown5569
    @marciabrown5569 Před rokem

    I really enjoyed your analogy. Though it is still over my head I do think I understand a bit more.

  • @OneAndOnlyMe
    @OneAndOnlyMe Před rokem +1

    Great explanation. As a computer scientist GPT is really not that mind blowing when you know that behind the scenes it's a giant data model and algorithms. It's magic to many non-computer scientists, but we can distinguish science from magic.

    • @herrbonk3635
      @herrbonk3635 Před rokem +1

      Really?? I'm a "computer scientist" of sorts myself (CPU logic designer, compiler writer) but doesn't get sh*t from this. The video does not really explain anything "technical" (despite what the title says), only hyper loose analogies that tells me nothing.

    • @OneAndOnlyMe
      @OneAndOnlyMe Před rokem

      @@herrbonk3635 As a computer programmer of 40+ years, AI is not some great mystery to me; large data models and quite simple algorithms at the core of it, combined with the computer capacity we now have. The theory has been around since the 1940s.

    • @herrbonk3635
      @herrbonk3635 Před rokem

      @@OneAndOnlyMe That wasn't the point. Neural networks are no mystery to me either. My complaint was that this guy doesn't explain anything in concrete terms.
      It was mainly other models in the 1940s and the better part of the 1900s though. More focus on recursive list processing (Lisp) and logic programming (like Prolog).

    • @OneAndOnlyMe
      @OneAndOnlyMe Před rokem

      @@herrbonk3635 I don't think the point is to explain in concrete in terms, more to just explain concepts and principles.

    • @messiisthebest
      @messiisthebest Před 10 měsíci

      It is all about attention mechanism

  • @diondewet8522
    @diondewet8522 Před rokem

    Wow.....brilliant explanation

  • @damonwu9658
    @damonwu9658 Před rokem

    Thank you for sharing, great stuff, and langchain next?

  • @superpowerdragon
    @superpowerdragon Před rokem +11

    can you do a video on how Stable Diffusion work technically?

  • @renatoigmed
    @renatoigmed Před 10 měsíci

    Even though I don't understand English perfectly, I managed to get a good idea of how it works. it is much more enlightening than the lazy analogy that they just say "ChatGPT talks about everything but has no awareness of what the subject is about". But imagine if there was...

  • @nithinbhandari3075
    @nithinbhandari3075 Před rokem +12

    Hi, like your video a lot. Thanks.
    Can you please create a video on computational power and cost for running GPT3?
    How many GPU are required to run one instance of GPT3?
    And How to dynamically scale server for GPT3?
    How many request per instance of GPT3 can handle request per second, request per minute, and request per hour?

  • @romeobernabe6871
    @romeobernabe6871 Před rokem

    Thank you!

  • @IbrahimAkar
    @IbrahimAkar Před rokem

    Excellent Video - thank you. What software do you use to create your CZcams presentations?

  • @Larry21924
    @Larry21924 Před 5 měsíci

    This content is a guiding star, revealing new pathways of understanding. A book with parallel material touched me deeply. "The Art of Meaningful Relationships in the 21st Century" by Leo Flint

  • @dr.imayavarambanmunuswamy808
    @dr.imayavarambanmunuswamy808 Před 10 měsíci

    Many thanks Sir.

  • @philipsun4834
    @philipsun4834 Před 9 měsíci +1

    to be more specific, the minute on 1:55, Token ID is the vector, instead of Token, right?
    as Token can consist of alpha-numeric value, but the vector is purely the numeric with digits only.
    that is why the vector database is coming as the storage of those vectors for searching and indexing.

  • @buntykumar7270
    @buntykumar7270 Před 2 měsíci

    This is awesome.

  • @BATMAN_1
    @BATMAN_1 Před 2 měsíci

    Thanks!

  • @tomtyiu
    @tomtyiu Před 9 měsíci

    wow, now I totally understand how it works technically. Thanks

  • @HypnoStellar
    @HypnoStellar Před 6 měsíci

    i like this video alot thanks

  • @mehediazad1780
    @mehediazad1780 Před rokem

    Sir I'm being very honest your 5 to 7 minutes video always taught more than the week of study, these visual are so helpful and also I love the fact whatever word you use you first explain the meaning behind that make's thing more easy to understand(2)

  • @williamschandran
    @williamschandran Před rokem

    well explained , Thanks

  • @SantoshNair1
    @SantoshNair1 Před rokem +1

    7:00 - there is a mistake in the graphic at this mark, where the prompt should have been a finance statement/question, but instead it remains the roses poem from the previous example. Probably a copy paste error.

  • @not_amanullah
    @not_amanullah Před 3 měsíci

    Thanks ❤

  • @bhushankshire2854
    @bhushankshire2854 Před 3 měsíci +1

    amazing. what tools do you use to make these videos??

  • @freekyninjacat8207
    @freekyninjacat8207 Před rokem

    Ffs, exactly what I just needed! :D

  • @hubstrangers3450
    @hubstrangers3450 Před rokem

    could expand how the constraints of the moderation API is developed (What type of parameters and arguments are provided on the subject of desired), thank you

  • @vikasgupta1828
    @vikasgupta1828 Před rokem

    Thanks

  • @aigriffin42604
    @aigriffin42604 Před 19 dny

    Could you please post something that is more up-to-date to this year thanks!❤🎉😁😊

  • @pelimies1818
    @pelimies1818 Před rokem

    What is typical energy consumption for one inquiry?
    For google search the consuption for one inquiry is around 24 hours usage of 2W led lamp.
    So if you make 10 inquiries per day, it uses around same energy than illumination needed for a small house.

  • @Belalrazaa
    @Belalrazaa Před 11 měsíci

    thank u sir

  • @BCubDelta9
    @BCubDelta9 Před 4 měsíci

    min 6:33 Could you please provide the paper for the "Conversational prompt injection" term?. I am currently citing in-context learning and prompt learning but this one is new for me and seems helpful.

  • @onlinecreations7781
    @onlinecreations7781 Před 3 měsíci

    Pretty same as phase of a compiler 😍🙏

  • @5P4C3V01D
    @5P4C3V01D Před 11 měsíci

    Pleeasse MOREEE!

  • @SpiritOfIndiaaa
    @SpiritOfIndiaaa Před 4 měsíci

    #ByteByteGo thanks a lot , your ppts/presentations are very good , can you help me how to learn preparing so , any recommandation for learning the same ?

  • @phil7121
    @phil7121 Před rokem +1

    Sahn is the Michael Jordan of giving ELI5 explanations of complex things

  • @user-zl2iv9sq6b
    @user-zl2iv9sq6b Před rokem

    What kind of tools used in your presentation. How you did the animation?

  • @TynOng
    @TynOng Před rokem +7

    Could you cover Vector databases for LLM next time please?