Architecture All Access: Modern CPU Architecture 2 - Microarchitecture Deep Dive | Intel Technology

Sdílet
Vložit
  • čas přidán 28. 05. 2024
  • What is a CPU microarchitecture and what are the building blocks inside a CPU? Boyd Phelps, CVP of Client Engineering at Intel, takes us through key microarchitecture concepts like pipelines, speculation, branch prediction as well as the main building blocks in the front and back end of a CPU. Want to learn about the history of CPU architecture? Check out part one here: • Architecture All Acces...
    Boyd Phelps has worked on some of the most well-known chip designs in Intel’s history, from Nehalem to Haswell to Tiger Lake and more.
    Architecture All Access is a master class technology series featuring Senior Intel Technical Leaders taking an educational approach to the historical impact and future innovations of key architectures that will continue to be at the center of ‘world-changing technology that enriches the lives of every person on earth.’ If you are interested in CPUs, FPGAs, Quantum Computing and beyond, subscribe and hit the bell to get new episode notifications.
    Chapters:
    0:00 Welcome to CPU Architecture Part 2
    0:51 Meet Boyd Phelps, CVP of Client Engineering
    1:14 What Are We Covering?
    1:47 Key Building Blocks in a CPU
    3:16 Pipeline Depth
    5:15 Speculation
    7:06 Branch Prediction
    7:35 Speculative Execution
    12:48 The Microprocessor Front End: Predict and Fetch
    14:44 The Microprocessor Front End: Decode
    17:19 Superscalar Execution
    18:36 Out-Of-Order
    19:57 CPU Back End
    23:35 Micro-Architecture Summary
    24:39 Where Are We Headed?
    Subscribe now to Intel Technology on CZcams: intel.ly/3P9BA7x
    About Intel Technology:
    Intel has always been at the forefront of developing exciting new technology for business and consumers including emerging technologies, data center servers, business transformation, memory and storage, security, and graphics. The Intel Technology CZcams channel is a place to learn tips and tricks, get the latest news, and watch product demos from both Intel and our many partners across multiple fields.
    Connect with Intel Technology:
    Visit Intel Technologies WEBSITE: intel.ly/IntelTechnologies
    Follow Intel Technology on TWITTER: / inteltech
    Architecture All Access: Modern CPU Architecture 2 - Microarchitecture Deep Dive | Intel Technology
    / inteltechnology
  • Věda a technologie

Komentáře • 198

  • @LeleSocho
    @LeleSocho Před 3 lety +285

    Hey this was incredibly produced and clear enough for many people to understand, you guys should publicize it more because i stumbled upon it almost casually.

    • @hariranormal5584
      @hariranormal5584 Před 3 lety +13

      When a actual Microprocessor company makes a video UNDERSTANDING how they work? Heh, and for the fact this actually isn't made bad. Don't get me wrong other content in CZcams that explain this sometimes can be easier and maybe harder. But I actually am amazed Intel really is doing this

    • @monavie9110
      @monavie9110 Před 2 lety +1

      @@hariranormal5584 absolutely

  • @GregoryJones9038
    @GregoryJones9038 Před 3 lety +83

    Honestly Boyd Phelps did an incredible job with these two videos. Granted I've been around since the 486 days and have always had an understanding of the various CPU architectures, but this was incredible with it's depth.

  • @adinchandra1797
    @adinchandra1797 Před 3 lety +13

    First time I have Phone, Internet access and Social Media, I started Addicted to all about Technology
    Especially about CPU

    • @platin2148
      @platin2148 Před 3 lety

      I would look at posts from fabian gisen and agner

    • @user-eb6vc2gs9e
      @user-eb6vc2gs9e Před 3 lety

      This means you know who is George Boole

  • @tuongnguyen9391
    @tuongnguyen9391 Před 3 lety +24

    I want intel to make more technical video like this. The more the better, I have a genuine interest for the inner working of the product instead of just buying it and wish for larger caches , better features.....As a customer , I really love your dedicated effort of creating a highly understable video with good analogy

  • @bgtubber
    @bgtubber Před 3 lety +63

    I love this series! It's incredible how these devices even work without a hitch given how mindbogglingly complex they are.

    • @glenwaldrop8166
      @glenwaldrop8166 Před 3 lety +8

      What's really amazing is they don't run without a hitch, there is an acceptable error rate that they recover from. That is part of why systems are more stable today than previously, more threads, more cores, if a thread crashes it doesn't take down the entire system.
      It's not just at the CPU level but errors still exist they just don't take down entire systems as often.

    • @karenkomeh737
      @karenkomeh737 Před 2 lety

      )l

  • @kilman54
    @kilman54 Před 3 lety +6

    I don't normally thumbs up or comment on a video, but, when I do, it's because a channel has done something really amazing and I want them to continue!

  • @ThunderingRoar
    @ThunderingRoar Před 11 měsíci +2

    The editor needs a raise

  • @JJsTechEsports
    @JJsTechEsports Před 3 lety +55

    Incredibly well done, breaking down such a complex topic into chunks that are digestible isn't easy and you guys did that super well!

  • @Happiness-lp9fw
    @Happiness-lp9fw Před 3 lety +5

    24:30 Yes, it was very beautiful 😌

  • @kcvinu
    @kcvinu Před rokem +3

    Lots of information with high quality content. Great effort Intel !!! And the host is doing an amazing job. His way of teaching is marvelous. For the last few weeks, I was searching for the topic "Computer architecture". Since, I am a hobby programmer, I would like to know more about how CPU execute my code. Thanks a lot for this series. :)

  • @MadamLava094
    @MadamLava094 Před 2 lety +4

    This was actually incredibly well put together! I always found that nothing really would ever bother to explain how exactly the subcomponents of a CPU talked to eachother, but this really helps show how a CPU is a lot of smaller, specific-purpose modular pieces talking to eachother

  • @sulikns4152
    @sulikns4152 Před 8 měsíci +1

    Oh thank u very much! reading "Inside the machine" book for now and it was too hard to understand all of this. This is great videocourse!

  • @alexandrebustico9691
    @alexandrebustico9691 Před 3 lety +6

    Love it. Explanation on branching and speculative execution is great. We must emphases that branching is the key of turing completeness which permit the birth of computer from previous simple calculator.

  • @mistercohaagen
    @mistercohaagen Před 3 lety +2

    Haven't been this captivated since reading Peter Norton's pink shirt book; "Programmer's Guide to the IBM PC".
    Deep and geeky is what the future is made of.

  • @SaladinG14
    @SaladinG14 Před 3 lety +9

    Awesome animations and analogies, altogether very easy to understand! I admit I'm heavily biased, but I think even a lay person with some passing interest would be able to understand a few of the important big-picture points.

  • @Nelthalin
    @Nelthalin Před 3 lety +8

    Thanks Boyd for these very clear video's i knew the basics but Part2 was very interesting and helped me to paint a clearer picture of what was going on. I would love to see more of these video's and even go more in depth!

  • @FullBrainiac
    @FullBrainiac Před rokem +1

    The content of this video was so clear that I saw myself working at an intel lab for a brief second in a near future. Thanks Boyd !!! Great Video

  • @aaronchung9838
    @aaronchung9838 Před 3 lety +5

    This is so good, it is easy for a newbie to understand. And it’s not boring for someone who’s already knows how a CPU works.

  • @KillerLettuce
    @KillerLettuce Před 3 lety +7

    This was really cool. Any can get a part 3 that explains how this is all translated onto a physical processor? How do we take these concepts and functions and make them work in the physical world?

    • @localcashmere
      @localcashmere Před 2 lety +1

      Think of it in this way, trillions of electric signals go through a CPU, these electric signals are sometimes of low current, sometimes of high current. Low current is interpreted as 0, while High is interpreted as 1. Now we have all the characters that make up the language of computers. The CPU then uses Hardware languages like VHDL to operate these 0s and 1s. This is how Physical things do software work.

  • @fernandoayala876
    @fernandoayala876 Před rokem +1

    Having had the opportunity to be at Intel for years (no longer there), so proud to see these series coming up. Very well done, something rather complex explained in a simple form. Hope that entice and nurture the imagination and curiosity of everyone, especially younger ones!

  • @jamespriest7328
    @jamespriest7328 Před 3 lety +34

    Love this intel!!! Do more of it and yes let the world know about this. Ads maybe.

  • @twpayne
    @twpayne Před 3 lety +6

    This is absolutely brilliantly explained and presented, thank you.

  • @Validole
    @Validole Před 3 lety +4

    Very well explained. The microcode decoding part was especially informative.

  • @aimanbryan1424
    @aimanbryan1424 Před 3 lety +12

    This is beautiful.

  • @vaidotasremeika7200
    @vaidotasremeika7200 Před 3 lety +3

    Absolutely amazing, thank you!

  • @Umeldaraje
    @Umeldaraje Před 3 lety

    I am in chip design from 1984 and tried many times to explain to people what am I doing. If I would have had these videos my explanation could have been easier. The animation and graphics are unbelievable quality. The Part 1 is a good umbrella explanation of the chip design in general and CPUs in particular. I will call this the 10.000 feet view. The Part 2 is the 1 foot view directly into the processor architecture so some industry lingo and knowledge is required. I would have liked to have a 3.000 feet and a 100 feet view for popularizing chip design and CPU for people who do not have an electronics background. Intel has all the capabilities to do it so please consider it. In the times of Artificial Intelligence and Biotech advancements making more people understand where all started and how it humans can benefit from their merger should be a good topic to cover. Looking forward for new videos from you.

  • @mfc1190
    @mfc1190 Před rokem +1

    This is literally amazing. Great explanation and great work on building these technologies. Speculative execution was really cool for me to learn about

  • @ttlim6752
    @ttlim6752 Před 3 lety +16

    Thank you Intel for putting this up. I like it a lot!

  • @Reinturtle
    @Reinturtle Před 3 lety +4

    It is a freaking miracle that we can make these things work reliably!

  • @mattanderson2074
    @mattanderson2074 Před 9 měsíci

    Absolutely brilliant. From start to finish.

  • @DANKAF
    @DANKAF Před 3 lety +2

    very helpful for CS students

  • @binhnq_tokyo_shorts_24
    @binhnq_tokyo_shorts_24 Před 3 lety +1

    It was truly remarkable. The best and most stunning lecture about CPU that I've ever seen.

  • @DeepFrydTurd
    @DeepFrydTurd Před 2 lety

    This is entertaining :)
    I already have a CS Degree and work as a Network Forensics Analyst but I still find this entertaining better than watching some non sense videos. I like learning about the physics of the electrons or photons inside the CPU highway and logic gates and conducting test's of new architecture designs in a digital 3D simulator environment.

  • @AlexSchendel
    @AlexSchendel Před 3 lety +3

    Honestly an incredible series! They seem to have found a perfect balance of details versus overview. It's not so high-level to seem common sense and it's not so in-the-weeds to seem impossible to understand.
    Also, the animation work is amazing. Great work all around.

  • @TalonsTech
    @TalonsTech Před 3 lety +11

    Good stuff. This was highly interesting watch. Enjoying my 11900K. Looking forward to Alder Lake and Intel’s GPU launch.

  • @julienp4563
    @julienp4563 Před 3 lety +2

    Thanks for this content, I liked it. I wish and hope more technical content like this one in the future.

  • @nadranaj
    @nadranaj Před 2 lety

    great video with excellent graphical representation to simplify the complex concepts.

  • @Anurag_Saxena
    @Anurag_Saxena Před 7 měsíci

    superb. mind-blowing. beyond one's imgination!

  • @renzomarini2480
    @renzomarini2480 Před 3 lety +3

    Please do more of these! I'm really enjoying the series.

  • @pierreboyer9277
    @pierreboyer9277 Před 3 lety +2

    Thanks for the video. I learned interesting things !

  • @sahandsalam4627
    @sahandsalam4627 Před rokem

    Extremely motivative and well comprehensive.

  • @orelmac
    @orelmac Před 3 lety +2

    Loved it. Thanks!

  • @kentlisius7675
    @kentlisius7675 Před 3 lety

    I really liked the TV sticks with the embedded technology they came out with. Above all I've found that the key to unlocking the potential of any product is to have in specification RAM from a quality manufacturer!

  • @mallikarjunareddyankinapal5977

    Great summary of uArch. Awesome!

  • @slyblood85
    @slyblood85 Před 3 lety

    Awesome videos I can show people to help them understand what I am talking about, only thing I think was missed(unless i missed it) was how hyperthreading works in the pipeline.. that'd been cool to show.

  • @Sakur.aiMusic
    @Sakur.aiMusic Před rokem

    This was actually extremely informative. I already knew a little bit about micro-architecture before hand.
    And now, seeing how some of this works, both the re-order buffer and branch prediction seem like they could be exploited to run unsigned code.

  • @vanshthakur7060
    @vanshthakur7060 Před 2 lety

    what a beautiful and educative illustration!

  • @tosemusername
    @tosemusername Před 3 lety +1

    Well done, Intel. Loved it. Wish there was more of this.

  • @thomasdevisser
    @thomasdevisser Před rokem

    These videos are so impressive, I would pay for a full course

  • @computerscience-hx7vn
    @computerscience-hx7vn Před 4 měsíci

    Incredible! the explanation and animation both!

  • @OTechnology
    @OTechnology Před 3 lety +2

    This is an incredible video!

  • @justsomejazz
    @justsomejazz Před 2 lety

    Thanks so much. This is fantastic. I'm using this to teach my daughter.

  • @paramveerteli
    @paramveerteli Před 3 lety

    Seen both parts. Great....

  • @Validole
    @Validole Před 3 lety

    Will you make more of these? They were incredibly informative: before, caches and pipelining were this black magic that was hard to reason about, especially as my previous reference point was essentially AVR MCU architecture (let's leave aside PIC because that's an entirely different beast altogether).

  • @AliceyBob
    @AliceyBob Před 2 lety

    I have not got words for congratulate this amazing videos !!!

  • @Arkan_Fadhila
    @Arkan_Fadhila Před 3 lety

    Thank you for this beautiful explanation of modern cpu. I hop you don't stop producing this series. I think GPU will be interesting topic to discuss as we all know intel have great iGPU today and hopefully will release discreate gpu soon

  • @dennysgrimaldi9623
    @dennysgrimaldi9623 Před 3 lety +2

    This is really good, nice video

  • @MrJackPL
    @MrJackPL Před 3 lety +2

    This is just awesome!

  • @Olibelus
    @Olibelus Před 2 lety

    This was amazing, thank you!

  • @harirao12345
    @harirao12345 Před 8 měsíci

    Fantastic! Thank you!

  • @shaxjl
    @shaxjl Před 2 lety

    very very great video!! thank you very much!

  • @agitkaplan7991
    @agitkaplan7991 Před 8 měsíci

    Great videos, thanks!

  • @leonardjoseph3152
    @leonardjoseph3152 Před 3 lety

    thanks for complete and clear explanation

  • @vladmihai306
    @vladmihai306 Před 3 lety +9

    Great video, congrats for making it!

  • @Nour-eddineTaleb
    @Nour-eddineTaleb Před rokem

    Very well done, but still waiting for the cache episode.

  • @mycollegeshirt
    @mycollegeshirt Před 2 lety

    That was soo soo fantastic, I can't believe it wow.

  • @mariocortes2670
    @mariocortes2670 Před rokem

    Great job and great video!

  • @sunilkumar-ls2yb
    @sunilkumar-ls2yb Před 2 lety

    great and simple explaination dude

  • @MrHav1k
    @MrHav1k Před 11 měsíci +1

    This is an incredible video!! Leave it to Intel to produce it. Thank you!

  • @cralx2k
    @cralx2k Před 2 lety

    JUST AMAZING... thanks

  • @ljwobker
    @ljwobker Před 3 lety +1

    This is really great stuff, but I found a bug in your code at the 5:00 mark... A 5 GHz processor doesn't mean "each completes in 5 billionths of a second" -- it means that each completes in 1/5 of a billionth of a second.
    It's a clock every 200 ns, not a clock every 5 µs... But at least we didn't divide by zero!

  • @praveenalapati5234
    @praveenalapati5234 Před rokem

    Excellent Presentation.

  • @Van_Verder
    @Van_Verder Před rokem

    Stellar presentation!

  • @luminomaximus8583
    @luminomaximus8583 Před 3 lety +2

    Thank you.

  • @elhadjiousmanediallo1618
    @elhadjiousmanediallo1618 Před 3 lety +2

    Highly informative

  • @mycollegeshirt
    @mycollegeshirt Před 2 lety

    Man if you guys could go even deeper, it whatever just amazing work

  • @aleb34
    @aleb34 Před 2 lety

    the pitch at 4:57 gave me shivers

  • @stachowi
    @stachowi Před 2 lety

    Totally found this by accident, but so informative.

  • @friendlyfripptit2228
    @friendlyfripptit2228 Před 2 lety

    This mini-series was excellent! yummy good!

  • @amanrawat1458
    @amanrawat1458 Před rokem

    Please keep teaching us similar content. Some people like us are thirsty to learn

  • @pstefanics
    @pstefanics Před 3 lety +2

    Incrediby well produced and informative. One question: at 4:58, shouldn't the time to complete a stage be 0.2 (1/5th) billionths of a second if the CPU is running at 5GHz? It looks like 5 billionths of a second per stage would give a 200 MHz clock speed.

  • @fapitbullet
    @fapitbullet Před 3 lety +2

    This video series is fantastic ! The animations, production quality are top-notch!

  • @hassanfirasat3079
    @hassanfirasat3079 Před 3 lety +2

    Amazing...

  • @IslamIsDanger
    @IslamIsDanger Před 3 lety +2

    Keep it going!

  • @emilienamaury3839
    @emilienamaury3839 Před 3 lety +2

    Cause this 2 videos, I want read more and more about this subject, so thk.

  • @michaelsandrik9819
    @michaelsandrik9819 Před 3 lety +2

    This is a great series! Hope there are more of them!

  • @NizarElZarif
    @NizarElZarif Před 3 lety +2

    The video is very well executed, but I think you went a little too fast on branch prediction stuff. I already know who it works but I had a hard time following that example, especially when talking about the assembly code. But this video is very well done.

  • @pierreboyer9277
    @pierreboyer9277 Před 3 lety +3

    It feels like uOps are the actual basic instruction set. Which makes it feels like ISA is actually a higher level language hardcoded in the hardware. But then what is the point of the higher complexity ISA and not using uOps as the basic instruction set directly? Is it why x86 has like 2500 instructions in its ISA? And RISC-V on the other hand as less instructions. 50 I think. Which sounds like many more than the really basic instructions so I guess they also use uOps?

    • @storyls
      @storyls Před 3 lety +4

      >Why not use uOPs as the basic instruction set directly?
      You could, but the issue is that it’s going to cost you a lot of memory. Really it’s just space complexity, instructions take up little memory, uOPs a lot.
      uOPs are basically a bunch of wires that go throughout the CPU and say things like “connect register 4 to the bus leading to the ALU” or “write output of ALU to the register file.” Each uOP also has to tell which modules of the CPU stay on and which stay off, and for the vast majority of instructions, each uOP is going to be sending a LOT of 0s to all the modules that don’t need to be operating for this instruction. While an instruction alone can take up say 2 bytes, each uOP could be telling hundreds of modules what to do.
      The decode stage itself is pretty dumb usually. It essentially uses storage, the instruction is an address and in that storage for that address there is some firmware for all the uOPs.
      Also each architecture can have all sorts of different uOPs for the same ISA.

  • @dinos22
    @dinos22 Před 2 lety

    Awesome video

  • @blueguy5588
    @blueguy5588 Před 2 lety +1

    Mindblowing

  • @maha5
    @maha5 Před rokem

    Well processed.

  • @hupa1a
    @hupa1a Před 3 lety +1

    Fantastic!

  • @JoseJimeniz
    @JoseJimeniz Před 2 lety +1

    If you want a more technical explanation, that in a lot of ways explains some of it much better, look up Eric Brumer's "Compiler Confidential" video. He goes into nitty-gritty detail the internal fetch-decode-pipeline.

  • @haongwong
    @haongwong Před 3 lety

    we need more people educated on this!

  • @k2t210
    @k2t210 Před 3 lety +1

    Outstanding

  • @malleshkoujalagi1125
    @malleshkoujalagi1125 Před 2 lety

    Awesome!!! got clearly instruction-->decode-->uops and ooo execution, dependent uops execution. Please clarify how data caches are used if uops are memory bound?

  • @prashanthp1077
    @prashanthp1077 Před 10 měsíci

    Boyd is brilliant

  • @RohanKumar-wf9sc
    @RohanKumar-wf9sc Před 3 lety +2

    This was a great, short and in-depth explanation with awesome animations & examples. Please make more such videos.

  • @superchillh3o
    @superchillh3o Před 5 měsíci

    Amazing work

  • @user-eb6vc2gs9e
    @user-eb6vc2gs9e Před 3 lety +2

    Nice!