192 Cores of EPYC Domination!

Sdílet
Vložit
  • čas přidán 7. 05. 2024
  • AMD EPYC 192 Cores of pure amazingness reviewed in this short 43-minute video... wait! How long!!??
    Wendell's got the ins and outs of this new server-level cpu. Benchmarks, first impressions, predictions of the future!
    Find Benchmarks here: forum.level1techs.com/t/new-e...
    0:00 Intro
    2:11 Quick Overview
    6:50 Testing and Benchmarks
    15:46 AMD Listening to Customers
    18:38 AVX512
    20:20 Neural Magic
    21:51 ZenDNN
    24:29 CXL
    29:32 Chiplets and IO
    35:29 A little bit of Microsoft
    39:08 Pricing and Summary
    **********************************
    Check us out online at the following places!
    linktr.ee/level1techs
    IMPORTANT Any email lacking “level1techs.com” should be ignored and immediately reported to Queries@level1techs.com.
    -------------------------------------------------------------------------------------------------------------
    Intro and Outro Music: "Earth Bound" by Slynk
    Other Music: "Lively" & "FollowHer" by Zeeky Beats
    Edited by Autumn
  • Věda a technologie

Komentáře • 438

  • @myselfremade
    @myselfremade Před rokem +776

    I am so glad to have been here to witness Wendell transforming from an awkward nerd hiding behind a monitor tree, to an awkward nerd that gets invited to AMD events and brings us such good content
    LOOKING GOOD my dude.

    • @myselfremade
      @myselfremade Před rokem +37

      Also I want everyone to know that I'm only saying he's still an awkward nerd because face it, we all know that's what he feels like inside. It doesn't show externally

    • @UNSTOPABLE40XBOX
      @UNSTOPABLE40XBOX Před rokem +18

      Those were the days, i think it was like 6 monitors.

    • @electricblue8196
      @electricblue8196 Před rokem +11

      Like the neighbour in Home Improvement TV show 😂

    • @gamer18990
      @gamer18990 Před rokem +22

      @@UNSTOPABLE40XBOX The days of tek syndicate were like 7-8 years ago now, hes come a long way for the better, he didnt get nearly enough representation there.

    • @UNSTOPABLE40XBOX
      @UNSTOPABLE40XBOX Před rokem +4

      @@gamer18990 True. I love seeing Wendell give us these kinds of videos.

  • @amessman
    @amessman Před rokem +43

    Twenty years ago we were starting to see DUAL core CPUs... One of these has 96!!! I just can't get over that.

    • @morosis82
      @morosis82 Před rokem +18

      It's even worse than that. Just 10 years ago Intel was releasing their top tier 8 core Xeon CPUs, at 135W tdp. 5 years ago AMD released first gen Epyc with 32 cores. Now we have 96.

    • @ALmaN11223344
      @ALmaN11223344 Před rokem

      @@morosis82 It's cause Intel is a shitty company that deserves no one's money until they're bled to the point of actually having to innovate

    • @ryanmcgowan3061
      @ryanmcgowan3061 Před rokem +2

      I remember my first quad CPU motherboard. Not a quad core. I had to buy 4 CPUs. It called it my vacuum cleaner because it sounded like one. That was around 2006, and the idea of multiple cores on a chip was just barely coming out. Now I have 12 CPUs on a chip, yet I can hear my fridge across the house better than my PC.

  • @TeraQuad
    @TeraQuad Před rokem +156

    "Don't reason with it. Don't argue with it. Just DOMINATE! Show them you're the pack leader." - Cesar Millan

    • @dark_mode
      @dark_mode Před rokem +10

      Tsst

    • @tyraelhermosa
      @tyraelhermosa Před rokem

      alpha roll those bitch--err ahem, those CPUs

    • @RobBCactive
      @RobBCactive Před rokem +4

      Hope AMD doesn't get bitten the way Cesar does!
      Being on TV is no guarantee of best practices

    • @Marin3r101
      @Marin3r101 Před rokem +2

      Shut up Cartman!

    • @LaurentiusTriarius
      @LaurentiusTriarius Před rokem +1

      Thankfully Queen Latifa doesn't use an IT service.

  • @insomnia20422
    @insomnia20422 Před rokem +52

    The performance per watt was blowing me (and Intel) away!

  • @stranglehold4713
    @stranglehold4713 Před rokem +97

    Its always awesome to see Wendell dig into some proper hardware and explain in depth why it matters

  • @kwinzman
    @kwinzman Před rokem +12

    How do you get so many different things done?! Every video is a treat! You support creators, develop ZFS diagnostics on the side, build systems for Linux core devs, build and benchmark various systems. Level1Forums, the podcast and a million other things. Do you even sleep?
    And how do you earn most of your money? Is it through CZcams? Consulting?

  • @jjdawg9918
    @jjdawg9918 Před rokem +4

    Lisa Su was on Bloomberg today. Of course we learned nothing from that interview other than it must be important.
    This is where the real learning happens. Thanks Wendell!

  • @MrMartinSchou
    @MrMartinSchou Před rokem +10

    Fun to see that we're back to servers having more memory per socket than a reasonably sized hard drive ;)

  • @GlennBerrySQL
    @GlennBerrySQL Před rokem +28

    As you well know by now, AMD EPYC 9004 will be a monster for many workloads. Great video, Wendell!

  • @aodhhanm4180
    @aodhhanm4180 Před rokem +19

    I don't even know what to say. Obviously from a enterprise standpoint, it's jaw dropping. It's been a while since we've seen such a performance jump with addition of flexibility. What shocks me the most is the culture change AMD has made along with the emphasis on efficiency (especially since there is so much flexibility). Being in a banking industry, where we worry about data/transaction loss, the addition of CXL is a great addition to see. So bring on January, so we can how Intel stacks up.

  • @ThePeperich
    @ThePeperich Před rokem +66

    Lisa was so happy at the streamed AMD event today - great video coverage Wendell, thank you very much. Seems to crush Xeons even more plus those great features (so much is wonderful - for me the further expanded confidential VMs seems very interesting). Just wow and for example already deployed at Azure -> just great.
    Cheers and keep this wonderful and interesting channel as it is, Pepe

    • @arm-power
      @arm-power Před rokem

      ARM server CPUs are actually better than this 4th gen EPYC:
      1) 7nm -> 5nm TSMC ........... -30% power consumption (42% more cores at iso-frequency)
      2) Zen3 EPYC SP4 280W TDP -> SP5 with 360W TDP ......... 29% more (so 29% more cores at iso-frequency)
      -----------------------------------------------------------------------------------------------
      ===== total 1.83 core count multiplier they would get from shrinked Zen 3 (1.42 * 1.29 = 1.83)
      4) so total performance increase by new Zen 4 micro-architecture (Zen3 -> Zen4) is pretty small (AMD basically did the same trick as at desktop - massive increase of TDP and clock frequencies is the major trick)
      5) SP5 has TDP of 400W (short peak 700W) and there is 1000W power supply per socket, and 24 DDR5 modules will consume around 150W, so total power consumption of CPU + RAM = 510 W .... SP5 is much larger than SP4 including TDP
      6) Performance: 192-core/384-thread dual socket Zen 4 EPYC = 1790 pts in SPECint2017
      7) Performance thread: 1790 / 384t = 4.66 pts/thread
      Now compare that to Nvidia server 144-core Super GRACE CPU (based on ARM Neoverse V2 core):
      6) Performance: 144-core/144-thread dual CPU ARM Neoverse V2 = 740 pts in SPECint2017
      7) Performance thread: 740 / 144 = 5.14 pts/thread ......... 5.14 / 4.66 = 1.10 ........ Grace is 10% faster per thread than Zen 4.
      ARM Grace is 10% faster per thread than Zen 4..... that's not a small number. Considering 96-core EPYC 9654 has boost 3.7 GHz and all-core 3.5 GHz, while ARM chips like 64-core Graviton 3 runs at 2.6 GHz. Grace's clocks are not known however around 3.0 - 3.3 GHz is reasonable estimation. This means ARM has IPC higher than these 10%.
      Consumer ARM Cortex X3 has 14% higher IPC than Zen 4 in Geekbench 5. Neoverse V2 core in Grace (and upcoming Graviton 4) is based on X3 core. But V2 has 2 MB L2 cache in compare to 1 MB in X3. So IPC might be even a bit higher than 14%.
      ___________________________________
      Be very cautious about stock investment. AMD beating Intel in trouble doesn't mean AMD will not be smashed by ARM servers. Especially when I see $11,000 USD price tag on AMD EPYC. ARM CPUs can be manufactured under $1000 USD while providing better performance and lower power consumption, and lower die area. Both Intel and AMD will be in trouble soon.
      BTW: Remember that any x86 is CISC but runs inside as RISC. That extra and unnecessary translation CISC-to-RISC will always hurt performance and efficiency. Plus CISC variable length instruction encoding (x86 instruction might have anything between 1 byte to 15 bytes) really hurts how many instruction can be decoded per cycle because 6th instruction can be between 6th byte and 90th byte = 84 possibilities. While RISC ARM instruction has always 4 bytes so decoding/prefetch of any quantity of instructions per cycle is simple and super efficient. That's math and good instruction set matters a lot. Generally any CISC is obsolete for these technical reasons. M68000, VAX, Z80 or MOS6502 are CISC and died long time ago. x86 is here today because they managed to make it RISC inside and because Intel managed to kill main RISC competitors like Alpha (bought and shut down), HP PA-RISC (shut down in favour of Itanium) and also huge PC popularity with unlimited TDP. But with massive multicore systems today there is not place for CISC-to-RISC translation energy wasting. Unnecessary wasting. x86 is sinking Titanic. Nobody knows how long time this sinking will take however every engineer knows it will happened. ARM server has more than 10% server share and that was gained in one year (mostly Graviton 2 systems). But now there are 128-core Ampere Altra MAX, Graviton 3 on 5nm TSMC and upcoming storm of new CPUs: Nvidia Grace, Graviton 4, Ampere One, Qualcomm Nuvia and maybe even CPUs from Google and MS.
      Storm is coming...
      - Sarah Connor (this time it's not a Skynet/Genisis)

    • @passintogracegoldenyearnin6310
      @passintogracegoldenyearnin6310 Před rokem +3

      @@arm-power Name and pfp check out, this is definitely marketing material.
      No current architecture, no performance paradigm currently in large scale use is equipped for the next steps in computing. X86, ARM, RISC-V, GPGPU, fixed accelerators, none of them are properly offering three-dimensional compute structures. We are running into the absolute limits of 2.5D circuit design and we've barely touched the potential of bonded layers with through-silicon vias.
      But all of that aside SPECINT is a measure of raw throughput and has nothing to do with task-oriented compute loads. In real performance a single 84-core Zen 4 chip can often match dual 64-core Zen 3 processors. This is due to the faster memory and all of the other small changes throughout. In some cases the performance increase from AVX is closer to ten times when comparing 96-core Zen 4 against 64-core Zen 3. TDP is tunable and there are two other whole platforms, the density-optimized Bergamot and the cost-optimized Siena. Neither you nor I know enough about them yet. NVidia Grace is a different story. The Grace Hopper superchip is a 1000W TDP scenario and will be compared against AMD Instinct mixed-mode APUs. The Grace-Grace CPU superchip will have its chance to compete but I am expecting high TDPs and case-specific system performance. You can check numbers on Phoronix but at least against dual-socket Altra the new Zen 4 is kinda scary. Also in terms of the case you laid out, CISC-to-RISC conversion now usually takes place in a single clock cycle as the instruction hits the pipeline. And CISC instructions can require less storage space and memory bandwidth. The biggest difference is that ARM has always been driven by power efficiency goals and X86 forgot about those goals to chase after absolute performance. We're currently seeing convergence as both architectures become increasingly similar in terms of manufacturing process and design goals. X86 chasing efficiency and ARM chasing performance.
      Also an H100 Hopper single card appeared to be priced around $35K usd with the Grace Hopper expected to be monumentally more expensive. And the Grace-Grace superchip is not expected to be a $1000 CPU. You'll be comparing $100K+ systems against each other, probably. Please stop trying to spread disinformation.

    • @passintogracegoldenyearnin6310
      @passintogracegoldenyearnin6310 Před rokem +1

      @@arm-power I followed up and ran some publicly available numbers. The 128-core Altra Max was listed at $5800 usd and 250w TDP or about 2w per thread. In testing it traded blows with the Epyc 7763 which has similar memory channels, PCIe lanes and in fact watts-per-thread. Main difference being the ARM CPU itself costing less but the costs of moving to the new platform being significant with little to no gains in performance or efficiency. The 32-core 7F53 could even match or beat the Altra Max in some tests, and the 7773X also needs to be considered. The new top chip in Genoa is 96 cores, 192 threads at 360w default package limit (1.875w per thread). This chip annihilates Milan in many tests and the new 32-core F series is far faster than previous F series. I have not seen a good, blow-by-blow direct comparison but it looks like Altra Max 128 cores would lose in both raw performance, performance per thread and maybe even performance per watt.
      Grace has an estimated performance of 370 per 144-core package, so yes about 750 for a Grace-Grace superchip. Divided by 288 threads, not 144. That would be roughly 2.6 points per thread which is maybe 60-65% of AMD's points per thread based on AMD official numbers. Third party vendors say that the score should be closer to 1900 in their testing which would be a ratio of about five points per thread for AMD. If the 128 core Altra Max with reduced CPU cache sizes needed 250W TDP on N7, the 288 core Grace-Grace superchip could draw 600w and still get such a low core ratio. Genoa's 32-core F series part is a thousand dollars cheaper and can beat the Altra Max in several tests, but Bergamot is where the direct comparison will take place.

    • @arm-power
      @arm-power Před rokem

      @@passintogracegoldenyearnin6310 1) 2018 Cortex A76 (Altra max / Neoverse N1) has IPC similar to Zen 1 (2017).
      2) 2020 Cortex X1 (Graviton 3 / Neoverse V1) has IPC 50% higher A76 and about 5% higher than Zen 3 (2020).
      3) 2022 Cortex X3 (Grace / Neoverse V2) has IPC 20% higher X1, so approx 10% higher than Zen 4.
      That's the real data, yours are wrong. SMT almost halves x86 IPC which is already behind ARM Neoverse. 64-core Graviton 3 @ fixed 2.6 GHz is super dangerous already today - slightly faster than Zen 3 Milan (despite SMT , 280W TDP and boost clock) but G3 consuming only 100W. Loot at Phoronix tests.
      Now Grace (and Graviton 4 possibly) based on X3/V2 core with 2MB L2 cache will have IPC between Zen 4 and Zen 5. X3 is absolute x86 annihilator. When you look how good results Altra and Graviton 2 server chips reached despite old A76/Neoverse N1 (with IPC of Zen 1 but N1 core is tiny 1.4 mm2 including 1 MB L2 cache, for comparison Zen 2 is 3.5 mm2, both 7nm) then imagine X3/V2 with 80% higher IPC. No SMT means very high performance per thread despite low N1 Zen1-like IPC.
      And ARM has up to 2048-bit SIMD SVE2 vectors with matrix instructions. What x86 has? 512-bit AVX and no matrix instructions (for that you need new Intel's AMX in upcoming Sapphire Rapids).
      Plus ARM released new SIMD extensions: SME and SME2 (Scalable Matrix Extension) with 2048-bit and tons of new useful matrix instructions. Not sure if V2 core will support SME but if yes, even bigger leap ahead for ARM.
      Grace will massacre Zen 4.

    • @passintogracegoldenyearnin6310
      @passintogracegoldenyearnin6310 Před rokem +2

      @@arm-power Oh it will be interesting. Intel and ARM continue to invest in accelerators which work very well in specific optimized loads, while AMD is planning FPGA integration to allow for software-defined fixed function circuits in the data center. I plan to look deeper into what Phoronix has for Graviton 3 now that you tipped me off to the fact they did some benching. Probably within as little as five years most HPC will be done with task-based semi custom chips and we'll finally see solid efficiency gains across the whole industry.
      Do you think Samsung will be able to crack the consumer market with ARM-based Windows laptops? Genuine question here.

  • @johndoh5182
    @johndoh5182 Před rokem +19

    I agree about the importance of this launch for AMD for Zen 4 CPUs across an entire spectrum of products.
    While the typical PC enthusiast has been complaining about MB pricing for which AMD can do almost nothing about, they fail to see how the economics of the CPUs that AMD are making is going to play out and how much better this gen is than others. You now have two lines of server CPUs and two lines of laptop APUs and this allows AMD to target use cases much better, and all this riding on TSMC N5

    • @hufthenerd7135
      @hufthenerd7135 Před rokem

      AMD is actually going to have 4 lines of Server CPU's. They may use the same socket, but they'll have Bergamo, Genoa, Genoa-X, and Siena. Thats 4 seperate lines of server CPU's to choose from depending on the needed use case of the customer. That flexibility is wonderful, and not something that you currently really see from intel.

  • @scarletspidernz
    @scarletspidernz Před rokem +12

    15:43 this is what needs to happen more and more, shared learning and confirmation at single resource point

  • @StargazingCeres
    @StargazingCeres Před rokem +9

    Wendell, there's a good chance I'll never even be in the same room as an EPYC system in my life, but your enthusiasm for it really makes my day anyway.

    • @morosis82
      @morosis82 Před rokem +3

      It's not that crazy a thought. These things depreciate hard over a few years, it cost me a couple grand to put a 32 core Rome server with 256GB RAM together.

    • @reezin14
      @reezin14 Před rokem

      @Stargazer on Ceres, I would agree with this in everyway...

  • @tommihommi1
    @tommihommi1 Před rokem +6

    33:49 this kind of configurable interconnect has been seen in some retail previous generation epyc platforms that STH covered

  • @enb0rn
    @enb0rn Před rokem +7

    This is such a good rundown of Genoa! I don't work with servers but this video made me excited about the products anyways. Wendell is so good at explaining stuff with excitement but still not be over the top in the presentation of said explanations and or information. Really professional and engaging! I hope all the best for you Wendell and team!

  • @skaltura
    @skaltura Před rokem +23

    This is damn exciting! You really drive it through :)
    We typically use 3+ year old servers, but this is the first time i asked already what supermicro parts would cost to build already a system like this :O
    These can push so much performance that we could potentially do 1:10 consolidations with just "basic" servers (we have a lot of E5 v1s still in production) if just enough memory can be installed

    • @astronemir
      @astronemir Před rokem +1

      We can literally move entire clusters to a single dual socket rack. It’s nuts

  • @spiralfractr
    @spiralfractr Před rokem +7

    I love this man...... "If you've ever come to the Level1 forums for help with your open-source project... AND I LET YOU REMOTE INTO A SYSTEM... chances are... it was this system"
    Thank you for what you do for our community Wendell.

  • @fatherguse9019
    @fatherguse9019 Před rokem

    Thank You .. I always learn something when watching your vids .. I very much appreciate your time and the dedication you show to sharing the info .. the fact that you are having a blast and "in you element" when doing this in not lost either.

  • @nymnicholas
    @nymnicholas Před rokem +5

    He is trying to stay sane and talk abt it. It must be a really Happy Day for him and the AMD fans. Peace :-) 192 Cores (2 Procs), 6TB ECC per Socket... This is God level H/W.

  • @shinokami0076
    @shinokami0076 Před rokem +1

    seeing Jake from LTT and Dr Ian Cutress is cherry on top of a LEVEL ONE video ahaha ;)
    Thanks guys

  • @jtmuzix
    @jtmuzix Před 9 měsíci

    Wendell is for real! He knows his stuff too, not just hardware but software as well. He definitely passes the litmus test.

  • @TanisHalfE1ven
    @TanisHalfE1ven Před rokem +2

    OMG Wendel was within spitting distance of my work next to AMD and I didn't get to meet him. So sad. Literally drive by the AMD office every day.

  • @fnaaijkens69
    @fnaaijkens69 Před rokem +1

    LOOOOOVE the 40,000ft helicopter view + gritty detail. Very nice presentation!

  • @markb7533
    @markb7533 Před rokem +3

    This type of thing never comes up in my healthcare job.
    Wendell’s enthusiasm makes my time away from work better 😊
    Thanks to the crew at L1 :)

  • @mianderson86
    @mianderson86 Před rokem +6

    Man these new chips are rad, one thing I love about being an MS partner is the licenses I can test with. Can't wait to see your tests.

  • @voidmind
    @voidmind Před rokem

    The thumbnail and the little 3 seconds clip that plays when you mouse over the thumbnail are just perfect.

  • @paxdriver
    @paxdriver Před rokem

    I was just on your forums talking about flexible pcie lane configuration this month and here's CXL - my dreams come true.

  • @shammyh
    @shammyh Před rokem +1

    Wonderful video! Very good contextualization of why Genoa is so amazing... Behind just the top line numbers.

  • @MrHaggyy
    @MrHaggyy Před rokem +2

    Oh boy this thing really raises x86 server stuff in the territory of older IBM Power systems. And will make datacenter much smaller, easier to run and far more efficient because you need way less power supplies, cabels, boards, power stages you name it.

  • @axessx
    @axessx Před rokem +2

    THE BEST HARDWARE DIVE EVER!! Love the Channel. This explains all the EPYC stock of Mobo and early Epycs on Ebay.

  • @isaacjjones
    @isaacjjones Před rokem +11

    I'd like to see some comparison numbers for a single 96c/192t CPU vs previous gen dual 64c setups! Unfair advantage I know, but still. As always, great job Wendell

  • @kenm3209
    @kenm3209 Před rokem

    I love to watch you Wendel as you remind me of my oldest brother, who was a 'computer mother' back in the 70 - 90's.

  • @zacharyschneider
    @zacharyschneider Před rokem +1

    Jake from LTT in the beginning is hilarious. Assume they have a video coming soon as well🤣🤣

  • @lilblackduc7312
    @lilblackduc7312 Před rokem

    Your Equipment Room is shaping up, Wendell! Congratulations...🇺🇸 😎👍☕

  • @benjaminoechsli1941
    @benjaminoechsli1941 Před rokem +8

    L1Techs is my go-to channel for geeking out over insane new server parts. So cool to see AMD giving Wendell everything he needs to show off the parts and imagine the possibilities.
    Edit: Making a platform that "can be whatever you want it to be, baby~" is a great way to start another 5 years of AMDomination in the server space. Here's hoping Intel brings something equally attractive with Sapphire Rapids and beyond! Because competition is good for everyone.

  • @landwolf00
    @landwolf00 Před rokem +4

    Never stop making videos. This is such awesome coverage!

  • @lesso187
    @lesso187 Před rokem +1

    Thanks for the info dump on this new product line from AMD.

  • @gryrvn
    @gryrvn Před rokem +1

    Perfect "Tech Evangelist" thumb nail, ... keep up the good work :-)

  • @DS-pk4eh
    @DS-pk4eh Před rokem

    Great video.Lot of information. While video is 43min, I it will take 2 hours to watch it properly (as you pause on bench results). Speaking of bench graphs, it would have help, us plebs, who are not familiar with CPU naming, to have number of cores next to their name > Epyc 9374F (32c).
    Thanks, again, really great video.

  • @leviathanpriim3951
    @leviathanpriim3951 Před rokem +1

    wow, that is pretty intense. will be interesting to see what this is capable of creating and learning

  • @johnramsey8712
    @johnramsey8712 Před rokem

    Thankyou so much for the video..........awesome.
    I only have 5800x and am very happy with it but from my understanding when this PC of mine gets passed onto my wife and I go PCI 5 etc in maybe 2 years from now maybe I can also benefit from the trickle down effect as Tech trickle down does work unlike the financial markets where the pennies have run out long before they reach the lower levels.
    That CXL discussion sounds really cool and I wonder how long it takes before it hits the consumer market? funtimes ahead indeed.

  • @jordancave6987
    @jordancave6987 Před rokem

    You're looking much slimmer these days Wendell, and you look fantastic mate! Much love from Singapore

  • @GearSeekers
    @GearSeekers Před rokem +3

    I need this in my life!

  • @R0ger123
    @R0ger123 Před 10 měsíci

    5:26 Loved the over 9000 reference

  • @theretrogamers7690
    @theretrogamers7690 Před rokem +3

    I can only imagine how many TempleOS VM's I can run on one of those.

  • @lavishjaat
    @lavishjaat Před rokem +1

    0:13 A Wild Jake has appeared

  • @pkt1213
    @pkt1213 Před rokem +6

    I really wanted to get a Genoa (or Saphire Rapids) server. As it will probably be my last on prem server, DDR5 and all the newest stuff. I had to settle for dual 32 core Milian which is still smokin compared to the dual E5-4617 w/ DDR3 it is replacing.

  • @MIBxSpartan
    @MIBxSpartan Před rokem +1

    Me as a sysadmin trying to figure out a way to convince my CIO that we need some of these to run our Citrix apps😂

  • @TeeTeeNet
    @TeeTeeNet Před rokem +1

    Damn these CPUs look good! On that note, looking good Wendell!

  • @TheNefastor
    @TheNefastor Před rokem +6

    Also, they'll now sell you thermal compound in cartridges along with a caulking gun to apply it 😀

  • @johnohara4046
    @johnohara4046 Před rokem +1

    The performance on show here by AMD is truly next level. Mind blowing sophistication commoditised. This kind of performance might get people building their own data centres again -- if you are a large consumer of compute, cloud is not cost effective (only supremely flexible, which is a different benefit).

  • @trendingtopicresearch9440

    Thanks for the vid. Would love to see it in 4k@60. Any reasons it's only 1080?

  • @sneedplays
    @sneedplays Před rokem +7

    Nice, I will put this right next to my brand new John Deere...(I wish)

    • @danielsnyder2288
      @danielsnyder2288 Před rokem +1

      The Deere is about the only thing more expensive than 192 cores :) AMD might be upset if you paint their chips john deere green :) They are more a Massey company 🤔

    • @sneedplays
      @sneedplays Před rokem +1

      @@danielsnyder2288 Well, partner, I like me them chiplets.

  • @GustavoBeneduzi
    @GustavoBeneduzi Před rokem +5

    If you ever want help to setup a WRF forecast test domain, I'm free to help. It can be a good test for longer/continuos process with heavy mpi workloads, and large cross cpu data transfers.

  • @pringl3s
    @pringl3s Před rokem

    Best content i've seen in a long time!

  • @jpsolares
    @jpsolares Před rokem

    Nice video, like a investigation, lot of info and good one, thanks.

  • @MommaMolly
    @MommaMolly Před rokem

    this video literally helped me get a job. I used the content of this video to be an IT system engineer for northrop.

  • @KaosArbitrium
    @KaosArbitrium Před rokem +3

    CXL sounds like it would also be a very good solution to some of the problems that seem to come up with multi-chip-module devices. Edit the implementation to focus a bit more on speed and performance, streamline it and bake this in as part of a Master chip's silicon instructions and do some good driver overhauls for communicating with other devices. I could easily see two, four, eight, etc. chips all working together on a PCI-E card, sharing memory tiers and caches, handling operations concurrently, and throwing out data like a hot-damn.

  • @Wagoo
    @Wagoo Před rokem +5

    I'd love to get this hardware in a nice quiet 4U server for home in a few years. Still got a 2x4 core opteron box with 64GB RAM running from 2008 lol

  • @johndoh5182
    @johndoh5182 Před rokem +9

    This is I think the 2nd video you've made after an AMD EPYC release where you are singing the praises about AMD and what they accomplished. That really says a lot about where AMD has come from and where they are now. I expect their market share for X86-64 server to get up to around 25% after the main Zen 4 run, and probably 30 - 35% after Zen 5.
    And people were being critical with AMD with Zen 2 EPYC saying things like "AMD only has xxxx amount of the server market", and I would respond saying for a small company to go from near 0 - 10% is a LOT of sales since the world of server is so large now.
    After Zen 5, I think Intel will start to pull back some market share IF they can keep on track with their "Intel 4" and then "Intel 20A" nodes. If they can't they're in trouble. TSMC can't manufacture enough die for Apple, AMD and Intel and they're going to prioritize Apple and AMD since they're fabless, whereas Intel is a direct competitor and wants to take market share from TSMC in the world of fabrication. So TSMC is never going to be the knight in shining armor for Intel.

    • @AOTanoos22
      @AOTanoos22 Před rokem

      TSMC is going to priorities whoever pays the most, not if they’re fabless or not.

    • @WayStedYou
      @WayStedYou Před rokem

      @@AOTanoos22 TSMC has a better relationship with AMD than the others now though since Nvidia has tried to cancel orders and intel hasn't really bought anything from them until recently

    • @AOTanoos22
      @AOTanoos22 Před rokem

      @@WayStedYou well thats true to a certain extend, AMD and Apple will have priority as long as everybody is paying around the same and other players don’t make a significant difference. TSMC is a publicly traded company after all, their shareholders want to see more profits, especially in these days in which we’re facing a regression.

  • @joshxwho
    @joshxwho Před rokem +7

    Once avx512 catches up, it's going to be nuts.

    • @666Tomato666
      @666Tomato666 Před rokem

      the nice thing is that for development you don't need to go for those monster parts, you can get desktop stuff from AMD and have local development
      lack of that was a huge issue with the Intel market segmentation for their AVX-512 offerings

  • @jztpnt
    @jztpnt Před rokem

    Looking forward to a sweat spot for VDI server bundle with these new AMD EPYC

  • @DFX4509B
    @DFX4509B Před rokem +3

    Wonder if or when an sTRX5 version of this will come out for the TR workstation line.

  • @tanmaypanadi1414
    @tanmaypanadi1414 Před rokem +1

    who needs sleep when Wendell drops a video.

  • @asmongoldsmouth9839
    @asmongoldsmouth9839 Před rokem +2

    48 cores at 4.1GHz boost and 96 cores at 3.7GHz boost. Those are both insane accomplishments. (They all are. But these 2 milestones really stick out).
    All of the benefits of being on DDR5 almost double the efficiency and performance. I am shocked. What a time to be alive.

    • @thepopeofkeke
      @thepopeofkeke Před rokem

      That’s equal too 24 dell 7010s with i7 3770.
      Someone should buy 24 of them for $3000 and do server performance test against this $12,000 monster lol
      That would be super fun

  • @ambientnaturally
    @ambientnaturally Před rokem

    I LOVE this idea!
    But I'd have to plug it into two circuits I think.
    But this would process my CPU-driven 3D artwork fast!

  • @brick4667
    @brick4667 Před rokem

    I was waiting for the "And were doing a AMD Test Platform giveaway!" ;)

  • @OfficialiGamer
    @OfficialiGamer Před rokem +1

    And here I am running a 4 core haswell server still. But it does what it's supposed to

  • @schrummy14
    @schrummy14 Před rokem

    I didn't see it in the write up, but did any benchmarks for LAMMPS or OpenFOAM get run?

  • @penzancepirate
    @penzancepirate Před rokem

    I'm weirdly proud of the fact that such a great new platform takes then name of my hometown haha

  • @steelfalconx2000
    @steelfalconx2000 Před rokem +4

    I can't wait to buy this used in 10 years 😆

  • @fredbecker607
    @fredbecker607 Před rokem

    Love that monitor setup

  • @Matt-oq4jq
    @Matt-oq4jq Před rokem

    hey, i have that exact same AUKEY keyboard. love to see my insane tech miserliness being validated by wendell, lol

  • @asdf51501
    @asdf51501 Před rokem +1

    AMD is on fire! And so is Level1Techs with this video. 😃👍🏻

  • @aliawada1126
    @aliawada1126 Před rokem +1

    So fast Wendell!

  • @UNSTOPABLE40XBOX
    @UNSTOPABLE40XBOX Před rokem +10

    I don't need it but i want it.
    I can't wait for threadripper to come out with this socket.
    I saw the pricing and it's great, for the performance that you get, it looks like a great deal.

    • @crazybeatrice4555
      @crazybeatrice4555 Před rokem

      Threadripper probably won't be this socket. However, I think a Threadripper with zen4c could be pretty interesting.

  • @deilusi
    @deilusi Před rokem

    18:35 I think module gains are even bigger than mentioned.
    it's standardized connector so in case of problem in that part, you can just pull it out and plop a newer version of that module, which would be both WAY cheaper than replacing the whole server, and it's more stable for users that need that 99.9 uptime, and don't have time to validate another hardware stack, because of some random bug waaaay deep in infrastructure parts they don't care about. I am sure it will not be JUST plug and play, but there is an option now, which was not there before.
    BTW, anyone has already tested PSQL behavior ? I would love to see those. I have a certain ROME server that, maybe, could get a little bit more OOMPH.

  • @marcin_karwinski
    @marcin_karwinski Před rokem +1

    Wonder what a Zen4 Threadripper is going to be like given the regular 16c R9 and those Epycs already show potential for greatness...

  • @norbertdrage
    @norbertdrage Před rokem

    5:28 "Is it really over 9000?"
    *hands Wendell a scouter to make sure* (:

  • @Jake9066
    @Jake9066 Před rokem +4

    Man, they let Jake out of Canadia?

  • @LA-MJ
    @LA-MJ Před rokem +3

    If only we had PCIE flexibility on the consumer platforms..

  • @helmanfrow
    @helmanfrow Před rokem +1

    15:25, Apologies in advance for the OT: What's the make and model of your huge screen?

  • @mikejennings7897
    @mikejennings7897 Před rokem

    Your running RHEL on the 64 core machine. Is there a diff running an enterprise software vs the likes of Linux Mint ?

  • @Catge
    @Catge Před rokem +3

    Amazing what AMD has revealed recently.

  • @Fetrovsky
    @Fetrovsky Před rokem +1

    Where do you get workstation motherboards and cases for Epyc?

  • @kenzieduckmoo
    @kenzieduckmoo Před rokem +1

    imagine in a few years when they get the DNN running and it slides down to consumer and gets incorporated into FidelityFX where the CPU boosts gaming performance as well

  • @locusm
    @locusm Před rokem

    What brand is that server AMD shipped you?

  • @otheremail123
    @otheremail123 Před rokem +2

    Very exciting, epic :)

  • @memyself879
    @memyself879 Před rokem

    Excellent excellent overview

  • @AdHdEntertainmentLLC
    @AdHdEntertainmentLLC Před rokem +1

    I can only dream of that processor power

  • @herrpez
    @herrpez Před rokem

    Wait, you mentioned linking to the AMD tuning PDFs, but I'm not seeing them anywhere. Am I blind?

  • @peppybocan
    @peppybocan Před rokem +3

    EPYC server: 50,000 USD
    MSSQL server licence: 1,000,000 USD.
    omfg.

  • @ace90210ace
    @ace90210ace Před rokem

    I'm curious and this seems good place to ask. Can you mix and match you epyc CPUs ina duel socket board so you could try get best of both worlds going for one xpu that's max core count and next the fastest core speed with decent number of cores

    • @carl8790
      @carl8790 Před rokem

      No. Both CPUs have to be identical. There's a slide in this video from AMD that mentioned it.

  • @alexfleener
    @alexfleener Před rokem +1

    WOW!

  • @V1N_574
    @V1N_574 Před rokem

    Judging by the content and AMD calendar I assume that Wendell is still alive. So glad. Thought he was dead for real hahahaha

  • @rudypieplenbosch6752
    @rudypieplenbosch6752 Před rokem +7

    Wow this is amazing, 12 memory channels, 192 cores 😎. Still no FPGA on there ?

    • @JasperSchwinghammer
      @JasperSchwinghammer Před rokem +7

      With that PCIe Bandwidth you could argue that a FPGA could just be added as PCIe Device.

  • @lua-nya
    @lua-nya Před rokem

    Can we hope to get that 1W per core on a smaller, cheaper edge form?

  • @TheSocialGamer
    @TheSocialGamer Před rokem +1

    Can I ask if it runs Cyberpunk 2077 at Maxed Settings with Ray Tracing though? 😆 So much compute power! Mind blown!

  • @TonySquared09
    @TonySquared09 Před rokem

    Wendell, talking about tech coming from AMD. Meanwhile, I'm too distracted hyperfocusing on that Ubuntu update dialogue.