My Biggest Server Rack Change Yet

Sdílet
Vložit
  • čas přidán 15. 06. 2024
  • Thanks to Linode for sponsoring today's video. Get a $100, 60-Day credit just for signing up at linode.com/CraftComputing, and start hosting your servers in the cloud!
    What better way to spice up your server rack than retiring a $3000 Epyc CPU and replacing it with two Intel Tiger Lake 11900H mobile chip engineering samples. Today I set out to restructure my entire server, not only trying to boost performance and network speeds, but reduce power consumption, and in turn... my power bill.
    But first, what am I drinking!?
    Mixology March is winding down, and I'm running out of time for projects. So I'm just drinking a cranberry juice today.
    Links to items below may be affiliate links for which I may be compensated
    Check out the parts from today's build:
    2U RackChoice Chassis: amzn.to/3lRecPT
    Erying TigerLake 11800H 2.2GHz 8c/16t: s.click.aliexpress.com/e/_DES...
    Patriot Viper 2x32GB 3600 Kit: amzn.to/3zewiP1
    Silicon Power 1TB A60: amzn.to/3zdw2zI
    Intel Box Cooler for LGA 115x/1200: amzn.to/3M6qP4t
    350W Power Supply: amzn.to/3npJI81
    nVidia Tesla P4: ebay.us/OjMWTE
    Grab yourself a Pint Glass or Hoodie at craftcomputing.store
    Follow me on Mastodon @Craftcomputing@hostux.social
    Support me on Patreon and get access to my exclusive Discord server. Chat with myself and the other hosts on Talking Heads all week long.
    / craftcomputing
    The following music was used for this media project:
    Music: Morning Stroll by Steven OBrien
    Free download: filmmusic.io/song/10523-morni...
    License (CC BY 4.0): filmmusic.io/standard-license
    0:00 - CAT
    1:35 - Welcome Back
    4:08 - Unboxing and Build
    6:21 - WHOOPS
    6:25 - Memory and Storage and Cooler
    8:34 - Graphics Cards
    9:51- SERVER MONTAGE
    14:15 - Post-Mortem
    16:53 - Why Did I Do This?
    18:24 - Sign Off
  • Věda a technologie

Komentáře • 202

  • @rustybobdotca
    @rustybobdotca Před rokem +133

    I can forgive using a stock Intel cooler, especially the newer, cooler looking black one. Paying $11 for said cooler though, that is unforgivable :)

  • @pascalleroux7881
    @pascalleroux7881 Před rokem +34

    To comment on "Why Did I Do This", this is the exact reason why I keep watching this channel. I like to see how creative you can be to pull out option of homelab without having to spend 3k for a decent setup. Or maybe I'm following because I like beer... :) IDK.... Has always, keep up the good work Jeff!

  • @kalark
    @kalark Před rokem +3

    Great video! Thanks again for the video about the erying motherboard/cpu because I put my erying 12800h into my server as well! It was quite the upgrade from my older server setup with a xeon e5 2470v2, PLUS my server idles so much lower now. I love it

  • @Solrak8O
    @Solrak8O Před rokem +36

    I'm glad power consumption was addressed in this video Jeff. I know electricity is pretty cheap in your neck of the wood but for most of us around the world it's not the case, or soon won't be. I do really enjoyed watching your home-lab/server builds but always thought " I'd never use X or Y components Jeff is using in my own home-lab as the daily power consumption, heat and noise would put me off. Those Erying Tiger Lake boards look like a real winner! I'm waiting patiently for when they release an ITX version........ Well, would you look at that? Erying has released a 12th gen version in ITX flavor! Sweet! I just picked up an i5 12500H (12C 16T little beast) for $400 AUD. You should pick one up for a ITX build for the channel Jeff?

    • @ExtremeMetal
      @ExtremeMetal Před rokem +4

      Imagine sticking a couple of those ITX boards in a 1U case, that'd be some pretty dense power efficient compute power

    • @SenZubEanS
      @SenZubEanS Před rokem +5

      I wish I didn't just scroll down and read this... you bastard!

    • @Solrak8O
      @Solrak8O Před rokem

      @@SenZubEanS I know what you mean! I thought just on the off chance I would check AliExpress as I heard Erying were working on a Intel 11th gen ITX board. Low and behold 12th gen CPU/mobos were listed!

    • @TheGoatPC
      @TheGoatPC Před rokem

      How are you using the 12th gen board? I am looking for something to setup cloud gaming vm's with a P4 myself and curious how promox uses the E-cores.

  • @shutdowncnn6086
    @shutdowncnn6086 Před rokem +3

    I have to admit the reasons for doing your own computer builds both servers and workstations is fun. Been doing computer builds since mid 1990's. More than 8 up and running on two homes. But now both of us retired my wife has other ideas, like boating. riding motorcycles. Here in Florida everyday is a Saturday. :) Thumbs up Video!👍👍👍 😀

  • @paulbrooks4395
    @paulbrooks4395 Před rokem +6

    Ooo a new GPU, that last review on the 70W card was mind blowing in how capable it was. Would love to see a comparison.

  • @SteveOwensRoswell
    @SteveOwensRoswell Před rokem

    Great video ... looks like lots of fun. Appreciate the reviews of the Tiger Lake board ... have one on the way.

  • @greenprotag
    @greenprotag Před rokem +21

    I am super excited to see how these TGLs fair in virtualized gaming workloads. Tesla T4s and P4s are very very interesting little GPUs.

  • @Snowynonuts
    @Snowynonuts Před rokem +2

    Love your videos Geoff, making me wanna host my own cloud services more and more....

  • @jtkoffenberger8922
    @jtkoffenberger8922 Před rokem +2

    Enjoying the videos. Keep up the good work. What did you use for the drive bays?

  • @popcorny007
    @popcorny007 Před rokem +3

    Cluster tutorial! Cluster tutorial! Cluster tutorial!

  • @markh2827
    @markh2827 Před rokem

    Always enjoy watching your vids 👍

  • @joemelnick
    @joemelnick Před rokem

    Love the Linode Intro today Jeff, Thanks :P

  • @kellyslow5506
    @kellyslow5506 Před rokem +2

    I have the Erying ES 2.6GHz version. I put it in the cheapest case I could find with 16GB 3200 (soon to be at least 32GB), a 2TB PCIe 4.0 M.2 and a Red Devil 6900XT. This will be my room scale VR machine. I did overclock it and the CPU is pulling almost 120w. I went with liquid metal between the CPU and the copper spacer, then added an Arctic Freezer 34 eSports DUO cooler. The liquid metal stopped the thermal throttling at 97c to a max of 74c! And got me up to just shy of 5.1GHz on most cores.

  • @davidsaunders216
    @davidsaunders216 Před rokem +2

    Nice new layout. Currently just running a single truenas on 6th gen intel but with the stock cooler also. It works…

  • @DonaldMolter
    @DonaldMolter Před rokem +21

    I’m curious, are these severs standalone proxmox hosts or clustered? Also I’d love to see how you utilize the ssds into your setup of the two erying servers.

  • @itsdeonlol
    @itsdeonlol Před rokem

    This is really cool Jeff!

  • @markphillips8019
    @markphillips8019 Před rokem +1

    I love your "Blue Peter" moment. Well done.

  • @jason-budney7624
    @jason-budney7624 Před rokem +4

    I have to agree that swapping parts and rebuilding machines is the best part of having a homelab or just multiple computers for that matter. I've always preferred playing with hardware over software.

  • @sjftech
    @sjftech Před rokem +1

    I think I spot SNK vs. Capcom: SVC Chaos on the arcade cab in the back :)

  • @cchalogamer
    @cchalogamer Před rokem +4

    I noticed when I was testing out some things on my ERYING board (I found and ordered one about a hour before you posted your first video on them) that if I used both M.2 storage slots (I also had a wifi card in at the time) the x16 slot was only running @ 3.0 x4 speed with my 1070 in it. I ended up only using one SSD in the top M.2 slot and my old 1080 Ti for the GPU with everything working full speed as normal so I never looked into it, but seeing you put two SSDs in made me remember that issue that I never bothered to troubleshoot. IDK if mine takes lanes from the GPU for those other slots or if maybe I set something crazy in the 100% easy to use no confusion to be found BIOS. /s I know for overclocking this one it's running windows so I just decided to use Intel XTU (had to enable an extra setting in an obscure menu for XTU to see it as an OC capable system but works great now) Little undervolt here, touch of extra PL1/2 there, and up those multicore muiltipliers and it's a beast for the money. I want to order the new 12th gen version they haveout now, but they're all non ES and I'm too cheap for that.

  • @TheMongolPrime
    @TheMongolPrime Před rokem +9

    Freaking love it. Great job on the project. Definitely jealous of the power draw to performance ratio.
    It's been a while, could you possibly show us a diagram of your network layout and how you have things set up for the lab topology? I'm curious how you VLAN this stuff.

  • @felixandy
    @felixandy Před rokem

    Such a satisfying video!

  • @maxbroomfield5392
    @maxbroomfield5392 Před rokem

    Best Linode AD so far!

  • @alexanderr6106
    @alexanderr6106 Před rokem +2

    Mine arrived today. At the Wall its pulling 150w at full boost. Not quite the 45w mark. Idle is about 15-30w.

  • @ultraprecisiontechnologies

    I loved everything about that intro

  • @jamesmcelfresh174
    @jamesmcelfresh174 Před rokem +3

    Would you consider purchasing one non ES board for the contrast point of what doesn't work with the Engineering Sample boards? This is especially relevant since you are doing virtualization on the systems.

  • @HoosierHardware
    @HoosierHardware Před rokem +1

    Okay, but the server montage music was 🔥

  • @eformance
    @eformance Před rokem +2

    Look at the X10DRC-T4+, it has the same slot layout but they are x16 slots and it's dual socket.

  • @DIYDaveOK
    @DIYDaveOK Před rokem

    The "paradigm couplers." That's awesome.😂😂😂

  • @camjohnson2004
    @camjohnson2004 Před 7 měsíci

    I have to admire you, using a Engineering Sample CPU to run a server is ballsy :) Though I am about to get a similar board based on 13th gen from them to use as a low power HTPC

  • @ArifKamaruzaman
    @ArifKamaruzaman Před rokem

    I've been sceptical about SP SSDs. Now I see you use it in server, I'll give it a try.

  • @BeeWhere
    @BeeWhere Před rokem +1

    Fun video as always, I'm updating my 1st gen thread ripper that has been running truenas and all my plugins. New version will be Ryzen 5700g to cut power and need for a GPU.

  • @112Haribo
    @112Haribo Před rokem +2

    Nice job, however a bit sad the 1 U blue server is going away. It was such an interesting machine!

  • @tatercrisp7186
    @tatercrisp7186 Před rokem

    this is beautiful to watch

  • @PatientXero607
    @PatientXero607 Před rokem

    HAHA, I love the linode sales ad. 😁

  • @trunksviper6583
    @trunksviper6583 Před rokem

    new servers are looking pretty nice

  • @TheMchip
    @TheMchip Před rokem +1

    hahah loved that intro! :D aswsome :D love the video overall :)

  • @lukemiller359
    @lukemiller359 Před 2 dny

    Checking back in a year later to say, I built one of these erying 2U servers for my homelab and have been enjoying it. HOWEVER, the intel stock cooler randomly died. Weirdly enough, the heatsink was enough that the CPU was fine--just limped along at 90C until I got a new cooler.

  • @reverendaero
    @reverendaero Před rokem

    Glorious ad, as always

  • @Aimtjie
    @Aimtjie Před rokem

    Great video! I keep meaning to ask what do program do you use to play games remotely on your cloud gaming servers?

  • @joshdemott7919
    @joshdemott7919 Před rokem +1

    just watching this video makes me sneeze.

  • @ManCheese-Mo
    @ManCheese-Mo Před rokem

    I dodnt know I was watching a linus tech tips video.
    Damn jeff, get it together!

  • @juffma
    @juffma Před rokem

    The Message at the end is so true. We have the luck to get our hands on an 12 year old used server. But it surely would run on other hardware as well

  • @ewenchan1239
    @ewenchan1239 Před rokem +3

    Wait....I'm confused.
    If you've retired your EPYC system with Tiger Lake systems, aren't you also giving up all of the PCIe lanes that the EPYC gives you that the Tiger Lake system does not?

  • @vascovalente3929
    @vascovalente3929 Před rokem

    Fascinating !

  • @marauder3058
    @marauder3058 Před rokem

    You turned me onto those Erying boards and just got my 11800 ES 2.2GHz with the vrm heatsink upgrade. I felt your frustration with that one, they sucked. Cant wait to get the rest of my parts and use it to replace my Dell HTPC with a i7 2600. Going to move over the HDD and SSD in it as well as the blu ray drive and the GTX 1650.

  • @bighairycomputers
    @bighairycomputers Před rokem

    Me: What chassis is that? ATX PSU in a 2U frame without doing some jank bracket and double sided tape work? I'll take two.
    Jeff: I linked the currently available equivalent in the description.
    Me: Hopefully they ship to Guam.

  • @Sargentwhitey
    @Sargentwhitey Před rokem +1

    I might actually steal this idea for hosting some gaming servers at a remote location. I think it's time I retired that ancient r710

  • @DinkleDooper
    @DinkleDooper Před rokem

    Just picked up a 2nd gen thread ripper for this exact reason.

  • @newAfonsoFGarcia
    @newAfonsoFGarcia Před rokem

    Loved the in case of AI revolt bat'leth

  • @blastradius1432
    @blastradius1432 Před rokem +1

    I'd love to see how the performance of Epyc does compared to my aging Ryzen 2700. Tried to do a two-pcs-one-cpu type thing on it before but it wasn't satisfactory for the wife, hehe.

  • @ildoddo
    @ildoddo Před rokem +1

    How about the PCI passthrough? There are the same issues with proxmox like your previous video on i9 motherboard?

  • @TheGoatPC
    @TheGoatPC Před rokem +1

    Any update to running gaming VM's with your new Nvidia T4 on those ERYING motherboards?

  • @BlitzkriegGT
    @BlitzkriegGT Před rokem +4

    rambo its back

  • @Kuiper39
    @Kuiper39 Před rokem +2

    How did you get past the pci passthrough issues on the chinese board?

  • @neccros007
    @neccros007 Před rokem

    I'd love to see a video on the bartop behind you

  • @giornikitop5373
    @giornikitop5373 Před 10 měsíci

    nice. in the end when you talk about the total cost of the board, cpu, vga etc. around ~$600, did you use the Tesla P4 or the Tesla T4? i think T4 is about $600-$700 alone. How much did you buy the 2 T4's that u used is the servers?

  • @RyanF470
    @RyanF470 Před rokem

    Can you check the C-State compliance of the board, I'm looking to move away from my power guzzling 2697v4 pair, to a Proxmox HA Cluster with Ceph but need something that actually drops down the C-States

  • @NasaRacer
    @NasaRacer Před rokem +1

    Did I miss something with these Erying motherboards how do you add networking more than the builtin 1gbs?

  • @rahulchandra152
    @rahulchandra152 Před rokem

    Hey, I think a lot of us would like to know what services you are running. We have heard snippets of it here and there but it would be great to have a dedicated video on the running services

  • @wyfyj
    @wyfyj Před rokem

    New server day!!!

  • @jsclayton
    @jsclayton Před rokem

    What memory speed did you end up getting those boards to run at? My 3200 Corsair memory should arrive tomorrow! 🤞🏼

  • @cyberagent009
    @cyberagent009 Před rokem

    Hi, what do you use for blowing dust, is that a datavac or just compressed air or a normal air blower?

  • @michaelthompson9798
    @michaelthompson9798 Před rokem +1

    Herein Australia 🇦🇺 we’re paying around 25c (USD) based on our hourly pricing …. So a 40%+ saving on power will definitely save a tonne of cash on the quarterly electricity ⚡bill 😇💪🤯🤩👍. Man looking at that home server …… 🤤🤤🤤🤤. I’m starting small trying a smaller itx build with multiple SATA SSDs for archiving, movies, photos, backups, a little smart home setup just to get my feet wet in my home server 💪😱. Fingers crossed 😅😂🤣🤞🤞

  • @wayland7150
    @wayland7150 Před rokem

    I love the Star Trek sketch.

  • @mkbean
    @mkbean Před rokem

    We need a diagram of all these fancy moves and builds :)

  • @Gastell0
    @Gastell0 Před rokem +4

    These are nice upgrades!
    Though Tesla P4 are only listing 8GB, are you sure it's 16GB?
    Also what's the drink?

    • @iyke8913
      @iyke8913 Před rokem +4

      T4 is 16gb and the P4 is 8GB, he has both.

    • @waifulhu9898
      @waifulhu9898 Před rokem +1

      cranberry juice...
      no, seriously, read the description lol

  • @computerenthusiast402

    What Budget Mobo/CPU combo do you recommend for “Fractal Define-5 Case” that I want to load up with hard drives and 2 LSI HBA controllers ? It just a home server nothing super fast will be replacing in WD MyCloud NAS drives.

  • @Prophes0r
    @Prophes0r Před rokem

    I have my rack in my dining room/Lab and they look dirtier than yours does the day after I clean them.
    It all comes down to how much dust/pollen/mold/smog is in the area and how old the house is.
    Note: Non smoker. And my kitchen is vented separately so no airborne oil either.

  • @reto
    @reto Před rokem

    I also did away with my dual-socket X79 system and replaced it with a first gen Threadripper 😁

  • @fditty276
    @fditty276 Před rokem

    your cat's making me sneeze(and I'm not allergic) LOL Cheers!

  • @Dtr146
    @Dtr146 Před rokem

    Your power prices make me jealous. Residential prices in my area 11.2 cents per kilowatt hour.

  • @aarrondias9950
    @aarrondias9950 Před rokem +1

    I couldn't help but purchase a p4 after your last video. Using some obscure Google driver and a virtual display, I've been gaming on it through parsec. For 70 watts, and $120 CAD, it's seriously impressive.

    • @ikilledtheyellowchobin808
      @ikilledtheyellowchobin808 Před rokem +1

      What driver did you use if you don't mind me asking? I've been trying to figure out a good way to deploy a P4.

  • @lynntatro7374
    @lynntatro7374 Před rokem

    Can't you fashion an intake filter (3M HVAC filter material) to keep all dust from entering your computers?

  • @buchanpeter
    @buchanpeter Před rokem +1

    Does the chinese boards allow PCI-Passthrough to virtual machines?

  • @hcjkruse
    @hcjkruse Před rokem

    How about 4K remote gaming on that Tesla thing on that tigerlake box?

  • @daymianhogue1634
    @daymianhogue1634 Před rokem

    The question of the day is have these come back down in price since your 1st video? Would check but am at work and my work internet doesn't like aliexpress.

  • @Kolor-kode
    @Kolor-kode Před rokem

    Lost a mainboard on my home server last week. Friend has a spare, hoping the RAID5 (shhh, I know) is fine :/

  • @wkm001
    @wkm001 Před rokem

    Is the on board gigabit Ethernet enough for your application?

  • @PatientXero607
    @PatientXero607 Před rokem

    The Cascade Lake boards are coming down in price as the Tiger Lake boards are being cleaned out fast. 12650 and 12500 options are decently priced.

  • @Sunlight91
    @Sunlight91 Před rokem

    I like the goal of reducing power consumption. My webserver is an HP office PC with an i5 9500. It needs just 7W in idle.

  • @AlexOlivieruk
    @AlexOlivieruk Před rokem

    Does PCI passthrough in proxmox work on these boards now?

  • @chrisleahy7664
    @chrisleahy7664 Před rokem

    @craftcomputing isn’t the Turing version of the p4 the t4 ( the silver card?) I have a p4 in my r620 but want to put a t4 in my epyc system. Any chance at a side by side on those two?

  • @MarkoVukovic0
    @MarkoVukovic0 Před rokem

    This is nerdgasm, love it!

  • @idahofur
    @idahofur Před rokem

    Yea I separate out my system. I have one bathroom upstairs and one bathroom downstairs. I also have 2 power meters on my house. One for each level. Though my server problem is hot water. The water heater only connects to the panel upstairs. Oh, Wait!! This isn't about throne redundancy? :)

  • @MrLorddjinn
    @MrLorddjinn Před rokem

    Can we get a video of the B roll of building it?

  • @RobertPendell
    @RobertPendell Před rokem

    How long did it take you to find the screw that fell on the floor?

  • @denvera1g1
    @denvera1g1 Před rokem +1

    My server stack consisted of a cheap ~$115 used Dell CloudEdge C2100 with 12 3.5 inch drives and dual Xeon L5640
    But because those werent fast enough for plex+transcoding, i needed another machine for that, back in 2016 it was a dual X5690 build, but after the 5700G came out i switched to that.
    I recently switched to a 7950X to hopefully go down to an all-in-one box for file server+plex recording+TDARR CPU transocding+Photoprism AI image recognition.
    Unfortunately TrueNAS does not support ROCm GPU acceleration for kubernetes/apps out of the box, and a recent bug means that none of the kubernetes/apps can even access the files on my file share meaning i still need the 5700G for plex and TDARR
    While idle the stack has gone from ~600w, down to ~220w, and that includes the upgrade from a 16 port gigabit switch, to a 48 port gigabit+4x10G+2x40G
    With the 5700G out of the picture it idles at ~130w and should peak at only 350w.
    Man those 1TB optane 960P drives are awesome for accelerating pools and reducing load on the HDDs

    • @denvera1g1
      @denvera1g1 Před rokem

      Oh, and IIRC that 220w number might include my redundancy server(currently my primary until i figure out networking and move everything over to the new enclosed rack), but this server is really low powered as is all flash (18x2.5 inch) IIRC idles at 40w with much of that probably being the SAS controller and 128GB of ECC

  • @TheLukemcdaniel
    @TheLukemcdaniel Před rokem

    Would almost any other cooler be "better"? Maybe, at a bare minimum 2x cost. Would you be able to tell without having to pull out the micrometer? Likely not.

  • @Vash.Baldeus
    @Vash.Baldeus Před rokem +1

    Rambo the technician!

  • @jammin8844
    @jammin8844 Před rokem +3

    Is ECC memory no longer of importance?
    Which filesystem are you running on these?

  • @BlackDogszz
    @BlackDogszz Před rokem

    well the cost of the Mobo and Proc are going up now that they are being bought when i cheked today it was alread up over 200$ US to get these and I cant imangine the price will come back down... ill have to decide quick if I want to try these myself.

  • @sjukfan
    @sjukfan Před rokem +1

    Erying saw this video, that's why they released boards with mobile xeons. No ecc support though.

  • @s.i.m.c.a
    @s.i.m.c.a Před rokem

    this guy installing new server each week

  • @Chilledoutredhead
    @Chilledoutredhead Před rokem

    I do wonder about the money you save, 200 watts less, but what saving in energy bills is that to how much it cost to replace the hardware? This is one of those questions i plague myself with, solar panels would be awesome for the house, but i put $60 in the meter a month. if i spend like $7000 how long is it going to take me to pay off. lol. Though the one advantage straight away would be being able to run way more electronics guilt free.

  • @mndlessdrwer
    @mndlessdrwer Před rokem +2

    Intel Mobile processors really are difficult to beat when you need efficiency more than you need performance or thread count.

  • @wesch4232
    @wesch4232 Před rokem

    Interested in the cat more than server.

  • @JReinhoud
    @JReinhoud Před rokem

    Apart from being a dual slot card, is an second hand RTX A2000 not a better value/choice?
    The T4 is around €500 (cheapest option) P4 around €120 and the RTX A2000 (6GB) I can get around €250.
    And thats with cooler.
    edit: stupid question after trying to get vgpu working on a rtx 3090 (Ampere) for hours/days🤭

  • @Nalianna
    @Nalianna Před rokem

    @5:20 see how glossy the heatsink block is. it's damn near perfectly flat.