One Terabyte of RAM for the CRAFTINATOR!
Vložit
- čas přidán 20. 06. 2024
- Thanks to SkillShare for sponsoring today's video. Be one of the first 1000 people to visit skl.sh/craftcomputing06221 and get 1-month of Premium membership on the house.
Who needs 1TB of memory in a homelab? Better yet... HOW did I get 1TB of memory in my homelab??? That's all thanks to Intel Optane Persistent Memory, along with an upgrade to an Intel Xeon Gold 5218N. Check out my most expensive upgrade yet, along with some VERY impressive performance numbers.
But first... What am I drinking???
Lagunitas Brewing Stereohopic IPA, Vol. 4 (7.2%)
Links to items below may be affiliate links for which I may be compensated
Intel Optane Persistent Memory Modules: ebay.us/nXCZTk
You'll also need an Intel Xeon X2XX Gold or Platinum CPU
Thanks again to 45drives for sending out the CRAFTINATOR!
45drives.com
Grab yourself a Pint Glass or Hoodie at craftcomputing.store
Follow me on Twitter @CraftComputing
Support me on Patreon or Floatplane and get access to my exclusive Discord server. Chat with myself and the other hosts on Talking Heads all week long.
/ craftcomputing
www.floatplane.com/channel/Cr...
Music:
Backbay Lounge by Kevin MacLeod
Link: incompetech.filmmusic.io/song...
License: filmmusic.io/standard-license
Chapters:
0:00 Intro and Paying Bills
1:10 What I'm Installing
3:20 Installation
8:30 What can we do with it all?
10:34 Optane Memory Mode
13:21 Optane AppDirect Mode
18:00 Wrap Up - Věda a technologie
6:36 Dang, you cut the thermal paste application, i guess its appropriate, because 99% of the comments would have been about how wrong you were doing it.
This guy gets it ^^^^
@@CraftComputing I thought the thermal paste troll was pretty funny.
Now he just gets a load of comments about how he didn't apply Thermal Paste instead...
@@BobHannent i noticed the sneaky troll cut in the video. hehe
Was the first thing I noticed. lol
512 GB Optane module for $500 is a steal.
I WANT MORE!!!!!
Yeah now that he made a video about it it will be sold out or 11dy million dollars..... Thanks Jeff
My favorite spud 😎
Did i miss the TP getting put on the CPU lol
Nah he didnt put any on he yoloing it, it would seem.
Thermal Paste is for losers anyway
Yeah didn't see it either
he skipped it because everyone would have just told him how wrong he did it
Have think the same
6:22 I hope you did put on thermal paste in the video cut :D
Of course I did. But if I show *how* I install thermal paste, it leads to 300 comments about how I did it wrong.
@@CraftComputing unfortunately now you are going to get 300 comments about not putting paste on. :p
Video engagement is still engagement 🙃
@@CraftComputing All Hail The Mighty Algorithm!
@@CraftComputing I would have liked to see the right way of themal pasting.
9:55 Minor correction, you mention that the optane NVDIMMs use flash like any other SSD, but optane (3d xpoint) is its own thing, among other differences not really having an endurance limit.
It has endurance limit of course, around 300 DWPD for these 1st gen DCPMM.. CMIIW
@@alfred4683 what does DWPD stand for?
@@SeanCMonahan quick googling should tell you.. DWPD = Drive Writes Per Day
Hey Jeff, when changing the the CPU you forgot to mention putting new heat sink compound on.
cant tell if irony
I think it's an inside joke
I was looking for this comment!
@@skilz8098 me too! But you can tell he did because he wiggled the cpu side to side :P
@@skilz8098 me as well
So... Upon the cpu swap, did you put thermal paste back? 😂😁✌️
As both a Canadian and an automotive technician, I very much approve of the Picquic screwdriver (4:43)
"What is my purpose"
"you pass the cpu"
"Oh my god"
It looks like the largest table I deal with on a regular basis has 1.15TB of data, 5.3TB of indexes , and 7,847,475,751 rows as of today. That's for 105 weeks of data as we remove everything older than that on a weekly basis.
We're still a very small fish though as this runs on a single server with 4 Virtual Processors and 32GB of RAM.
Dare I ask what this table is?
What database software does your company use?
@@h.b.5577 We use Microsoft SQL Server mainly because the SQLXML Bulk Loader is really, really fast and works very well.
That's a stupid amount of memory!
I love it.
Now that I finally have my own house, I can fully dive into the wild world of servers and I can't wait!!!
Congrats on the house! Don’t go too overboard on it, it’s a deep rabbit hole haha
@@_mew i know but I'm super excited
@@_mew
I like the idea of buying old xeons and components in bulk and building a multi CPU server with obscene amounts of RAM for absolutely no reason at all. Like I really don't think I have a use for one besides a gaming server but I still want to build one.
Great Video. Thanks for putting in the time!
This is awesome, I'm so happy to see you playing with bonkers hardware, and sharing it. I have no need for any of this but it sure is fun to watch.
17:48, creeper aw man.
Thanks to SkillShare for sponsoring today's video. Be one of the first 1000 people to visit skl.sh/craftcomputing06221 and get 1-month of Premium membership on the house...
And no, I didn't forget the thermal paste. It was on the CPU.
Thanks for describing this tech in detail and especially without the unthinking OTT reactions many tech CZcamsrs use.
Slowly watching.... No thermal paste?? 🤯
I used Schrödinger's Thermal Paste. It's best not to observe its application.
I worked a few years ago (middle of 2019) with some prototypes of these memories. The idea was to study ways to optimize them and our BIOS to integrate with a new line of workstations from my company. The speed and latency results we got were insane. We had 6TB (12x 512GB) in a dual xeon machine, working as 50/50 (3TB RAM + 3TB AppDirect). The read/write speeds were near to 15GB/s on AppDirect mode.
I was reading about this so much when making my hardware selection for my new server, after plenty of reading and suggestions. I decided not to go this route, but I'm glad you did, and could show us why not to, at your expense. Thanks for the awesome video though!
Lol at 15 min he totally called us out! That's exactly why I watch to reduce the risk of wasting my own money and pick up some ideas and practical how-to's along the way! Thanks man!
This one’s been on my bucket list to try out. Thanks for a great episode!
No thermal paste?
He wiggled the CPU, so yes, thermal paste is here
Wonderful timing. My own optane just arrived - a 16 gig nvme stick of it, which I simply wanted to play around with on my core 2 quad system (lol)
Optane is magical, it's a shame they stopped trying to make consumer SSDs with it...
I run a database recovery business and have to write hundreds of gigabytes of data to sql databases on a daily basis. This would probably be much more cheaper than the boatloads of ram and throwing SSD cache at the problem that I'm currently using.
Can’t believe he killed Geordi LaForge and has his visor on display.
Love you Visor mate!
That 500optane chips are going to need hundreds of videos to be paid!!! Cant wait the playlist
Great video, very informative, thank you for sharing.
Which server rails are you using?
This is INSANE Jeff!!!!
i paused it to look up the beir
and was impressed by the list of biers in the series/moniker.
even though i know what lagunitas is now; id give the series a view.
Oh how I wanted this to come to HEDT with the ability to boot directly off the optane dimms.
*slaps ram* these babies can hold so many Call of Duty installations
Here I am happy with getting another 64GB kit for my server, then you post this! lol Great video Jeff, freaking impressive!
i just keep on watching when the drink goes down
An interesting thing about the retainer, the two holes on the corners that don’t have screws are different sizes and the posts on the sockets match them, so as long as you match the cpu triangle with the retainer triangle it will only be able to go on the correct orientation into the socket as long as you don’t force it
At least that’s how my experience with these sockets are in the data center
I slowly upgrade to max memory on any given platform. My main rig only has 64GB right now, but my previous were maxed out at 128GB and 256GB. I'll wait for DDR5 to slide down in price before getting the next 64GB.
Bonkers indeed - but you're having fun and so am I watching your antics. Don't expect me to be following your lead though.
9:59 it's not what people typically associate with flash. It's 3Dxpoint cells that have orders of magnitude more endurance than nand cells.
This is correct. I should have expanded on the type of memory used here.
@@CraftComputing I love optane. Even using the M.2 32GB version for swap, ELT scratch space on home-lab servers is amazing for the latency difference.
@@magfal I got a 16GB stick for cheap a while back and I use it as a ZFS write cache.
also very low latency, just a few microseconds, it was so freaking good. but it's now canceled, micron could not keep producing them, as they were complex and not cost effective.
I've definitely worked on and even upgraded machines with more RAM than that in a professional capacity, but it's still impressive.
That server has more RAM the my PC has in SSD storage! How many chrome tabs can it do?
2, but it crashes.
I'm guessing actually 1000 (due to software limitations). My PC currently has 280 open.
@@laloajuria4678 Rough.
@@Big_Flubba I would guess about 954 but if it werent chrome but a browser like Opera GX or something similar it would probably be more than 1000.
@@Kaotix19 Plausible!
Note that with Gen3, some Xeon Silver does support Optane, but only supports Optane 200 which is hellishly expensive. 4314 and 4316 both claim support while 4310 and 4309 do not.
I could in theory have a terrabyte of memory in my old dell server. But 32x32 gb sticks are pretty expensive. For my needs, my current 32x4 gb sticks are enough.
When your ram uses more power than your CPU
Constructive criticism for the camera operator: when you were explaining the RAM slot colors, it would be better to have a better angle showing the slots, I could barely make out the blue if that's even the RAM slot.
Also, the focusing could be improved to keep the subject Jeff's talking about in focus.
Otherwise, framing of everything else is pretty good, and it's nice to have movement when doing something while talking. Good work camera operator!
Perhaps you should have been there so these comments could have been useful. Sometimes you miss things in the shoot, commenting like this isn't constructive, its irritating.
I consider anything better than Kyle's camera operator (his other hand) to be good enough on these solo channels :)
@@timellis7720 I consider it constructive since it’s something that can be considered for future videos, and pointing it out helps spread awareness. I wouldn’t know if they realized it or not. I’m not expecting this video to be reshot or anything, but I don’t see any harm in pointing it out.
I’m not trying to be an asshole about it or demand this video be taken down entitely just for this small detail, nor hate the camera operator or anything, and I also want to give credit where credit is due, because like I said, the framing for everything else was great, there’s no doubt about that.
@@kenzieduckmoo True that.
@@ReturnJJ no, everyone who has ever held a camera knows you need to keep important things in frame and keep it in focus. But they can still make mistakes, they don’t need to be reminded of them. You don’t go up to people and say “hey, here’s a helpful tip, those mistakes you made earlier, don’t do that”
Nice to see someone else using Picquic screwdrivers, they are a Canadian brand!
Seriously one of my favorite drivers. I've had it for 10 years.
This is gonna be in one of those 'Try not to laugh' compilations in like 2086
Great video as always! I got nervous every time the pile of screws giggled around. Have you considered a magnetic screw tray? Harbor Freight usually has them for a couple of bucks, and I haven't lost a screw since I got mine. I do tend to leave one with a project when I set it aside for a while though, so I've ended up with a pile of them stuck to the side of my toolbox :-)
Hmmm, did you have to remove it again to add thermal paste?
We have a couple of quad-socket VMware boxes with 3 TB memory each that we had to retire due to not being on VMware's HCL for ESXi 7. I set one of them up as a hardened Linux repository for Veeam. It's ridiculous. 56 cores. Current load average, 0.09.
It would make an awesome ProxMox server!
*me having just bought 128gb thinking I am going to have a baller system* "A terabyte of RAM" ME: AWWWW MAN
Awesome Video! What's with the Creeper though ? :-)
I do wonder how well these would work on TrueNAS with it using the zfs ram caching and such
What’s the HDStor box about the board with the SATA and power cables coming out of it? Is it just somewhere to put 2.5” drives?
Would downloading the weather data set and trying to predict the up-coming weather use up the available memory?
Idk what's more intriguing... 1TB RAM in a home lab... Or chewy beer.
So, the CPU thermal paste - has it ever been applied?
This is an advanced class I think.
One of my favourite (and worst) hobbies is shopping our datacenter for boxes that are about to be recycled. If I lug it, I get it. xD Though, these days I do end up recycling most of it as you only need _so much_ hardware in a homelab.
I can be a recycling center; my homelab needs more hardware :-)
Getting ready to replace my 3800X/B450m/64GB RAM home brew server setup w/ a Xeon E5-2697 v3/JGINYUE X99 TITANIUM D4/128GB ECC RAM.....and I thought 128GB was a bit for a home server.
loved the creeper... actually, it would be interesting to se how it would handle as a mc server... with that amount of memory and speed?
Am I the only one that saw him put the CPU back in but no thermal base
Thank you for the very interesting and informative video. I have a use case scenario that I would like to suggest as I have a real world need (or want) to fill;
Multiple virtual machines, Mac OS and Windows, running DAW software (such as Logic Pro, Studio One, Pro Tools, etc.) with VSTs and plugins. Have a studio with multiple production areas and if we could consolidate our hardware that is doing the heavy lifting, that would be incredible. Mixing/recording on a thin client or through a virtual session on a laptop or something would be ideal.
Love how you just slapped the heatsink on and said it was ready to drop in. I suppose you wear shoes with no socks also, you reckless maniac. :-)
Man that intro really got me haha
Hi Jeff, great content btw. 2 things caught my attention: first, really thermal paste before placing the "new" CPU. Second: avoid touching the contact pads from the CPU with your bare fingers, grease will corrode them, also static may damage the CPU. Juts my 2 cents. Keep up the great work.
Especially on 3647 sockets. Can't tell you how many times I've had issues with memory channels if the pads aren't completely clean and the chip exactly torqued correctly in the socket.
Was there thermal paste on the new CPU?
Hey Jeff.
What rails do you use for your server case? 🤔
I couldn't find anything explaining how the 1TB limit of Xeon Scalable v2 CPUs applied when using Optane; thank you for mentioning that the Optane PMem doesn't count towards this limit, as this as it was something I was really wanting to know! If you have encountered this information written down anywhere I'd love a reference to it.
I'm just waiting for the day someone makes a 1 Petabyte of RAM computer
17:40 Are you going to try to run a minecraft server with this? If so I would love to see that.
You might be able to run ATM6 now!
here i am upgrading a cpu on a 5 yr old b350. we are the same!
Under 0.01 ms storage latency? My latest gear has latency measured in minutes. I wouldn't mind seeing your thoughts about using tape storage in the homelab.
And one more thing, please take care of whatever is ailing your HPE server. IIRC it was also complaining the last time we saw it.
5:50 we don't this to turn into a Linus Tech Tips video.
Much like normal CPUs. The larger ones almost always have side of the socket that has a gold bar. Line that side up with the triangle on the chip
You didn't put thermal paste on the new cpu? or did you cut that out.
love the server
I just want this for my Plex database.
touching CPU by your fingers? No antistatic belts? ahhh so professionalllyyy
I don't know DCPMM in memory mode doesn't have CPU limitation, that's good news for in-memory database like SAP Hana, Oracle DB, NoSQL, etc
you put thermal paste after the video published?
Just wodering if the CPU is running a bit Warm? I didn't see a thermal paste applied to the new CPU. Or maybe it was lost in the edit..?
You forgot thermal paste or is it a magical connection between CPU and cooler
did you 3d print that visor/stand? stl?
Ooo. I like Blue. what is blue in the rack?
I would love to see a method of using RAM as a read cache for databases within windows without moving the files from their slow medium.
I know you can pull off a safe way using ZFS and linux for this read cache, but I've yet to see a method of doing this for windows.
Current best guess is to create a RAMDISK/CACHE in Linux using ZFS and pass it to windows as an ISCSI device which really complicates things.
I know it would be stupidly major overkill, but would it benefit these folding projects for gene research etc?
That intro could have been on every tech video from every youtuber between 2020 and now and people would still be butthurt
Great video as always but I need to ask because you are sending mixed signals.
William Shatner or Mark Hamill?
mm banana nut crunch... damnit man! I won't soak it in IPA though.
I hadn't looked at optane nvdimms, but just last week I was eyeballing what it would take to add some small (and surprisingly cheap) nvdimm-n dimms and battery to a Dell R740 for use as an extremely fast zfs zil, but found the documentation on the subject a little intimidating.
Funny timing.
I feel like I would be really happy with about 16 or 32GB of ram for my laptop as right now I am still stuck with 8.
No need for Thermal Paste. Sweet
Damn I wish I could afford this or something like it. My whole server runs on an i5-3470t, 16gb ram, 2 x 1tb (raid1) and 2 x 3tb (raid1) in a microserver gen 8.
I have HyperV for PiHole and Plex and then its just storage for everything else!
How does it affect the dram memory speed (fsb?)
wait no thermal paste on the new one?
6:49 what about thermalpaste?
did I miss the thermal paste?
my minecraft server needs this
What can you do with it? ZFS give it all to me, Muggle I demand it!!!
You touched the contacts and didn't apply thermal paste?
Is it weird that seeing 1TB on a server doesn't shock me in the slightest even assuming it's a standard DDR4 DIMM?
I mean, probably yes, but I work in a datacenter, so also no, because I've built it out a few times.
Super cool and interesting video though! I haven't dealt with PMEM, and seeing this was really interesting :) I didn't know it had those different modes and how they each worked, but damn does it look crazy to implement them XD