$90000 NVIDIA A100 GPU Server
Vložit
- čas přidán 16. 01. 2024
- #ai #gpu #workstations
CPU: Intel Xeon Scalable 5220 (2EA)
M/B: ASUS WS C621E SAGE
RAM: SAMSUNG DDR4-3200 ECC/REG 256GB(32Gx8)
SSD: SK Hynix PLATINUM P41 M.2 NVMe 2TB
VGA: NVIDIA A100 80GB (4EA)
CASE: 4U RACK
POWER: SuperFlower SF-2000F14HP LEADEX PLATINUM
FAN: Phanteks PH-F120T30 (9EA)
CUSTOM PARTS: Alphacool 3647 (2EA), Alphacool A100 Carbon (4EA), Alphacool 360mm 60T (2EA),
Alphacool PUMP, Manifold 7Port, Quick Disconnect 6Set, Black PVC
Yangcom Home Page
www.yangcom.co.kr
Yangcom Instagram
/ yangcom_official
Yangcom Facebook
/ yangcompc
Yangcom Blog
blog.naver.com/combox0 - Věda a technologie
You know shit gonna be real expensive when you don't even recognize half of the hardware's names.
Could not be for cheap one
But all of them are easily recognizable?
tell them that you get nvidia A100 to some average gamer and see their reaction@@BlackJobZ
We r talking about kinda above average pc user, not tech professionals@@BlackJobZ
Jelous 😂😂😂😂
Finally a build that can run Crysis in 1080p 30fps,nice 👍🏼
640p 20 fps Maximum
@@Porsche_x my results are using Frame Generation and low settings
@@des7royerz So yes, I said 640p at 20 fps using graphics very low without dlss and without frame generator
LTT ran Crysis on AMD Server CPU with software rendering and got like 10 or so
with dlss 3, fsr 3 and low seting 🤣
This PC consumed more power than my entire house electronics combined
about 2kw when all processores is max-loaded
Your water kettle would easily consume more power than this machine.
@@NowhereNear42 we talking about electricity, not heat
@@thenasiudk1337 You talking about power. This PC uses electricity to produce heat. So does your water kettle.
Doesn't use more than 2kw.
Finally, a server for running Latest version of minecraft in the future.
😂😂😂😂😂 Minecraft
Tetris
still only get 45fps in vanilla MC
Vastly underrated comment. 😂
А ты в теме😎
would not like a coolant leak in that
finnaly a pc to compile gentoo
You would have the fastest emerge times in the world
my i5 13600kf took 4h to emerge -avq
this thing would do that in 10 sec xD
I can't imagine how satisfying it must be to train LLM´s on that thing.
you can easily rent set up like this for around $4 per hour
@@user-vp2tv8ff8j Renting is not satisfying as owing and running and training LLM's locallly
@@rd_626what the hell are you talking about?.The satisfying OP said isn't about “owning and training”...its about how fast it will train LLMs.
Try renting tpuv4 or even the new ones tpuv5s....smooth as butter. you will never ever run anything on gpus again lol
@@sohailmd123 Just FYI..... I wasn't saying that to the op
@@rd_626 “satisfying” is literally OPs point of contention. you can't take it out of OPs context....any ML engineer only gets satisfied/orgasms on how fast his large data is being trained before his eyes....not by owning costly shit just to see it train mid compared to tpus
-Для чего тебе такая сборка.
-Чтобы Excel работал без лагов.
Наконец-то я смогу открыть 4 вкладки в хроме))
В перерыве можно и пасьянс разложить по-человечески.
LOL
I'm afraid to ask this question and rather just look at this beauty but "Does it even run..?"
Crysis....
Used for AI backend stuff. Mostly for training. Runs only on linux
It must be so scary to work on gpu's that expensive
I am not a fan of liquid cooled servers, but we have air cooled units with similar specs (mainly Supermicro) and they are way more crowded and noisy as hell. That one looks really nice and neat, and you should be able to sit next to it without going deaf. Also, in the long run it won't end so full of dust and crap. This one of yours is a custom unit though, so the client probably had certain requirements in mind, but not others. I see he/she decided to skip things like plug and play redundant PSUs, for example. Also, any leak could cause catastrophic failure and down time, which is not always acceptable. Anyway, very nice.
I completely agree, liquid cooling in the server environment is a complete nonsense. It doesn't matter how qualitative is the cooling system, it will leak sooner or lately.
@@noJobProgrammer I know some servers use liquid cooling but it's probably more like AC, with heat exchanger close to the server racks rather than using water blocks directly on components
In high density applications such as HPC or AI training liquid to chip can be used, particularly in the 80kW/rack+ range
IBM Mainframe can be liquid cooled. Since its reputation for reliability, I’m sure reliability isn’t an issue if do it correctly.
@@noJobProgrammerif it leaks, you haven't done it right. Does your house plumbing leak every few years for example? If you do it correctly, there is absolutely no problem to be had there
Love to see the performance stats on it once it's powered up.
Kinda want to see the thermal performance of this build. The fans don’t seem like powerful enough.
Its not about the fans. Its about shitty MX-4 that he put on the everything
Yeah, the most overrated thermal compound. Noctua NT-H2 is way better for example.
@@Turboriderthermal compound isn't making or breaking this build lol. Maybe the most unimportant part of cooling as long as it's applied right.
@@MustafaKhan-hg8lu I have my own experience that I have made over the last decade on many different computers and laptops. But I'm not going to argue just do whatever you think is right.
@@Turboriderthen you should use Kryonaut Extreme or a Kryosheet. I myself work on a lot of stuff and MX-4 is completely fine for everything you could want as a "normal" person.
It also really depends on what you want to do with it. For example I've had a bunch of issues with NT-H2 squishing away from my GPU die due pump out caused by the extreme heat and power I was pushing through that card (3090 with an XOC BIOS).
On my 7900X, its another story. No direct die setup. NT-H2 was fine and pretty okay, one of the better pastes that I used. But with Kryonaut Extreme, I got way more stable clock speeds while pushing the same amount of power and thermals. Heat transfer is simply just better with this one.
However, I would not recommend it to anyone that doesn't want to push for the absolute best results. It's simply too expensive. But for everything I use personally, I use not much else anymore.
Is that 2kw PSU enough to run two Xeons and 4 A100s?
Yes
If you assume 500W per component at full power (it could happen), then it's 1000W short.
@@NegativeROGA100's are 250 W.
@@Mr.Not_Sure lul
@@Mr.Not_Sure A100 on AWS can use upto 450W. Still, in most local setups people will limit its usage to 350-ish because even a good liquid cooling won't cut it.
Fyi, the instance i use is p4d.24xlarge so they are 40Gb versions. not 80Gb. i don't know if 80Gb ones work in lower watt or not.
i guess a single cooling fan is worth my entire house but okok 👍
interesting setup. is 2kw power supply enough to fuel system like this? and what about temperatures with closed cover?
Why don't you do an actual review of the power it has? Some benchmarks. It would be awesome.
Watching that cloth glove get close to the socket in the first 5 seconds was nerv racking
guys thats pure power, nothing else
I can't imagine how satisfying is disassembly and repaste all again in the correct way.
I'm waiting for the benchmark test, do you have it? how long does it takes to train nanoGPT medium size model?
He just wanted to show off and prove he could afford one.
@@shidongxu3410 They are an actual computer shop! This is for their client
@@shidongxu3410 This is probably his job and he's just showing the process
@@shidongxu3410 no way someone can own 4 A100's and use it for personal usage
@@rd_626 a lot of people can but why would these people do it is the proper question.
Just one A100 would be my dream frfr
why would you need one ? It's mostly for data centers and stuff, unless you're doing something to use that 80gb of vram, because for gaming it would be pretty uderwhelming, as the driver suport wouldn't be the best.
@@cooooooooooooooool3 because ai applications in general, aswell as LLMs run like shit on the RTX 4070. Training obj detection nets also take quite a while even with pytorch+cuda :(
@reapiu8316 That makes sense, you have pretty vram intensive workloads. My dayjob is video editing, so I never exceed 4gb of vram use even with 4k editing
@@cooooooooooooooool3my Firefox uses 11 gb vram :(
Depending on the task. Nvidia Tesla P40 is not a bad entry for 24gb of vram in the used market. Runs RVC smooth as butter in my experience
Where are your CPU heat sink clips? Or do those water blocks not allow them?
All zero maintenance tubing too. Very nice.
Bro build his own personal super computer 😮
Any reason it should be mounted this orientation? Why not upside down, so leaking coolant will not damage the mobo?
2 questions: 1- Why not fill the remaining memory slots with 4x32GB?
2- Would custom length cables have removed some clutter and added to the airflow in the U4 chassis?
Nice job, I've already got a perfect spot picked out for it.
It's crazy how much tech goes into pumping around less than 2 volts through a few chips, and then we need a hoover dam to keep it all cool.
Props to the guy building it, has to be the first person I have seen who isn't deathly afraid of a little extra thermal paste.
Why you didn't put ram in all slots? I think you crippled the memory speed quite a bit. 🤷♂️
Thanks, amazing, will be nice if you power on the server. Windows? Linux?
Hmm, this build needs a bigger acrylic case, awesome setup!
It sounds like a jet engine while its running and needs cooling made for a small office to keep it running. Unless you are 100% gpu and 100% ram usage, it won't hit near its total wattage consumption. In comparison to a dgx1, it can do 40% more work while consuming 20% less power doing a task that would max out a dgx1.
How long will game streamers have to play before you get your money back, including the energy bill.
Nice boiler!
One can dream.. but never have.
Why leave 4 memory channels unused? Is the client buying more DIMMs later?
Very nice build, but this watercooling loop seems underpowered
MX-4? Seriously???? Why didnt you use Noctua NT-H2 thermal paste? Or Thermal Grizzly Kryonaut Extreme?
Y'all have been marketed to too hard. The thermal paste is maybe the least important part of cooling this over here as long as the paste is applied evenly. You don't actually need thermal grizzly unless you wanna overclock or if you just really like CZcams sponsors
@@MustafaKhan-hg8lu you know its A100 we are talking about, right?.. its not your average 4060
там и GD900 справится
How it felt to work on the big box palsma tvs back in the day.
Let's see on Facebook marketplace 10 years later
amazing how they could get the cooling plate of the gpu on the market..
i bet this rig can finish the f@h workloads my rig does in a week, in like an hour
엔비디아 폼 지린다
That's progress. In the 90's we would pay this voor a DEC VAX 128MB memory expansion.
someone gonna make some real money with this monster
The lack of redundant power supplies worries me
Finally, something adequate to run Tetris
Bros getting ready for gta 7
Это для 4ой вкладки в хром? Или для 20 ФПС в киберпанке с пастрэйсингом?:)
Man, this has become a car machine😂
Refilling water is gonna be nightmare better use mineral oil
What the hell IS bro cooking
His CPU's most likely with that thermal paste application.
Bro gonna create another dimension
Hell yeah
I would’ve mounted this in an enthoo pro 2 server case😊
2 киловатта могут легко разогреть такой объем воды
i need this for my school works
Why are you wearing gardening gloves? 😂😂
Are the Xeon’s thermo-electrically cooled? Is condensation still a problem? 😔
There are no Peltier cells there. These are ordinary water blocks.
Such beauty.
oh so that is why we have a pc part shortage
you can have the best waifu simulator on this thing
Insane.
Watercooling A100s is brazy.
Gloves +socket pins= pain
У меня дома такой же пк, но на 90тыс долларов дешевле)))
what gpu server used for? first time i see this monster
I actually have 2 of those SK hynix M.2 2tb for my pc
Q: What does this computer do?!
A: yes.
Ok I can build my setup I have the Alphacool A100 Carbon, now I need a A100 80GB.
finally a PC that can run MS word at 240 FPS👍
Everyone talked shit until the snow part of crysis then parts started to melt
Very cool.
now im ready to play minecraft
Ready to open google chrome with 10 tabs)))
Diesen Arbeitsplatz würde ich auch gerne haben. Den ganzen Tag mit Teurer Hardware basteln .
Almost got to wormhole phase 😂😂
Ну все можно вдвоем играть в тетрис.
Super flower psu!? No way!
C'est Gleen qui monte le pc 😮Omg
Il lui ressemble sur les reflets x)
This PC goes into the category of:"Nasa Super Computer" 😅
What's performance can you show any performance.
Proper rig for Cities Skylines 2
круто выглядит
Finally a server that python can print 1 to 10000000000 in 1 second
"bro the servers are bad im lagging"
The servers in question:
did this thing actually work?? you have six components on one thick 360 and normal 120 fans. I cannot believe temperatures under load this system better than 60C
60c is ridiculously cold, especially for server shit. There are thousands of those on earth running 80°+ right now, and they're doing just fine
@@lillee4207 if it's intended for loud operation / server closet then can go air-cooled and save a ton of money / complexity
@@paulwais9219 100%. But don't discredit the thiccboi rad
this bro built for gta 6 high settings
Now we can watch skibidi videos without getting stuck...
зачем горячий воздух гнать в корпус а не сразу наружу?
Question, why Xeon and not Epyc platform? If i recognize correctly, Epyc is made for servers, and its powerful
It doesn't matter (whatever was available/affordable in terms of CPU+mobo). Its a GPU node , the CPUs are only there to provide the PCI lanes, run the OS and handle the IO. Everything else will be handled by the GPUs on application level. That is why he didn't put much RAM in it because , it doesn't need it.
no ram, vrm, eth cooling, different length of tubes lead to uneven water flow, correct me if I'm wrong
Very nice 😮😮
only fittingsa and tubes cost are more than my desktop's
царь ПК!
I can finally open 24 Chrome tabs at the same time!
Which quick disconnects are these?
Minesweeper is gonna be AWESOME!!!!!!!!!!!!
А где тесты?
el verdadero pc de la nasa
BGM kinda reminds me of Dr. Driving..btw the build is