$200000 NVIDIA H100 80GB 4Way GPU Server
Vložit
- čas přidán 9. 03. 2024
- #nvidia #gpu #h100 #workstations #server #yangcom
CPU: Intel Xeon Scalable Gold 6336Y (2EA)
M/B: SUPERMICRO MBD-X12PI-NT
RAM: SAMSUNG DDR4-3200 ECC/REG 768GB(64Gx12)
SSD: SAMSUNG 980 PRO M.2 NVMe 2TB
VGA: NVIDIA H100 80GB PCIE (4EA)
CASE: 4U RACK Type Rail KIT
POWER: 2000W PLATINIM + 1000W GOLD
Water Cooling Parts: 1U LGA 4189(2EA), NVIDIA H100 Block(4EA),
30T Radiator (2EA), All in one Pump, EPDM Clamp, EPDM, Quick Disconnect
Yangcom Home Page
www.yangcom.co.kr
Yangcom Instagram
/ yangcom_official
Yangcom Facebook
/ yangcompc
Yangcom Blog
blog.naver.com/combox0 - Věda a technologie
Yes mom, its for school
Yes it is
for NASA school
😂 XD
Now we can play Minecraft on steroids!
clean clean
I have a qustion, I have a Skylake Xeon do you need eight sticks per CPU to get Quaf Channel, I have four per CPU and its only giving me Interleaving of 2 in Linux
Awesome It would be fantastic to see how it behaves with its installed operating system.
There is no installed operating system with it. Most customers would roll out their own OS installation platform using a protocol called PXE or Preboot eXecution Environment. The network card loads a firmware that requests an IP address from a DHCP server and the DHCP server can set up a "next-server" to talk to that will be a File Transfer Protocol (FTP) server. Usually this will be an authentication-less FTP using "Trivial FTP" or TFTP for short.
The TFTP server will provide a "Network Boot Protocol" (NBP) file with some information to handle structuring requests into memory (to bootstrap an initial kernel or download and unpack an ISO file that contains the base OS image for Windows, VMWare, even Linux distros). Many customers will use some autoconfiguration utility like "Kickstart" for Red-Hat distributions or "Preseed" / "cloud-init" for Debian/Ubuntu distributions.
Linux distributions would be the most common OS used for these H100 systems along with one of the latest CUDA versions. I believe CUDA 12 and above is needed for H100s.
💥💥
Could you or anyone provide a link to that 4U case? Ive been looking for a case that can support supermicro boards since I dont want to use their proprietary chassies.
Where is the NVLink bridge?
You will need it for sharding the largest models and getting the best performance. PCIe 5.0 is not gonna cut it ..
Exactly.
they probably arent serving models that large and if they are they will upgrade, its expensive so if you dont need it, why not
NVlink is only needed for training, if you do inference you don't need it at all.
This motherboard model -- X12PI-NT -- does not support NVLink. NVLink could only be provided in this configuration with a direct GPU bridge between two cards. Most of the Supermicro models require an add-on physical component to bridge the cards together (similar to NVIDIA SLI or AMD Crossfire back in the day but its not just a janky ribbon cable; its a big metal and plastic piece that connects into PCIe-like connectors on the top of the card). Otherwise most of the time customers will be running the NVIDIA "Unified Virtual Memory" driver which will link GPUs together over PCIe. As long as the GPUs are behind the same PCIe root complex they can communicate over the same PCIe bus using "Peer to Peer" communication without talking to the CPU over the interconnect (such as Intel QPI or QuickPath Interconnect).
PCIe 5.0 will cut it but some configurations are needing to use add-on components like "retimer cards" to avoid too much attenuation on the PCIe bus. Retimer cards will repeat a fresh copy of the signal they receive to boost the signal's propagation. This is larger a concern for traffic between the NICs and the GPUs since they are both constantly in competition on the PCIe main bus behind the root complex.
ready for word 2019…❤😂
lul
Why loop the second CPU into the output of the first when you had space on the block? Is there a reason to do this?
nerd
It doesn't make much of a difference. The delta between the input and the output of a cpu heating block is negligable. The water heats up until it reaches equilibrium with the radiators.
Wow
Now build a mini nuclear reactor for it
Can it run Crysis?
It would be good to have one that shows NIC installation too
mom, please, buy me just one computer like this...
Don't find it necessary to watercool, the passive cooled H100 is capped at 300w and you won't be able to go over. Plus, using lesser capable fans (T30 is ok for normal PC, not really for servers) yields much higher component temp such as ram, on-board vrm.
Also, using custom case means you lost the drive slots on the front panel often seem on oem solutions. And not using server grade power supply is also a huge downside. (seriously, not even dual titanium redundant PSU???)
For 200k, you can get better complete solutions better than this, and with much better reliability.
yeahh this is not server level. seems like a consumer approach to server equipment.
he didnt even install the nv link bridges which is important for this type of machine. 90% used for LLM training
Это сборка для размещения вне ЦОД. Весь смысл подобных извращений в том, чтобы когда вы включите сервер в съемном офисе, по вашу душу не пришла инспекция по охране труда. Большинство коммерческих ЦОД имеют лишь 5000W на стойку и запросят за размещение такого сервера действительно много денег.
so crazy
we need a minecraft and crysis 1 test on this !!!
Now you can run Crysis 3 remastered
But will it run Crysis?
No 😢😢
No port😔😔
🤢
No
Never 😭
Crazy, 200k on a rig and no RGB? This is madness.
this is not for Gaming, It's for Server
Ready for cs go 2 😏
imagine mining with that
Is that silicone or rubber tubing?
EPDM.
Well? Where are the tests for The Witcher 3 and Cyberpunk 2077?
Will it work in 4k on the highest settings? With path tracing?
The gpu's are server gpu's, they don't have anything in them for graphics
It can run W3 on 40000k
Omg
wheres the storage
For the double psu need a specific motherboard?
You need a motherboard chassis that comes with a Power Distribution Board (PDB for short) in order for dual-PSU configurations. Supermicro is the motherboard vendor in this video and they provide a parts list for server models. You'll find PDB- which will be the PDB the chassis comes with.
200$ on a cooler? No way a server PC worth that less.
Isn’t this literally a D100?
All this to run Internet Explorer in compatibility mode, i bet
Ay yoo the toubs thow 😂😂😂😂 sow maniy
Как работает система от 2х блоков питания???
кабели синхронизации блоков питания (есть в продаже, так и называются)
@@anspreadНу ещё стоит отметить что киловатник скорее всего будет питать только два зеона, а блок на 2 киловатта под питание ускорителей
This is how an AI brain looks like, boys and waifus..
Damn weebs
@@XantheFIN Damn lowbrow
@@XantheFIN You won't be laughing when those waifus start walking around and weebs fighting for their rights... or maybe you will. lol.
Хороший обогреватель
Да, это правда, но твоя мама самая лучшая
will it run doom?
Pow: You enjoy the success of drug bussiness
hopefully, anyways im happy w the account, assuming all show up, starting from gaeul i guess
200k is madness in any country but if u can afford it why not
Will the GPU be burned out if the water cooling system stops abnormally?
yes but there are temp sensors so it will shut off before it dies
@@SupremeSaucer811 bsod
Those things have hardware protection.
What happens if those coolant lines spring a leak?
@@tinyclub8542their coolant isn't conductive so it's just a large mess to clean
Minimum requirement for gta 6
Do the radiator fans really work? They don't have space to vent, do they?
An Excellent Server, How about using it as a professional Render-station? We need to check how it runs, 3DS Max, Vray, Lumion, Twinmotion, Unreal Engine! if you can do this test it would be perfect. Thank you.
These GPUs are made for AI training. Render works (I already did with Blender) but it's very suboptimal. BTW these kind of machines often run Linux.
rendering is better on a rtx 4090 or rtx 6000 ada. the h100 is an AI gpu
@@SupremeSaucer811 you mean all this money and amazing components can not run a high quality render?. It would be very interesting to see that.
@@wangzig9800 I mean they can but that's not what the server was built for. you can look up a H100 render test.
@@wangzig9800 he didn't mean it can't run, but he meant that other cards like 4090 or 6000 Ada performs better as the H100 is not optimised for rendering, it's a data center card specifically made for ML/AI workloads
Not having more storage and ddr5 ram is a crime
yeah kinda sad that ive been working hard just to rebuilt/regain my old pcs and still havent
Why no actual benchmark?
For what? Its a server. Even dont need monitor. Cpu+ gpu calculation/simulation/AI generstions and so on
They never power up their builds.
What is the usage of this kind of system?
Deep Learning?
Now u can play cyberpunk in 32K
Why liquid cooling on server equipment?
Для возможности размещения оборудования вне специально оборудованных помещений. Шум штатных систем воздушного охлаждения является вредным производственным фактором и небезопасен для органов слуха.
8 yos making a pc for Playing Roblox:
But will it run Arma 3
fps in fortnite??????
у меня на жигуле меньше радиатор
250k in loans
Finally i can run Llama3 offline
Chat-GPT 5 offline
this machine u can play Gta 10 ultra setting in 20K resolution
Can I ask you...., why Intel and not AMD?
He obviously built for a client and not for his own. So he did what the client wants to have.
@@crowschattenpfote Understand!
Minimun requirements to play GTA VI when the game come out for pc
Вы всегда так мажете термоинтерфейс?)
Do you think this is an educational channel he is just flexing on you
jetzt könnt ihr mit Affen Gott spielen 😣🖖🤖
Lets see the Userbench report.
PCIe 5.0 x5 NVMe
Why are they called servers? Can they also run advanced physics and car simulations?
They are called servers because most of them serve information
It runs any simulation
Just order one for home gamepc for test monkey island on windows 95 😂😂😂
200k or 20k???? I cant believe this shit.
the vga dosent have hdmi or vga or dvi or displayport
These cards are not used for much video rendering let alone to stream to a local monitor.
I doubt it would run Windows Vista
2 процессора в один контур воды? Воду нужно было брать на +1 контур. А так получается теплоноситель, забравший температуру с 1 проца течёт на 2-й, тем самым добавляя туда градусов
watercooler rack servers will always be the stupidest thing
Beamng will still run at 40 fps.
sadly not for gaming :(
No RGB is great!
no epyc is rip
1
3D mark Score ? 🤣
There's none - These GPU's do not have a video output.
@@vanderlinde4you GPUs with no video output, SCAMMED by NVIDIA
@@gileneusz compute cards: they don’t need video output.
@@vanderlinde4you I know I know 🤣
Hello, I wonder why you always use intel operating systems, is there a purpose for this?
And I want to collect this kind of server, almost every video of yours has Ddr4 and Intel, there are high amounts of fees, so why ddr4
Maybe the customer wanted more stability than price to performance.
@@alfiandy4494 I want to learn this too, do you say whether the parts he uses make more sense than the current parts or the performance at a more favorable price, but it’s already a very high number, it’s obvious that a professional logic does in this business, I want to learn that logic, it’s not about the price.
@@YagizMahsun Kullandığı işlemci bir hayli eski aslında 3 yıllık niye kullandığı belli değil, 4 tane H100 olan sisteme pek yakışmıyor. Müşterinin işlemci üzerinde pek yapay zeka eğitmeye niyeti yok galiba yine de yapabilsin diye orta ayar bir şey sipariş etmiş. Intel'de AMX accelerators vs teknolojiler var, yapay zeka eğitmede biraz daha avantajlı ama EPYC'te öyle çok geride değil, ekran kartlarında uçurum var ama Nvidia fark attı AMDye..
Ya tamam da genel olarak herkes amd takılır bende böyle bir sistem istiyorum lakin 200k sen olsan daha iyi bir şey yapmaz mıydın ?
@@YagizMahsun Öyle tabi H100'ün tanesi 40 bin dolar civarı 4 tane takıyorsun sonra 3 yıllık ucuz bir işlemci takıyorsun çok saçma. Bunun kararını hiç anlamayan bir yönetici vermiştir herhalde.
Maybe 20,000 thousand?)
This is pathetic, each one of those $2000 cpus has the same amount of cores as my $500 gaming chip and base clocks 2ghz lower. I understand they are server chips but in this case It’s just one example of intel hardware that is outdated yet hasn’t dropped in price. Respect on the build because you are probably able to charge a 8-10k markup on not even 4 hours of work, you still could have done better with the hardware choices.
Thermal paste........... omg ........
Not for China distribution!!!! Or are we that dumb!!!!!!!!!!!????????????
can i play mine sweeper on it ?
can it run crysis ? 😂
4K at 1000FPS
dude puts togethet 200k usd builds and doesnt have a stahwille torsiotronic to save time and set the screws to spec.
Way more then $200, you must have meant $200,000.00
But will it run gta5 ?
Arent those GPU's under sanction in China?
Lets see it operate at 104° for 2 weeks . Lets see it in operation . You show no evidence of any success
Platinim...
OpenAI who?
incorrect application of thermal paste. dislike
Este servidor é judeu minera bitcoin e não esquenta muito é tem muitos slot 😅
Закрутить винты по диагонали? не нафиг, пусть лучше неравномерно прижмется, а еще лучше гпу сколит
AWFUL !!! GREEN MB
Who needs a "GPU server"? What an expensive bullshit!
1:22 Soo stupid . Regular terminal paste for soo big gpu crystal . Pump. Dislikes .
Non redundant power supplies, 90EUR SSD that is slow... For 200k. What a pathetic build.
Bro piss off
Собери лучше и покажи нам что получилось 😂😊
Может не было цели у заказчика собирать на быстром ссд
the data will come through the Internet not the SSD, the build is not meant for gaming but for data processing
200k but no money for a 990pro? What garbage is this? I get you don't install PCIE 5.0 SSDs for liability reasons yet but come on.
I don't see how adding a 990 PRO will make it any better, but please do enlighten me if needed
save more power and faster read and write speed. If you build the best AI PC, SSD need to be the best.@@TAEMBO_RK
So what brand that should be use in this type of building
it probably boots from network
Won’t make a difference