Eight Gaming PCs in a 1U Server - Cloud Gaming Server Part 16
Vložit
- čas přidán 22. 09. 2022
- Visit Porkbun today, and get any niche TLD from .ai to .xyz, with prices you won't see anywhere else. Plus support is all US-Based in Portland, OR. Thanks to Porkbun for sponsoring this video. Click the following link to get $1 off a new domain today bit.ly/3UDhAKD .
Microcenter is the place to find all your PC hardware under one roof, or order online at Microcenter.com.
New Customers Exclusive - $25 off all processors micro.center/yyq
Submit your build to Micro Center’s Build Showcase: micro.center/7vd
Check out Micro Center’s PC Builder: micro.center/lm9
Samsung 980 Pro 2TB SSD: micro.center/qzs
WD Black SN770 2TB SSD: micro.center/k5a
Ah, the return of my Cloud Gaming Server series. This time, we're cramming three nVidia Tesla GPUs, two CPUs, 8TB of SSDs and 256GB of DDR4 RDIMMs into a 1U rackmount server, all to run EIGHT gaming VMs at the same time.
But first... What am I drinking???
Kla3 from my Patreon server sent over some Norwegian goodness in the Nøgne Ø Imperial Stout. Definitely a stout like no other... rich and thick, but with a flavor profile closer to figs and cinnamon rather than dark chocolate and coffee.
Links to items below may be affiliate links for which I may be compensated
Set up your own vGPU Server with Proxmox and nVidia GPUs: • Proxmox GPU Virtualiza...
iSCSI Configuration for Game Libraries: • Use your NAS as a Stea...
ZFS DeDuplication in TrueNAS: • ZFS Deduplication in T...
Private Cloud Gaming - Parsec and Moonlight: • Private Cloud Gaming -...
Check out the parts from today's build...
1U GPU Servers: ebay.us/BtwxUr
HPE 32GB DDR4 REG-ECC 2133: ebay.us/MAJyvc
nVidia Tesla M40: ebay.to/3DlPPxu
nVidia Tesla M60: ebay.us/A4C0Zz
4x NVMe m.2 Adapter (require PCIe bifurcation support): amzn.to/3DORY7x
Grab yourself a Pint Glass or Hoodie at craftcomputing.store
Follow me on Twitter @CraftComputing
Support me on Patreon or Floatplane and get access to my exclusive Discord server. Chat with myself and the other hosts on Talking Heads all week long.
/ craftcomputing
www.floatplane.com/channel/Cr...
The following music was used for this media project:
Music: Disco Of The 70’s by Frank Schroeter
Free download: filmmusic.io/song/8298-disco-...
License (CC BY 4.0): filmmusic.io/standard-license
Artist on Facebook: / frank.schroeter.52
No Good Layabout by Kevin MacLeod
Link: incompetech.filmmusic.io/song...
License: filmmusic.io/standard-license - Věda a technologie
I am glad your channel has found success, so that we can continue getting content like this.
Interesting to see Pork Bun buying sponsorships. Bought mine from them over a year ago and just renewed. They are cheaper than cheap.
you rent it, not buy
@@majstealth "YoU rEnT iT nOt BuY iT"
😆
Same. Have a handful with them. No issues.
Okay, that intro competes with the Manscaped video for best ad
"so far so good' joke was on point! I love that you're building on all the other videos and just linking back for tutorials.
On projects like this, there's just SO MUCH to cover. One of those tutorials by itself is nearly 40 minutes, so no way I could cover it all in this video :-)
Plus, I like getting clicks.
I know that I will never ever set something like this up.
But, the possibilities of the hardware and the setup is what is cool!
Your shirt in the inro...
White-Orange
Orange
..... LMAO... I have always mumbled to my self while making RJ45 connections ALmost singing it on each line... I've done this for soooooooooo many years that back in 2000 in Highschool in the newly formed "Computer Tech" class, we learned out to make our own Cat5 cables. I know your shirt if right with WHITE-Orange, but i've always had it drilled in my head as the colors first as it helps me remember and sing my little tune.
Orange-white
Orange
Green-White
Blue
Blue-White
Green
Brown-White
Brown
Outstanding, I'm glad you're sticking with this.
I can't believe how powerful this Hyper-Visor is. An amazing case study, a fantastic demonstration and proof of concept. Giving you all the virtual thumbs I can brew. Great job, thoroughly entertaining and informative! Cheers 'tink'.'tink'
That intro was fuckin hilarious.
I wonder if you'd get better deduplication efficiency if you set the volblocksize of your zvols be the same as the cluster size of the FS you format them with. BTW, what are the values for your setup? The default volblocksize is 8kB, I think, whereas the default NTFS cluster size is 4k. I would suggest setting both to 16kB to cut down on the metadata overhead. Jeff, do you feel like giving it a try?
That's a great idea. In a quick setup like this, I've left everything at the defaults (8K in ZVOL). I'm working on some testing methodology to start sussing some of this out.
Fascinating stuff - was great fun see all the instances of Crysis running at the same time. Would for sure call this project a win !
Porkbun are great! I bought my domain there a few years ago and I recently renewed it with them, they are cheap and the service is great.
I would still would love to see you do a cloud video editing or similar variation on this eight games one PC idea
Had to rewind and take a second listen when you said you put the 2 drives in TrueNAS into a raidz1. For those who may not be well versed in ZFS or TrueNAS, it was a zfs Mirror, not a RAIDZ1.
I love your content so much, always such great ideas and helpful ways to set things up!
Yep, RAIDZ1 is akin to RAID5 (also which not a great idea since long ago with drives getting huge). If you must, RAIDZ2 (2 parity recovery members). I prefer striped mirrors (like RAID10). Much easier to extend existing arrays (no backup, destroy/reconfigure/restore) - just add a new mirror ZVOL to the array and -- done!
(There's lots of good info on TrueNAS and ZFS over on Lawrence Systems channel.) Like here, the signal-to-noise ratio is very good, unlike LTT seems to have become (with the exception of ones with Anthony).
Love the cloud gaming! I'd really like to see a... public cloud / private cloud deployment with a self service portal with vGPU support. It's been something I've worked on before and would love to see your rendition of it.
Very cool glad you got this working
Fantastic video!! Keep the great content coming
I've never heard of porkbun will definitely check them out.
I love these videos, I usually aim for quite stuff now a days though
That intro skit OMG Soooo hilarious!! Cool video too.... my maaan!!
Aw thanks bro
Intro was so funny almost made me cry thanks guys
I'm really wanting to do this exact project! But I gotta get the necessary hardware to do so. I'm close to getting it tho!
Don't you just love it when Papa Jeff talks tech ... Gets your bits all messed up in a cluster of ones and zeros. Someone defrag me before I toss an error code or BSOD 😂
Love the flash back shirts!
Fun! This is what playing with hardware is all about.
Great! I love this setup
Thanks to your series, I've been able to build my cloud gaming server
PowerEdge R720 with 128GB of RAM, 2x Xeon E5-2697 V2's, and 2x TESLA K80's.
My Operating Systems run locally on a NVME drive, however all my steam library games run off TrueNAS VIA iSCSI with zfs de-dup, which was also the result of one of your videos.
I really want to upgrade to M60's but they're very expensive right now.
I just looked around for M60s on ebay and it's too much for me to spend on one right now. M40 as an experiment is good enough for me to try.
@@spicylemon53234 I didn't. I'm using the Dell redundant SD card module for boot.
I have a system with an HV paravirtual guest that I share with my lady. For storage, we both connect to the same SMB TrueNas share for the Steam library. It works very well as we have a 10 Gbit link back to the shared storage. Since Truenas has 128GB of ram with l2arc as well, all games run off the storage flawlessly.
Love your content, it is both chilling while informative, hope this kind of things reach out to more people so other tech youtuber can also try it for as niche this sadly is..
I know this is a rather unrelateable thing to ask, but can you do a showcase of gpu passthrough on gaming laptops?
I am looking to build like a unified setup, therefore i don't know if it'd be worth to have gaming and workloads to both in and out of my house. Or else just a desktop pc with linux and some vms to work/gaming at home and provide the cloud and a laptop to access it on the cloud and just work/game otg.
Keep up the great work :)
Oh my god you were right... the pork bun ad spot. God that tickled a good side this morning.
Freakin space ship man. Gotta get into this server building thing. Sure messing with laptops is cool and fun. Certainly building a pc tower from the floor up is great. But geez dude 😅 the server thing looks amazing. Had to subscribe.
what a legend. nice project.
hahaha the intro was pretty damn good!
Awesome video! I think Crysis Remastered has benchmarking tools. You could get some numbers out of that.
Used your tutorials to create a remote gaming VM within Proxmox, setup iSCSI to said VM and other PCs, and some other things regarding Plex all using HP Z840s.
That was a great sponsor plug 😂
"Crysies Machine", LOVE IT!!!!
The best part is the detailed of whiskeys on your shelf in the now and before section
Ok, I'm sold. I'm gonna do this soon. They make a 24Gb version of the M40. did you choose the 12Gb because there isn't enough GPU to split?
Just had my own board meeting before watching this……That ad is hilarious
Jesus wept, another S tier sponsor spot!
Best series on CZcams
I think I'm in 4th place.
1) Colin Furze Tunnel
2) JerryRig Electric Hummer
3) ALCH Apartment Renovation
4) Me
@@CraftComputing personally this series is the best. I would love to see a practical 2 gamer one system cloud machine. But the real question is how much do you use your cloud gaming system??
Just imagine what 180W of fans would sound like. You could just use your server as a leafblower now that we are getting into fall
i wonder if they would be any better using some noctua fans?
Ear protection required. Those things are like a leaf blower straight into your ear. Built like tanks though...
That grin @17:32 when playing eight instances of crysis at the same time.
pretty cool Jeff, I have been following you for the last few years. Also it would be pretty cool if there were a way for you to control all 8 instances simultaneously.
Are there any issues with anti-cheat in a system like this? IIRC Linus abandoned his network gaming server project because of that.
This is essentially the perfect hardware target for roughly 30 years of videogames. With a rom library AND a PC gaming library you could categorically load and stream 8 instances of humanities videogame history (or at least the "top hits") from 1980-2010. Some of those instances could feasibly handle multiple players on older multiplayer titles OR indie titles.
Given that older roms are so small and quick to load, you could offload THAT library to a NAS.
pretty much perfect for the computer games that came before that too - most of them were terminal based and ran on mini/mainframe systems this would have no trouble emulating
I need to follow along with this eventually. I've wanted to make a gaming server so I can play games on my (non-gaming, fully arting) laptop without issues on the go. It would have been nice to have a total cost listing for a generalisation on what people looking to follow along can expect to pay. I get with eBay it's a bit of a crap shoot. Your $20 Tesla M40 may be $2000 for the next guy. But generally it gives an expected project value from $2k to $20k.
This might be the longest series on CZcams and I love it
This is amazing, is a complete walk through video coming?
Full tutorials are linked in the description for everything you see here.
@@CraftComputing thanks for your tireless efforts to make these videos, i did try the vGPU / Proxmox video you linked above and must admit that i sadly failed, both times :-)
Then i went with the Hyper V approach and that seems much more promising, but admittedly doesn't feel as "cool" as the proxmox stuff.
As you i have been hunting for a VDI solution since the "dawn" of computers and with the new streaming clients that uses the NVENC hardware we are finally getting there but what really confuses me is that the nvenc streaming tech isn't just a native the host that the virtual machines run on...
I have never seen the E5-2898 v3 before lol. 4:05
This is legendary
Thanks for all the great videos :)
I would like to know more about "Thin Client" or whatever they call it. If I wanted to make a server for my 2 boys so they could game on it, which "Client" should I use and what are the requirements for them if they want to be able to play at 1440p?
I enjoy learning from the information that you put out there. I was wondering if it is possible to have multiple windows OSs in the DeDup? Or will that not work? Or does each Windows OS VM need it's own non-DeDup zvol?
I need that RJ45 wire layout shirt 😂😂😂
vkc.sh
Craft on any of your x79 adventures did u have psu coil while happen when using a sata ssd doing random things? It might just be my board and psu
Amazing video, thank you. Would this be applicable to a LAN set up? I.e. 1 machine with 8 separate players stations. How would the displays and keyboards/mice work? Would be amazing if you could do a video for this to!
What are you using to tile all the moonlight windows? I’m trying to do something similar to basically build an “Xbox” based around a bunch of windows VMs
Watching the Build Montage gave me Mr Roger's Neighborhood vibes idk why 🤣🤣
thank you good sir
Nice FitGirl repacks shout out
I was wondering if anyone would notice that :-D
This makes me curious, is there a way to use a mining rig (or making a similar setup) of just multiple GPU's buy for gaming rather than mining? I have a bung of older GPU's that I would love to do something similar to this with.
Great video. How loud is the server? I imagine even though its passively cooled the case and PSU fan's would be quite loud due to their diameters?
If you have to ask how loud it is, you've never been around 1U servers ;-)
@@CraftComputing Yeah I guess I will keep searching for those unicorns.
From Evan Williams to Whistle Pig, such a nice detail
Glad someone noticed!
This was my first time watching you and I subbed during your in video ad, that's a fucking first for me . Love that you even changed your booze for the skit when you recalled the past lmao. Bunch of stoners, loved the vid.
I Loooooove that custom 45 Drives storage.
ME TOO!!!!!
I'm a fan of all self hosted cloud gaming videos you put out there. Question: What's encoding the video? H.264 cpu encoding? NVENC? Does this cards support several nvenc simultaneous streams?
It encodes with nvenc, CPU encoding would have horrible latency. That is why he failed with some other GPUs, cause they didn't have an encoder on them
They need to pay you well for that commercial. Very funny
Out of curiosity, would Tesla P4 cards work with this build, and if so, would it be considered a worthwhile upgrade? I recently watched the P4 video and it would seem that those cards out perform by quite a bit.
Ooh, have you seen Retro Game Corp's video on Caster? I was thinking of you the whole video.
I'll link in a reply to myself in case there is a filter.
How did you get the vgpu driver from nvidia? I tried making an enterprise account with them, but it seems as though they just ghosted me.
Time to start running an old WoW or Diablo Multibox setup for that sweet loot
Awesome seeing you get a win at last. I look forward to the LAN video ;P
Wondering if it is possible to deal with the GPUs in a completely different way - having multiple GPUs for a single gaming VM instance? Using two M40s or P40s could bring some real performance if the thing scaled well. I remember that we used to have SLI/Crossfire in the consumer grade PCs, but I guess it is not the thing anymore.
Excellent 👍👍👍👍👍👍👍👍👍
How do you handle Windows Licensing? MSDN/VSS? Also, CZcams has been around long enough that watchers know where the links are and pointing to "the usual spot below" isn't required.
Imma buy a few more beer glasses because of that opening. 😂
Check out the new TOS shirts too ;-)
@@CraftComputing Will do, love your content.
[FitGirl Repack] 13:38 I died 🤣🤣🤣🤣🤣🤣🤣
This rocks
Awesome!
Is it possible to use your mouse and keyboard to play on all instances simultaneously? If there is some way you could benchmark it.
You can use Barrier.
Its a open-source fork of an older (now commercial?) app called Synergy. It allows you to have a single keyboard and mouse controlling an arbitrary (and heterogeneous) collection of network-connected machines which each have their own locally attached display. The mouse controls the keyboard/mouse input "focus", much like pressing a button on a hardware KVM switch.
When setting it up, you designate one machine as the "server" and the rest as "clients" and describe the positional relationship of the "client"(s) screens relative to the screen of the "server" (right-of, left-of kind of thing). You can use it across an arbitrary mix of Linux, Windows and Mac machines seamlessly. Highest recommendation.
I'd love to see you checkout newer Tesla's like the P100 as those are starting to go down in price
They're starting to, and I definitely have my eye on them.
Wondering if the NVME SSDs were not actually heavily loaded by all 8 instances, since most of the data that the Cryses needed for that first level were only read ~once (because of dedup) and therefore cached in RAM for the other instances. Could turn off dedup and reinstall Crysis to test.
The reason for the dedup is to save on disk space not for performance. Would love to buy several 4TB NVME SSDs for ZFS raid but too pricey at the moment.
@@Darkk6969 I understand. I'm just saying the performance test in this video might not perfectly match reality if the machines are loading different levels.
I managed to setup vgpu follow your guide. but when trying to export video in Pr, it said no available video card. Any tricks that I can do?
interrestung you using sata drives, this means you using a standad SAS controller? or can you use nvme on this system too? if yes why you dont buy a adapter bord thats hase the size of a 2.5 inch drive and has on its self a m.2 connector for nvme drives if you want fast drives
I'm looking to put together a home, rack, gaming server together just for the server, to connect to, not to game directly from. Being new at this do you need graphics cards when all the server is doing is processing incoming player computers ? I've been surprised at how little i've been able to find about making gaming servers when it's not an old PC / Laptop you are converting. Anything would be a great help.
I'm wondering how to go about connecting eight monitors, eight mice, and eight keyboards to this server. Could you provide guidance on the process?
That opening add 💀💀💀
Jeff lookin like Sammy Hagar 😂
Strange config! In your video and in the links I see SuperServer 1027GR-TRF with X9DRT-HF. Right?
This motherboard supports Xeon E2 processors with 12 Cores and DDR3 as much as possible, but you have something more advanced stated in the video! Or do I not understand something?
This looks like such a cool project, how does it handle anti cheat? I'm guessing EAC would not play well with this?
Interesting video, in the past you used parsec for your remote gaming, what was the motivation for switching to moonlight?
Moonlight is 100% locally hosted and open source. Plus, Parsec doesn't allow me to run multiple clients on the same screen like I did in this video.
@@CraftComputing how did you find the performance between the two? Moonlight seemed to be giving you a fairly good response time.
Is it possible to play multiplayer between all of the VMs?
You pulled it off, and with allot less components than LTT.
And a budget somewhat below $40K. 🙂
Jeff you do a great Sammy Hagar impression.
PCI-Express slot: nice and tight
It cleared the memory by ~3mm!
Very good viedo, i find more easy to run CCBoot on windows server and deploy games as ISCI with only one copy to all 40 diskless PC with very low latency and 4gib ethernet pci as a team for load balancing, and in the end it took only 600GiB of disk space,
By anychance can you link the GPU power cables that you are using I am having a hard time finding them off ebay?!
Would a cloud gaming server like this be able to handle cloud VR on the Quest (or Pico)?
Don't beat me to the next video on it ;-)
@@CraftComputing ah, apologies. 👍
Crysis has a benchmark tool you can run that should better test loading data from the drive, since it runs a flyby through the first mission.
Why not get a $200 end up to plug for PCI Express slots. You can get one with a bridge chip that allows you to plug twice as many nvme drives to maximize throughput