nVidia GRID/Tesla Gaming Server Pt.3... IT WORKS!... kinda...

Sdílet
Vložit
  • čas přidán 15. 02. 2020
  • Part 3 is finally here! But is it mission accomplished?
    But first... What am I drinking???
    Two days of filming means two beers to enjoy! First up, Samuel Smith's (Tadcaster, UK) Organic Chocolate Stout. This was was....ok. It says stout, and is USDA organic, but is also technically a malt beverage.
    Second was muuuuch better, with Mankato Brewing (Minnesota) Real IPA. Crisp, citrusy, refreshing, and an unknown ABV, because it looks like it has a homebrew can label.
    So, there were some compromises made in then end, and they were all due to software compatibility. First off, this became a 4-gamer rig, not 6. Second, Windows 8.1 is the highest OS we're allowed to install. But in the end, does it work and was it worth it?
    Links to items below may be affiliate links for which I may be compensated
    Check out the Seagate IronWolf 1.92TB Enterprise SSDs on Amazon: amzn.to/3bMZdNd
    Seagate FireCuda 510 1TB NVMe: amzn.to/2SSELln
    LABISTS Raspberry Pi 4 4GB Complete Starter Kit: amzn.to/2UTMyBM
    Coupon Code for 10% Off Labists kits: GRQ424DF
    Find the parts I recommend on my Amazon store: www.amazon.com/shop/craftcomp...
    Follow me on Twitter @CraftComputing
    Support me on Patreon and get access to my exclusive Discord server. Chat with myself and the other hosts on Talking Heads all week long. / craftcomputing
    Music:
    Link: incompetech.filmmusic.io/song...
    Link: incompetech.filmmusic.io/song...
    Link: incompetech.filmmusic.io/song...
    License: creativecommons.org/licenses/b...
  • Věda a technologie

Komentáře • 350

  • @justbubba4373
    @justbubba4373 Před 4 lety +115

    He has returned. After 4 months, he has returned to inform and instruct us in the ways of sketchy resistor modding and diy game streaming servers.

  • @reverendaero
    @reverendaero Před 4 lety +84

    4:30
    "...sail the seven seas..."
    May have busted up laughing at this point

    • @The_Keeper
      @The_Keeper Před 4 lety +5

      Never stopped sailing. :D

    • @apIthletIcc
      @apIthletIcc Před 4 lety

      Same dude lol me too that was actually hilarious

    • @ooHotcooleRoo
      @ooHotcooleRoo Před 4 lety +4

      While sailing the seas I would've probably tested the newer vmware stuff, since that's probably available on the seven seas too.

    • @win7best
      @win7best Před 3 měsíci +1

      I sailed the seven seas and still didn't find it

  • @skaal_
    @skaal_ Před 4 lety +54

    The Server Strikes back ... GTX 690s 2 Cards, 4 GPUs, and a whole lot of heat

    • @CraftComputing
      @CraftComputing  Před 4 lety +14

      You watched the ending :-D

    • @Skids4777
      @Skids4777 Před 4 lety +1

      @@CraftComputing As did I... Hoping to see what you come up with using those cards...

    • @stevearkwright
      @stevearkwright Před rokem +1

      @@Skids4777: Likewise. I spent £80 on the nVidia Grid K2 8GB so I’m not giving up. I’m looking towards a Debian Linux flavour to save the day.
      What I *really* want is this card in bare metal TrueNAS Scale running the Plex plug-in, utilising the K2 for transcoding and video out. How hard can it be, ffs???

  • @joeck
    @joeck Před 4 lety +22

    Mad respect that you managed to hustle your way through that many hypervisors without flipping your table. The licensing BS is just atrocious. I tried ESXi and Xen and settled on proxmox for sanity's sake. Great job.

    • @ahmedyo2
      @ahmedyo2 Před 3 lety +2

      Just curious - were you able to use VGPUs on proxmox without any licensing issues . i have an esxi host running 5 developer vms and few git/database / etc , I wanted to utilize vgpu so that windows vm renders using gpu . at this moment all of my cpu utilization mostly is for rendering desktop alone :)

    • @joeck
      @joeck Před 3 lety +3

      @@ahmedyo2 i'm running 1u servers with 10gig fiber for storage so sadly there is no pcie expansion left for me to even try - you might wanna check r/homelab

  • @justDIY
    @justDIY Před 4 lety +19

    "Sail the seven seas," I love it!

  • @Johnbscv
    @Johnbscv Před 4 lety +2

    Running a GRID K2 using ESXI 6.7 u3, works great! However, you can tell that Kepler is quite the aging architecture. The GPUs are powering several W10 machines. Regarding the fans, I ran the K2 inside of an R720, and controlled the fans over the IPMI interface exposed by iDRAC, which works wonders. I can slow the fans down when not much is happening, and increase them when gaming on one of the VMs. Technically one could create a script that polls nvidia-smi over SSH from the host, check temperature, and adjust fans based on that.

  • @n3ttx580
    @n3ttx580 Před 4 lety +20

    This is actually more interesting than "7 gamers 1 cpu" by LTT :D Really great video :)
    Also that server is quiet. Try to run PowerEdge 1950. Or 12 of them, like I did. Ear protection is a must.

    • @CraftComputing
      @CraftComputing  Před 4 lety +6

      Thanks! And trust me, it's much louder in person. You can hear that thing in every room of the house, even running from the garage.

    • @stevearkwright
      @stevearkwright Před rokem

      @@CraftComputing: No wonder, when you’ve cut the wires for 12,500rpm on each fan! 😲😀

  • @TehJumpingJawa
    @TehJumpingJawa Před 4 lety +4

    While perusing ebay for throw-away priced server hardware I routinely see K10/K2 cards going for pennies; I'd always been curious what it'd take to get them working.
    Kudos for taking the plunge, and fulfilling my curiosity!
    Would love an update when you work out whatever is causing the network frame drops.

  • @DangoNetwork
    @DangoNetwork Před 4 lety +2

    On VMware side, you need full vCenter license to give you vGPU support. You can trial for 30 days. Grid management driver needs to install on the esci host via ssh. Then you will see vGPU with profile listed in vm config list. It's really easy when everything is compatible.

  • @SteveOwensRoswell
    @SteveOwensRoswell Před 4 lety +1

    Appreciate your honesty... not all projects work as planned. Not all CZcamsrs are willing to admit that.

  • @_mwomp
    @_mwomp Před 4 lety

    I just re-watched the vids a week ago, thanks for following this up!

  • @Kapitaen_Flauschbart
    @Kapitaen_Flauschbart Před 4 lety

    Hello there!
    Nice and clean presentation! I like your thorough illustrations.

  • @Travelfast
    @Travelfast Před 4 lety +2

    Great video again dude! That Samuel Smith Chocolate Stout is delicious!

  • @mattb4526
    @mattb4526 Před 4 lety +2

    On the R15 score, i'm still running an i7 930 @ 4ghz (daily) and it gets around 630 in cinebench r15. It's amazing how far u can push them especially compared to newer cpus which have already been pushed so far there is little overclocking headroom. Anyway keep up the brilliant content on "cheap" hardware.

  • @rossgarner58
    @rossgarner58 Před 4 lety +1

    a very entertaining series and well done.

  • @platinumfreeman
    @platinumfreeman Před 4 lety

    Congratulations on your work!

  • @highplainsdrifter1502
    @highplainsdrifter1502 Před 3 lety

    Anyone that will work his ass off or should I say brain, deserves my subscription. The question I would have is , when I was in College I in 1995, I could go every other day on 4 hours sleep. Now that I am 50 years old, I still can't sleep when I get wrapped up in a project but I look and feel like someone beat the hell out of me after going on 2 hours sleep per night. Not to mention I have Graves Disease ( Eye muscles are not the right lengths ) and I end up with eye pain and headaches, but watching you try this peaked my interest and that adds just another thing I want to know about. In 1995, there were 2 people at The University of Georgia that had a computer at home. I was some an outlier the Professors found out about because I never went to the Computer Lab, because I could build a PC in 1995 I was lucky and a millionaire Professor was able to get me a CEO internship. But in my last 6 months at UGA, I was supposed to go to class on Tuesday and Thursday to finish my last 2 classes and drive from Athens, GA to Atlanta, GA for CEO mentorship. Two weeks before class started, a psychotic man left a Hospital saying he was going to kill himself and someone else with his vehicle. He left the hospital, then drove 20 miles at 125 mph and when I pulled onto the empty highway, he crossed 2 empty lanes hitting me head on at 125 mph.
    He died immediately and I died and came back but I only just recovered enough from constant headaches to care about computers again. Also, Georgia is the most corrupt state in the union. All Federal Laws pertaining to disabled people are laughed at and I applied for disability 25 years ago. The Governor has been killing the poor and disabled since the 1990's, they did not care if I was going to be making $200,000 a year and I had to figure out all of my medical diagnosis because Georgia is full of Doctors that became Doctors for the quick easy money and not to help people. The only thing I miss about College was being around people like all of fellow Nerds. I like having someone to bounce my ideas off of or work on a project together and our minds work alike. I have worked with Computer Nerds and we did not have to finish our sentences and my family would say I am weird because I want to play with server equipment like Craft Computing. If anyone has a Lawyer friend that can fight these corrupt bastards in Georgia, it would be appreciated, they have made it personal and torturing me for 25 years will not end well.

  • @randallsmith2521
    @randallsmith2521 Před 4 lety +1

    This is awesome... I'm actually considering doing something like this (not with the GRID GPUs, but in the more traditional multi-gamers, one computer) for my kids. I really do like the idea of everything being centralized and not having to maintain three separate machines for them. I didn't realize that Dell had rackmount workstations. You have given me ideas!

    • @JimmyZeng
      @JimmyZeng Před 4 lety +1

      Well, servers and workstations aren't that different anyway, at least some of them, I built a (2nd hand) R720 with 1070*2 gaming system last year, using Proxmox VE, it was really fun! I still won't recommend this though since nvidia seems to be against using retail gaming gpu in virtualization environments, google "nvidia code 43" if you're curious.

  • @TheSgtCyrus
    @TheSgtCyrus Před 4 lety

    Hell yea thanks for coming through with this vid

  • @malbeth8700
    @malbeth8700 Před 4 lety

    Huzzah! Congratulation on getting your Grid cards working! Yeah I also tried setting up a centralized gaming server for in-home streaming (single host), and I scrapped that idea after a couple of months. Even with a hard line connection on a gigabit network it still added just enough extra latency and image compression artifacts that it eventually started to bugging me too much.

    • @malbeth8700
      @malbeth8700 Před 4 lety

      LOL "If you didn't like it well you're dead inside" indeed!

  • @abedfo88
    @abedfo88 Před 4 lety +4

    Samuel Smiths ale, from my home county of Yorkshire-or as its called over in the UK: "Gods Own County".

  • @paulcosteines5556
    @paulcosteines5556 Před 4 lety

    I found this channel by searching for the same problems. Good work. For me though it was set up so my kids could play roblox and sims with their dedicated VMs. Daddy still needs his own dedicated gaming computer.

  • @ryanhill8651
    @ryanhill8651 Před 4 lety

    I was able to pick up a vSphere product key on Ebay. This not only fully licensed all of my hosts, but also unlocked all of the features, such as vSAN, and Grid K2 support. Might be worth checking out.

  • @kitsu5245
    @kitsu5245 Před 4 lety +2

    This was awesome. Even if it's "not worth it" the voyage of exploration was

  • @nwrk
    @nwrk Před 4 lety +4

    One little hint, on vmware u need ESXi an u need also vCenter Server wich gives u the needed features to use vGPU. i have it running on my server. Supermicro SYS-2027GR-TRF; ESXi 6.7; vCenter 6.7; Grid K1

    • @Spoonuk666
      @Spoonuk666 Před 2 lety +1

      Did you have any issues with 6.7? Pretty sure the max officially supported version is 6.5?

    • @nwrk
      @nwrk Před 2 lety

      @@Spoonuk666 Yeah, the official Supported version is 6.5. but i had it running with 6.7. but its not worth it, k1 and k2 cards are getting weak in this modern days my biggest problem was no h265 support. i upgraded later to an m60 and stoped using vGPU now i use pcie passthrough (can have only 2 VM with this method but better than buying for nvidia licenses)

  • @GabrielFoote
    @GabrielFoote Před 4 lety +1

    This is legit some of the best content on CZcams

  • @Lipa939
    @Lipa939 Před 3 lety

    Awesome video, just on the side note - I guess that someone probably already said this in the comments, but you can actually use the K2 GRID card as a vGPU (let's call it slicing a GPU with use of a vGPU profile) in VMware - you just need a vCentre Server with Enterprise Plus license and drivers loaded onto the host server running ESXi hypervisor. Then you can assign a portion of a GPU to the VM, install a dedicated drivers for the OS and that's pretty much it - tested it with Windows 10 and Server 2016, both worked brilliantly.
    You can always use the GPU in vDGA (Direct Graphics Assignment - or simply Passthrough) mode, where the entire GPU is assigned to a VM (all guest memory needs to be reserved and drivers you install on a guest are different) - works great too. Had one of the PoC projects in the past where I needed to set up a virtual CAD server for a client, and that was a way to go :)
    Anyway, expensive but great fun!

  • @admiralkirov3442
    @admiralkirov3442 Před 4 lety

    I' ve seen systems like this used to run VDIs used for CAD and 3D drawing, using them for gaming is like forcing them in a spot they don' t fit well into, congrats for getting it working!

    • @altairfoo1920
      @altairfoo1920 Před 4 lety

      Tesla P40 in cloud gaming is a beast. 😂

  • @Cobalt_027
    @Cobalt_027 Před 4 lety

    Beer and Computing, where has this channel been all my life

  • @Terracraft321
    @Terracraft321 Před 3 lety +1

    Thank you for the great content ^^ this was super informative

  • @sin3r6y98
    @sin3r6y98 Před 4 lety +1

    working on something similar myself, you'll get better results using KVM's SPICE protocol, depending on distro you have to patch it to allow h264 encoding. Then instead of a qxl-display you pipe it directly to a hosts render node with egl-headless.

  • @wossman
    @wossman Před 4 lety

    Hey Jeff!
    Take heart, my friend. The point is that you made it work. And personally, it was fun to follow along on your journey of discovery. Keep the projects like this coming!

  • @anticommunist840
    @anticommunist840 Před 4 lety +10

    Do a review on that beer.

  • @evilgeek87
    @evilgeek87 Před 4 lety +2

    I had that same Intel Pentium bunny-suit plushy as a kid, kinda wish I had any idea where it was, but it's fun to see someone else still has theirs.

  • @ThePoot_tf2
    @ThePoot_tf2 Před 4 lety

    you finally did it. im so proud!

  • @rdsii64
    @rdsii64 Před 4 lety +3

    What's in those 4u rosewill boxes, and what rails did you use?
    While I'm here, what rack is that. I'm looking at a startech rack in the near future.

  • @TheDualMP
    @TheDualMP Před 4 lety

    I have a M60 around, maybe I should give it a try too. Enjoy your video, keep it up.

  • @amnottabs
    @amnottabs Před 4 lety +15

    11:15 hey you fired up an og PS4

  • @ittos90
    @ittos90 Před 3 lety

    Gotta love the Mikrotik CRS328-24P! Best managed PoE switch for the price

  • @ezequiel5260
    @ezequiel5260 Před 4 lety

    I've been thinking on doing this experiment for about a year, in order to host a Lan Party with my friends to play low demanding games from one single system. Your videos were extremely insightful specially about now before ordering some used parts; mostly regarding software.
    I'm aiming to go with a used Firepro S7150x2 and trying out GIM (Amd's Linux GPU-IOV Module) to achieve the MxGPU virtualization. I'm doing a full Linux setup (on host and VMs).
    The ability to deliver the processed image to the remote clients is something that I will have to research further, as it's not as simple to just install Parsec and call it a day. I know this will take a ton of effort and time!
    I would liked to see what was the performance when you split those GPUs even further, like having 8 clients at the time, or even 16. I'm not aiming for any demanding titles, probably Dota 2 would be the most powerful game I test.
    Thanks a ton for this video, this kind of content is the most existing thing on CZcams Tech Channels!

  • @SmittyEh.
    @SmittyEh. Před 4 lety

    Glad to see another update!

  • @MajorArchitect-0
    @MajorArchitect-0 Před 4 lety

    I used to have a 7610, there is literally a menu in the bios to put the fans on full speed there was no need to cut the wire. I also used it for virtualization

  • @juliano_1996
    @juliano_1996 Před 4 lety +2

    Oh boy that end...

  • @randomgaminginfullhd7347
    @randomgaminginfullhd7347 Před 3 lety +1

    Hi bro, where's Part 2? I love your work!

  • @Jimmy___
    @Jimmy___ Před 4 lety +6

    This video was much more interesting than Linus' version imo. His one is like "with unlimited money and support, how many gaming rigs can you fit in one box?" whereas this is much more like something I would try to get working and with concerns like hardware and licencing budgets being fairly low or nonexistent. This is also much closer to the type of virtualization I want to move towards, not just having a full discreet system for every VM you need while sharing CPU and motherboard as Linus did.
    With that being said, I'd be interested in what steps you could take to make this system work better as I'd like to do something similar. For example, what if you set up the system with a more modern CPU with the intention of just creating one streaming client that works well. What is the thinnest client you can use and get a close-to-five-star experience?
    It's a real shame about the greed that has happened with regard to these Grid systems, and sadly I'm sure that many of the limitations of this setup (including drop outs and other issues) are a result of the OS limitations and have likely been patched in newer versions of the hypervisor, not to mention using old Windows. Still, it's nice to see someone who isn't just throwing money at the problem to fix it. Perhaps you could investigate the viabiliy of this setup with those licences having exhausted all other options. At any rate, I respect your approach and having done it cheaply first

    • @Gastell0
      @Gastell0 Před 4 lety +1

      It is also extremely sad to see powerful modern gpu's to be licensed so heavily where end result would be that they would worth nothing for 2nd hand consumer market unlike all other computer parts. It's just dead unusable hardware.

    • @stevearkwright
      @stevearkwright Před rokem

      @@Gastell0: Maybe there’s a Linux solution? Sounds more likely/promising. I’m going to look into it to provide a use for my K2 card. Gotta find something.

  • @TheBIOSStar
    @TheBIOSStar Před 4 lety +2

    What were you looking at when you were turning around while in front of your screen? :D Glad you're back btw.

  • @scudsturm1
    @scudsturm1 Před 4 lety

    thats some nice fan sounds

  • @justplaingarak
    @justplaingarak Před 4 lety

    Also, if I were to guess, the drops you're seeing could also be the encoding of the video. You're right in that you probably aren't seeing drops due to network, but if you have multiple NICs on the workstation and can team them, that might improve your experience as well.

  • @cptcrogge
    @cptcrogge Před 4 lety

    Well done!

  • @andreashaugland931
    @andreashaugland931 Před 4 lety

    Proxmox supports vGPUs too. And it will also play nicely with your cache drive and such. It might be less of a headache :)

  • @lachiu1
    @lachiu1 Před 4 lety +15

    I was expecting the fans to be much louder... The fan of my supermicro psu is louder.
    Can you try kvm too?

    • @ohap1234
      @ohap1234 Před 4 lety

      Yes supermicro servers psu are retarded loud thats the old server I had, I gave it away to a friend when I switched to dell R520

  • @Batman-xl2bg
    @Batman-xl2bg Před 4 lety

    Had no problems here on vmware. The info for install was hard to find. Noticeable difference from your setup was i used a legit esxi serial. Not free Awesome video tho. You got me thru the hard times while setting this up. Cheers

  • @uptimefpv
    @uptimefpv Před 4 lety +1

    If there are extra CPU cores/memory, you could setup another VM as a Steam Cache. Another thing to test is using Moonlight Internet Hosting Tool. Another alternative streaming that might fix the dropped frames. Maybe a Part 4?

  • @IanC14
    @IanC14 Před 4 lety +1

    Steam Link (both hardware and software version) recommend either a 5Ghz WiFi connection or ethernet. I know my Nvidia Shield (upstairs in my bedroom) is pretty much damn near indistinguishable from local with gigabit ethernet but WiFi is a bit blocky at times, no matter what WiFi network I connect to

  • @danieltracy5559
    @danieltracy5559 Před 4 lety

    I have been waiting for this video!

  • @robertsanchez5279
    @robertsanchez5279 Před 2 lety

    awesome video

  • @qubinets5014
    @qubinets5014 Před 4 lety +2

    Dude ESXI 6.5 working fine, you need to setup vCenter and do everything there , i followed Jason Meers - VMware - Lead Architect
    guide and everything works with Nvidia Grid K2, so try again with his tutorial =)

  • @nathanieldoyle4972
    @nathanieldoyle4972 Před 3 lety

    Hey mate, quick questions, what resistors did you use to "change the tesla k10" and do you also have a link to the bios? I managed to get my hands on 5 k10's and I'll looking at modding one for my partner to remotely encode her livestreams on, great vids man keep it up

  • @ThePoot_tf2
    @ThePoot_tf2 Před 4 lety

    ive done some testing with steam in home streaming, and i prefer parsec in some ways. when i use steam in home streaming i notice its always using cpu encoding, which is not bad if you have an ok cpu, but i was using a xeon x5670, and it wasnt very good.
    i prefer parsec because i was using a rx 580 8 gb and parsec what capturing the screen with the gpu, and it was so much smoother.
    i did have some issues when running parsec on my laptop over wifi. on wired it ok.
    im very glad to see this conclusion.

  • @BasedPajeet
    @BasedPajeet Před 4 lety

    I was waiting for this one!!!

  • @5had0w5talk3r
    @5had0w5talk3r Před 4 lety +7

    You might be able to get around some of the limitations in those older versions of ESXi and Xen, by using KVM in Proxmox or whatever other distro you want. Grid software will still have its own limitations, but you might get more out of it in the end.

    • @JimmyZeng
      @JimmyZeng Před 4 lety

      I suppose GRID can't be used that way since proprietary driver restrictions, BUT, we may have a chance with the linux open source driver? then with proton we might get somewhere?

    • @5had0w5talk3r
      @5had0w5talk3r Před 4 lety

      @@JimmyZeng I'm fairly sure nouveau doesn't have any sort of vGPU support (it would be strange, given how it lacks support for most other things). I can't think of a reason as to why you couldn't pass the vGPUs with Grid Software to Linux guests, though.

    • @CraftComputing
      @CraftComputing  Před 4 lety

      For the K2, there are no vGPU drivers for Linux. Windows support only :-(

    • @5had0w5talk3r
      @5had0w5talk3r Před 4 lety +1

      @@CraftComputing That's not what I'm seeing on Nvidia's website. "GRID Software for Red Hat Enterprise Linux with KVM Release Notes Version 367.130/370.35" - last updated March 15 2019 - states the Grid K2 is supported under Linux as a host.

    • @AlexWilliamson-aw
      @AlexWilliamson-aw Před 4 lety +2

      Correct, each GPU of a K2 can be assigned to a separate VM with KVM, no vGPU required. There are also Windows 10 and Linux drivers for the K2 (look for "GRID Series", not "NVIDIA GRID vGPU").

  • @RAMMSPECK
    @RAMMSPECK Před 4 lety +2

    I'd suspect the VMs are choking on the stream rendering that's why you're getting lag. I'm not really deep in Steam Link or Parsec but there should be some encoding settings. Either dialing down the resolution or bitrate could help. Or trying to use another hardware renderer - Those ivy bridge Xeons should support h264 encoding via QuickSync although I don't know how QuickSync behaves inside a VM. And NVIDIA should have some hardware acceleration for h264/x264 as well (but I'm not sure there)

  • @longnamedude3947
    @longnamedude3947 Před 4 lety

    Have you tried:
    Ibik - Aster Multiseat?
    It is a Windows-only software, but useful for maybe people looking to try this out with consumer grade hardware.

  • @ItsKingMyles
    @ItsKingMyles Před 4 lety +1

    well shit, i went to Mankato for school.
    much love from MN ~

  • @dashtesla
    @dashtesla Před 4 lety +1

    I run PARSEC myself i have an hp z420 workstation with a quadro p4000 though i run windows server 2019 datacenter straight off the hardware no passthrough for the gpu, so my own personal experience is that if you increase parsec bitrate any higher than 10mbps you're gonna get all sorts of issues, the problem is with the encoding, i tried some different stuff in the past like having a second gpu dedicated to rendering and mirroring monitors while using displayport dummies (i have a radeon pro wx2100 i was using just for h265 encode and it was worse than using just the p4000 alone) though i suspect maybe using a p400 along with a p4000 and using the p400 for h265 encode may work better, though these gpus are not for gaming anyway and it's just a little bonus for me. But in the case of parsec try running h264 encode and 10mbps since your gpu probably is too old to encode h265 in real time. Cool thing about the quadros is that even the p400 can take up to 8 encodes at the same time but in theory any new card even a gt 1030 would help with h265 encode if you can get it to work the right way. You can look up all the info about NVENC on wikipedia. Also setting which gpu is encoding can be tricky whenever dealing with multi-gpus the software just isn't designed to run that way so it defaults to whatever it wants, in your case i would try adding a p400 there for the encode and see if it improves and also proxmox can handle virtualization and passthrough better than xenserver and esxi i would take a look into it i remember reading in the forums about the grid and tesla cards.

  • @sophustranquillitastv4468

    You said you're not going to recommend this thing but I want to try one of this my self.

  • @soucouyant
    @soucouyant Před 4 lety

    Awesome!!! Just Awesome video!!!

  • @justplaingarak
    @justplaingarak Před 4 lety

    Steam Controller is great if you use the gyro sensor for aiming! Use the pad for gross aiming and the gyro for fine aiming. I use the same type of setup with the PS4 controller and Steam profiles as well.

  • @Maisonier
    @Maisonier Před 4 lety +1

    wow...amazing video dude!!! and what's the specs of the network? 10 gbe ethernet? What software did you use for remote view on PC? Have you tried NoMachine?

    • @Maisonier
      @Maisonier Před 4 lety +1

      ps: What about Fedora + KVM + QEMU?

  • @2008spoonman
    @2008spoonman Před 4 lety +2

    Have you tried XCP-NG with passthrough?
    - I'm waiting for the day you knock over your beer and spill it over hardware....... ;-)
    Love your channel and videos !!

    • @RAMMSPECK
      @RAMMSPECK Před 4 lety

      Unfortunately XCP-NG can just passthrough the whole card and not just a part of the GPU like Citrix XenServer due to commercial drivers and Licensing on Nvidia's side.
      It would be nice if XCP-NG would be able to do this but it wouldn't be fully open source if they'd implement commercial code from Nvidia (licensing as mentioned in the video aside)

    • @ohap1234
      @ohap1234 Před 4 lety

      I got xcp-ng working and passed tho each gpu 1 card 2 gpus and had 2 win10 vm each one had 1 gpu . Only thing is xcp-ng is buggy maybe cus I was trying to boot uefi idk but I had so many boot issues and laggy performance

  • @joebonsaipoland
    @joebonsaipoland Před 4 lety

    Vmware ESXI 6.7. Supports vGPU in the free trial license. Did you try that? Easy to get a “new license” if that one expires. Curious if VMware ESXi would perform any better!?

  • @user-xh5pi2nf9q
    @user-xh5pi2nf9q Před 4 lety

    I have been using Parsec for months without issue. Im running a 2700X and 1080Ti. Im working towards a setup similar to what you are doing but with UnRaid most likely. I do it over ethernet and Wifi. Server is ethernet, laptop is wifi, steamlink is ethernet. Id like to see you run a consumer card as a comparison.

  • @jonathanbarber1531
    @jonathanbarber1531 Před 3 lety

    I run an old NVIDIA Quadro Plex model IV with a single GTX 980 card while using HP ZCentral Remote Boost when remote gaming and pleased with the performance due to the system being a server and older Tech. Wouldnt mind finding a Quadro Plex 7000 and swap to 1080ti Card or cards etc. But Both Units can hold 2 cards wondering what 2 Tesla K80's could do if anything as a 4-gamer rig server since the K80's are dirt cheap on ebay at the moment.

  • @eatont9999
    @eatont9999 Před 3 lety

    Cool project. It would be nice if nVidia would sponsor some GRID software for you to make it easier. I think gaming over a remote session is going to be problematic without editing the network stack for the lowest latency possible.

  • @amp888
    @amp888 Před 4 lety +5

    Hmm, cutting the fan wires to disable PWM control seems a bit drastic; if you couldn't change the fan speed through the BIOS or management, couldn't you just have taped over the PWM pin contacts?

    • @CraftComputing
      @CraftComputing  Před 4 lety +2

      I have a full replacement set of fans for this server. I wasn't worried about wasting them :-)

    • @admiralkirov3442
      @admiralkirov3442 Před 4 lety +2

      Very few servers allow you to adjuts fan speed, the fans are managed by a dedicated CPU running a small OS that just monitors and manages the motherboard, and is designed to guarantee the maximum availability of the system, not of people eardrums! :P

    • @amp888
      @amp888 Před 4 lety +2

      @@admiralkirov3442 I don't know about the R7610 (or others in the workstation series), but the Dell PowerEdge servers from around that generation and newer make it really easy to set custom fan speeds. In my R730 it's in a drop-down menu in the system BIOS, or can be set in the iDRAC.

    • @admiralkirov3442
      @admiralkirov3442 Před 4 lety +1

      @@amp888 Did dell really add that feature on rackable servers? That's cool, I didn't know about that!

    • @amp888
      @amp888 Před 4 lety

      @@admiralkirov3442 Yeah, I don't know when they started, but it's been there since at least the 11th Generation of PowerEdge servers (e.g. R610/710).

  •  Před 4 lety

    Hi
    Great Video and Project!
    I've done something similar with my Grid K2.
    Did you try GPU passtrough to a Virtual Machine?
    Because that's what I did. It gave me the most "success", even the performance is okay-ish though.
    The virtual machine ran with Windows 10 without any driver problems with the Grid K2

    • @Hamkaastosti1
      @Hamkaastosti1 Před 4 lety

      Did you get parsec to work? I also tried a similar setup with a Proliant Gen9 DL380 and a Grid K2 in Hyper-V with DDA passtrough but parsec can not use it because it does not have a display out port. Also tried VMWare 6.5 but was not able to install the nvidia grid driver in VMWare.

    •  Před 4 lety +1

      ​@@Hamkaastosti1 Never tried Parsec, so I can't say anything about that. I'm using VMware ESXi 6.7 U3. With GPU Passthrough you don't install the driver on the ESXi Host. I've installed the driver for the GRID K2 directly on my virtual machine. The catch is you can only have 2 VM's with GPU Support. GRID K2 is a dual GPU.
      There is one small thing that needs to be edited in the .vmx-file of the virtual machine. Otherwise it won't work. (Drivers can't be installed or the setup crashes with a strange Error or something like that) But I can't remember what it was. I will check as I can.

  • @theoryismypraxis3538
    @theoryismypraxis3538 Před 3 lety

    would there be a way to funnel the power o both cards into one system? You think the 10 gig connection possibly using gpu passthrough would be enough throughput to not choke the performance of the cards?

  • @florian76
    @florian76 Před 4 lety

    What's the difference between LTTs "7 gamers/1CPU" and your setup? As far as I understand, LTT is actually gaming ON the server vs. you are streaming the video to a remote RasPi. Latency and hiccups may be related to that video encoding/decoding and optimization on that end might drill down the latency. Have you tried connecting with a "real computer" instead of the RasPi's? Awesome project, by the way.

  • @MrFloRolf
    @MrFloRolf Před 4 lety

    Do you think it would be possible to run a "2 gamers 1 cpu" type or system that scales? For example, I bought a 3900X and it really has enough horsepower for two systems. Could I just add a second GPU to the mix and then, whenever I want, split the system into two 6cores but still be able to use one dual gpu (SLI if possible but I don't think so) 12core system at other times?

  • @hi_tech_reptiles
    @hi_tech_reptiles Před 4 lety +3

    SteamLink has worked amazing for me both locally and over the internet - that kinda stuttering and stuff is non-existent, so it definitely is possible to get a good lower latency connection, especially without those stutters. I have only ever gotten the artifact very rarely, usually when using a bad wifi connection over internet, never locally. It basically looks like 1440p on a phone even lol. So SteamLink is quite capable, though my PC that's running the games is hooked up to a 500MB down low latency internet connection. What RAM do you have in that workstation?

    • @jonmayer
      @jonmayer Před 4 lety

      I agree steamlink is fully capable. Something is wrong with the server, the network, or both.

    • @stevearkwright
      @stevearkwright Před rokem

      128GB fast RAM and, yes, it’s probably a network switch that’s the bottleneck here.

  • @JasonLeaman
    @JasonLeaman Před 4 lety +1

    I was working on a Project to Pass a K5000 to a VM in Hyper v on server 2016 on my HP Ml350 G8 and what a fail that was! Xen looks interesting. I wanted to just do a RDP to window 10 Pro vm to do some light cad work..

    • @Hamkaastosti1
      @Hamkaastosti1 Před 4 lety

      What issues did you got? I also used DDA passtrough in Hyper-V 2016 on a DL380 Gen9 to test if it was good enough for Autocad and for me it worked fine via RDP if the up and down link are sufficiënt.

    • @JasonLeaman
      @JasonLeaman Před 4 lety

      @@Hamkaastosti1 the g8 is what I have, it doesnt do dda, the go does for sure tho.

  • @theburntcrumpet8371
    @theburntcrumpet8371 Před 4 lety

    Thank you!

  • @danjones4002
    @danjones4002 Před 4 lety

    Im working on something very similar. Im just doing gpu passthrough. Right now im stuck on getting the client side figured out. The steam link sucks because dealing with none steam games is a pain, and i wish it would run kodi natively for my media needs. I really want to test parsec next

  • @ricardomacarico818
    @ricardomacarico818 Před 3 lety

    I bought 3 Tesla M2090 graphics cards for mining, i´m testing like you :D
    Since these machines were created for calculations and not for playing, I believe that I can still perform an interesting hashrating with them.
    What do you think?
    Cheers from Lisboa / Portugal

  • @hex2307
    @hex2307 Před 4 lety

    I've being waiting so long

  • @JimmyZeng
    @JimmyZeng Před 4 lety

    Is NVENC available on those cards? if not, this could be the cause of the steam/parsec remote performance issue. This(unavailable NVENC) was an issue in reusing mining cards for gaming, you might have mentioned this in previous episodes, but I'm a bit lazy to check back.

    • @CraftComputing
      @CraftComputing  Před 4 lety

      The answer is.... maybe. nVidia says in their documentation that NVENC is not passed through in vGPU mode, but also says NVENC only works with vGPU assignments with 1GB or more of VRAM. Either way, it did not seem to be working in WIndows 8.1.

  • @zack4485
    @zack4485 Před 4 lety

    GRID K2 works out of box on vSphere 6.7; no hacks required. I agree it isn't officially supported according to the HCL but I can tell you from personal experience that it works. As for 6.0 and 6.5, the K2 is officially supported on those versions. Were you trying to use the bare hypervisor or were you using vcenter for management?

    • @CraftComputing
      @CraftComputing  Před 4 lety +1

      I've heard it works in VSphere 6.7 as well. I may pick up a license on eBay and give it one last shot.

  • @ofacefan
    @ofacefan Před 4 lety

    my guess is a bottle neck with the older Pis, memory, network mainly. you should setup up a grafana/influxdb/telegraf monitoring VM and have it collect on the PI's to see where the bottleneck is

  • @Myvoetisseer
    @Myvoetisseer Před 4 lety

    Great video!
    Any way to get this working on a GeForce card? I'm aware they can do passthrough, but I need vGPU. The 2080ti has more than enough power for my purposes, and I don't want to pay the Quadro premium just to have this feature enabled.
    I wouldn't mind sailing the seven seas for this, or at least flagging some ships down from the shore.

  • @Morimea
    @Morimea Před rokem

    Amazing!
    Crazy effort to make it all work, and modify Nvidia wow!

  • @joelcrocker1094
    @joelcrocker1094 Před 3 lety

    Jeff I got my Tesla card working my system reads 22 gigs of VRam now with the driver that Driver Booster 3 chosed for me on steam, it is clear that my GTX 660 Ti only has 2 Gigs of Vram, I have 48 gigs of ram, the driver that supports my card is less than a 1 month old says the bios date

  • @benricok
    @benricok Před 4 lety +1

    Did you try XCP-ng? its the open source version of Citrix Xen server
    EDIT: That is how my 2 HP servers sound when it starts up lol (1200RPM)

  • @dorion9111
    @dorion9111 Před 4 lety

    I wasn't being rude about your build cause I do enjoy watching you assemble older hardware and making something useful out of it. The fact that you modded those GPU'S to work as Graphic cards is awesome... If this worked flawless then you would run out of Video material ;)

    • @CraftComputing
      @CraftComputing  Před 4 lety

      No offense taken or implied. Just answering comments as I come to them, and my box is filled with suggestions I addressed in the video :-)

  • @dontthroworanges
    @dontthroworanges Před 4 lety

    Jeff, would love to see the AMD FirePro MxGPU version of this series.

    • @DanielDiaz-by7fc
      @DanielDiaz-by7fc Před 4 lety

      Dan Thale Save us SR IOV, you’re our only hope!

    • @SaroG
      @SaroG Před 4 lety

      I'm also for a MxGPU test as there's very little research done on AMD's solution. For what it's worth, I tested AMD's Radeon Pro WX 4100 GPU in a PowerEdge R630 with pass-through (SR-IOV) enabled running ESXi 6.7 and.... I was very disappointed with the results. Remote GPU acceleration didn't kick-in like I hoped it would while using RDSH RemoteApps in Windows Server 2016. I installed the special Radeon Pro Enterprise (virtualization-ready) drivers too. I spent a couple hours each day over the span of a week trying to figure out why the GPU utilization counter wasn't giving me any values until I came to the conclusion that RemoteApps + RemoteFX is a crappy combination. Basically there is very little support when it comes to AMD's current vGPU solutions. Sadly, VMware's Horizon doesn't support it either.

  • @TVJAY
    @TVJAY Před 4 lety

    Did you think about trying XCP-NG instead of Citrix?

    • @CraftComputing
      @CraftComputing  Před 4 lety +1

      XCP-ng can only use the open source aspects of XenServer. The GRID drivers are a closed stack, so no dice there.

  • @pixuhl
    @pixuhl Před 4 lety

    Hey Mankato MN! Im living in Minneapolis. If you like a hoppy IPA, try Surly Furious from Surly Brewing Company.

    • @CraftComputing
      @CraftComputing  Před 4 lety

      Like this? ;-)
      czcams.com/video/L3tcfVF8am0/video.html

  • @AmishCrusader
    @AmishCrusader Před 4 lety

    Highly recommend using moonlight instead of parsec. I use it on iPad, Android phone, and it streams great.

    • @CraftComputing
      @CraftComputing  Před 4 lety

      Moonlight requires Windows 10 :-(

    • @AmishCrusader
      @AmishCrusader Před 4 lety

      @@CraftComputing Huh, surprising. It works on Rpi using flatpack install... Possibly through repo as well.

    • @AmishCrusader
      @AmishCrusader Před 4 lety

      Does GeForce experience install on win8? That's the "server" part that moonlight connects to and uses, moonlight should install fine on Rpi or anything else

  • @win7best
    @win7best Před 3 měsíci +1

    Why didn't you use moonlight and sunshine. Also where do I find Xenserver 6.2?

  • @corrgie9830
    @corrgie9830 Před 4 lety +1

    Does the server/workstation not have a management port/iDRAC? IPMI gives very good fan control just need to setup a VM for controling it.

    • @CraftComputing
      @CraftComputing  Před 4 lety

      Nope, no IPMI, and none of the OSs I was working with allowed fan control through software, as they all require IPMI to be there to work.

  • @Gastell0
    @Gastell0 Před 4 lety

    Thank you for update!
    Also why the hell are you using controller for a PC FPS game? xD
    Steam Controller is good many games with exception of FPS, RTS and Strategy games, awesome for platformers