How to Set Up SR-IOV with Intel Flex 170
Vložit
- čas přidán 21. 04. 2024
- Join Wendell as he takes you through the how to set up SR-IOV with intel.
Check out the forum post here: forum.level1techs.com/t/intel...
Supermicro system here: store.supermicro.com/us_en/io...
*********************************
Check us out online at the following places!
bio.link/level1techs
IMPORTANT Any email lacking “level1techs.com” should be ignored and immediately reported to Queries@level1techs.com.
-------------------------------------------------------------------------------------------------------------
Intro and Outro Music: "In the Atomosphere" by Bad Snacks
Edited by Autumn - Věda a technologie
How about SR-IOV on consumer cards (A770)? I'm still waiting for that!
The most wanted tutorial since the invention of GVT-g
I just can't believe it's 2024 and not one of three gpu manufacturers have thought to break ranks and enable gpu sharing pass through on VM's and containers for a consumer card / personal use. Every single person with a homelab / server would buy one.
SR-IOV would make me daily drive Linux again. Single GPU passthrough ended up being painful to the point I dropped Linux as I am very reliant on Windows for VR game development.
@@blitzwing1 I took me two years before I was fed up enough about constantly switching OSes.
Single GPU passthrough is more favorable than dual boot, but if you are like me, it becomes too much of a hassle and hassle is something I already do at work.
Absolutely. And when you think you got it working, you walk away the virtual machine go to sleep and there's no path back to linux @@_NekOz
> Every single person with a homelab / server would buy one.
This is not nearly as enticing a proposition as you make it sound. The combined revenue from all those sales might account for 0.01% of GPU revenue, and probably wont pay for the time it took to implement it, let alone maintain it.
@@ToroidalVortices Dev time? It's not because of dev time they don't allow it, it's for market segmentation been consumer and enterprise hardware. They already must write the feature for the enterprise drivers, there would be minimal work in allowing it on the consumer cards, as the generational architecture is the same.
Man, i am a sick man, could watch Wendell vids 24/7 and never stop enjoying. Greatest man on yt!
I dont need SRIOV at all ... And i CANT WAIT to finally use it😂
I think, conceptually, this would be very interesting with an OS like Qubes OS. You could get the security of an OS that containerizes everything with more of the performance out of your actual VMs. This would have actual security implications if they just made this more widely available and supported.
@@blitzwing1 Yeah I would imagine that an OS based on something like Kubernetes where every application would be containerized would be more performant than QubesOS but virtualization support in all hardware would be a prerequisite for something that is actually usable.
Just picked up an MS-01 myself and am super pumped to watch this tutorial :)
If sr-iov starts working in Proxmox on consumer grade Intel GPUs (A770, etc.) they'll get my money. I only want accelerated desktops for ~4 VMs (2 more slices for jellyfin and frigate would also be nice).
Im considering moving my frigate install to a dedicated low power lenovo thinkcentre 12th gen to substantially reduce power draw.
Love all this. Cant get enough help. I’ll always take it.
Stop teasing us with the A770 🤣, I'm ready to bite the bullet, just not sure on the card or if a variant would work
I picked up an Acer A770 last week, so far it looks like you're dependent on vendor drivers vs newer intel since my attempt at getting those newer intel drivers (with baked in intel control center thing) didn't seem to find hardware it agreed with, so if it's possible, it's a bit more involved than download and run. This is a daily driver workstation, so I doubt I'll be messing with things like SRIOV with it for many years.
Also, I had to disable explosion rendering in Eve Online to stop having a full screen white flash epilepsy inducing graphics experience.
@@SteveBrownRacingthank you, I was considering buying the ACER A770 Bifrost.
One big problem with the A770: Intel has gone *crickets chirping* on tickets asking for them to support graphics encoder firmware loading with the new Xe driver that replaces i915. Search Google for: huc firmware xe
I regret buying my A770, partly for this reason, and partly for the fact that it idles at something like 40 watts, even when I try to enable ASPM.
thanks Wendell
Hummm. First time that CZcams showed me this channel , after I’ve been dubbed to the main L1 channel for YEARS!
I've not seen a company so loathe to supply it's products. The Flex series are essentially unobtainable in the retail environment. Nvidia might charge a lot for their professional cards, but at least there's availability from board vendors and not extreme pricing from server vendors.
That sounds absolutely painful from a user perspective, and the apparent office politics make me mad.
It’s only going to get easier. I’m hearing Wendell giving out so many hints during this video. My guess is the genie is out of the bottle.
I have a brand new MS-01 sitting in front of me awaiting deployment. I've been stuck setting up ollama on my TrueNAS Scale install on my Poweredge T30 /w a RTX 2070. I've also been debating what to install on it (vs TrueNAS). I had Proxmox on my Poweredge, but I removed it and put TrueNAS bare metal. All my True Chart apps get stuck installing/starting. Once I solve that, I was going to setup my MS-01 using the 2.5G port at first - i'm awaiting on two shipments of 4x intel OPT/SR/10G modules and 2 pairs of MMF. I'm glad you made this video. I'm going to watch it multiple times before I start digging in this amazing piece of hardware (for the price). It's my primary home server with the PowerEdge (hopefully) being my mid-range AI box doing only that (inference, not training until a video card upgrade). The poweredge was my "first real server". I've worked support that had a datacenter on prem with 4U Compaq servers from 20 years ago, so seeing something like this in my home today is mind blowing.
Wooooooo! SRIOV baby!
TEACH US HOW TO DO THIS ON THE ARC YO
he just did. flash it.
Next: "vWendell".
In the trend of everything being virtualized, this is probably the next logical step😉
With this I can banish Windows to a virtual machine for everything but gaming, nice.
Gaming on Linux is amazing.
@@bossman18899 Sure is, shame more and more games seem to be going down the invasive anti-cheat route and not putting in the time to support Linux. Basically the only way there's an issue anymore.
@@bossman18899 Yeah but HDR and VR aren't, unfortunately
@@bossman18899 Also some anticheats still hinder us from switching completely.
@@bossman18899 Wine or Proton making games run better than native Windows, somehow.
6.8 seemed to come out with latest Proxmox VE in the last day or so.
D- I'm well aware of ya
Shenaniry *Wendell..*
Intel making this work with their own consumer GPU’s would be … nice and maybe get their sales up?
Currently using my A380 as the host gpu for my passthrough setup. Had to fight through new vendor-reset issues and a startup script with that `echo 'device_specific' > /sys/bus/pci/devices/0000\:03\:00.0/reset_method` fix people got working, in order to get my 5700 xt passed through.
Wouldn't it be awesome if consumer Battlemage supported SR-IOV out of the box haha? Or if even a software update brought it to the A770?
Thank goodness Strong Bad's cousin is working on this. I would trust no one else.
Wendell has hinted at the A770 having unofficial SR-IOV support although it might be for certain card vendors. I am waiting to hear more about this because I would like a single GPU passthrough setup.
They should rename the I915-backports to AI-Accelerator and engineering team will get blank check to do whatever they want with it
I got a Rocket Lake machine (W-1370P), only to find out that even though one Intel page says it supports GVT-G, and another says it supports SR-IOV, it actually supports NEITHER. I guess Rocket Lake is kind of a forgotten/abandoned generation.
That's not the only thing missing on Rocket Lake... the ieh_edac.c driver is both missing from upstream and missing the PCI ID for Rocket Lake. I wonder if the IEH hardware is just broken? Supermicro has it disabled in some hidden setup options.
May be a good point in time to talk battlemage with the wizards at Intel
If Battlemage supported a couple of client SR-IOV sessions then I would buy a couple - even if AMD and Nvidia had better performance.
How about the a380 or a310 hpthose cards would be perfect for my use case if I could get them to work. U can get a single slot half height a310 amd a dual slot half height a380
Where can you buy a flex 140?
Why would you ask that? This is content, for content's sake.
Not sure, but theoretically you can reflash Arc A770 to Flex 170 to enable SR-IOV.
@@mistercohaagen Cuz I want one... or three
Wait 5 years till it gets dropped from Datacenters then buy it at 2x cost from scalpers.
@@szaszm_where’s that how-to?
I wish this worked for igpu on 14700k
How to afford flex and the server it goes into?
13:30 -- passthrough second physical gpu
So is this effectively PCIe pass through to more than one VM at once?
...with windowing the output. You don't need another dedicated screen.
The PCI reset is STILL a thing? I remember that was a problem around a decade ago. I don't think it's on their top-tier list of priorities :)
Have You tried iGPU passthrough on MS-01 with new Proxmox and new kernel? unfortunatelly it doesn't work for me :/ (strongtz do not support new kernel right now)
😂 Strongbad for life!
Don't make him release Trogdor! 😈
So what is the real use case? I have this thing running for let's say plex server. Then I still need a small pc connected to the TV to watch the media isn't it?
The use case is that you can accelerate your plex server and a linux desktop and what else simultaneously. GPU passthrough is your best bet when u only need gpu power for plex.
How does that repo differ from the cgit freedesktop org drm intel repo? YT hates anything related to references.
Can a linux host starfield with a windows guest? Starfield does not work at all with the mesa drivers, missing extensions.
Too funny, I wasted a bunch of time today trying to get an old HD 530 in some xeon thing from 8 years ago to passthrough to Windows 10 without 43'ing me through PVE. I did NOT succeed. Fun day though!
Is this possible with AMD APUs like the 5600G?
afaik SRIOV only works on amd Pro GPUs and Intel
First! Dunno why, but this video was showing as private'ed for just a second.
There's latency to take into account _(not talking about gaming)_ but that needn't be a problem per se but rather that the use cases are specific, such as neural networks running on GPU in use cases whereby the latency is not the priority. So for example, there might be a probability-estimation or vector similarity comparison on some Fourier Transform to be done retroactively on some data rather than as fast as possible in real-time. The GPU uses with OpenCL could be handy _(medical imagery, radiation technologies and so on)._ That then means heterogeneous computing because the device can be switch between for different kernels including on different microarchitectures. Therefore FPGA or emulation expansion card could be used _(and passed through in VM, or Jail via SR-IOV or at least VMDq)_ so that exotic microarchitecures _(most likely custom)_ can have the heterogeneous computing run on there, especially for testing and bug finding. Managing various VMs passing round the expansion device could be done with Ansible but moreover for the jails on account of the listening on multiple sockets. So then you can listen on multiple sockets but also with pass-through of NICs that support that (VMDq or SR-IOV).
This could also help dependency tree mitigation such as RISC microarchitectures, some of which have a tendency to be deciduous. That then can help with hybrid kernels (like SoC, System on A Chip) so a commonplace A53 might have a SoC made on it by emulating it in a FPGA or emulator-expansion card (even if it is slow). The R-and-D of that (or RISC-V, etc.) can then mean its long-term feasibility study is for something like say power-saving or ecologically sensitive applications. Then it can be studied at home in a home-lab, cost-saving, and saving for licencing such that localisation could be planned for as a reasonable revenue source.
My comment has no hate in it and I do no harm. I am not appalled or afraid, boasting or envying or complaining... Just saying. Psalms23: Giving thanks and praise to the Lord and peace and love. Also, I'd say Matthew6.
Sooooo is it mother board?
To bad the Flex170 or 140 fit in a ms-01.
Here
Can this be done on a rolling Arch host with kernel 6.8+ instead of Proxmox?
Yes the qemu is the same tech just get your driver's and firmware right and boom the same
Would it let me run Windows VM on GPD Win 3 and game on external screen in fullscreen mode while browsing the web in host ubuntu on touchscreen without losing focus from the game?
I use Linux! And have Windows because of the office...
My homelab proxmox cluster is made of 5 i7-8700 boxes. Can I get sr-iov working with their integrated UHD Graphics 630?
I want to build a Windows XP Cloud Gaming Rig, as in a linux host with 4 VMs with windows XP. These would be all set up with old lan games. I have friends I do LAN Parties with and We can't ever run old stuff properly on modern laptops, so I want the cloud setup to play these, I' want to try this with the iGPU maybe it has enough power for my use case!
These intel cards don’t seem that cheap. Not sure how the math adds up? Maybe I just don’t understood
The business people got them into this mess. How are there still any business people still being paid by that company? I want to make 6-7 figures for bringing down one of the most successful companies in the history of the USA.
Why is this card so expensive, something like 2700 euro, come on.
It’s not a consumer grade card.
What's wrong with WSL's paravirtualized GPU? Doesn't Windows' CUDA support show that paravirtualization is usable? QEMU has also had a paravirtualized GPU for years now, and SR-IOV seems like a step backwards.
Why is it a step backwards to do things properly and no use bodges to make thinks work. Sr-iov was designed to allow true abstraction.
@@damiendye6623 passing hardware through to a VM is the opposite of abstraction. If things were done properly, then the hardware wouldn't matter at all and a running VM could move from a server with an Intel GPU to one with an AMD GPU, and then on to a server with no GPU at all. Consumer GPUs lack of support from the manufacturer wouldn't even be an issue
@@shanent5793 so how you getting your GPU assisted windows systems running to the required standard to run cad, solidworks, arcGIS working with the nonfunctional virtgl drivers.
Seems like we can all say if you into getting a pc for any gaming... make your money worth spent. at least a 4060 gpu and a 12th gen intel cpu or a amd 5000 series R5 at least.. just do it