Building My New Proxmox Server! - ASUS RS100-E10-PI2
Vložit
- čas přidán 7. 06. 2024
- In this video, I build myself a new home server to use as a dedicated VM host running Proxmox VE based around an ASUS RS100-E10-PI2 server. We'll take a look at the server in its stock configuration, then add a few upgrades including new NVMe SSDs, a 10 gigabit network card a module to enable the onboard IPMI controller.
Buy the 1TB Sabrent Rocket NVMe 4.0 SSD on Amazon (Affiliate): geni.us/9AaY0Nq
Buy the Dopesplay DR138 Lapdock on AliExpress (Affiliate): geni.us/UH5itjY
www.camerongray.me/
/ camerongray1515
Chapters:
00:00 - Introduction
03:16 - Hardware Tour
10:51 - First Power Up
14:38 - Upgrades
17:16 - Ridiculous Packaging!
19:51 - Installing the Upgrades
24:43 - Installing Proxmox VE
27:40 - Taming the Loud Fans!
33:25 - Rack Mounting The Server
38:13 - Quick tour of Proxmox VE
40:47 - Tour of the iKVM Interface
41:45 - Conclusion
AFFILIATE LINKS NOTICE:
Product links under this video marked “(Affiliate)” are affiliate links where I may receive a small commission on qualifying sales. Affiliate programs that I am a member of include, but are not limited to: Amazon Associates, eBay Partner Network and AliExpress Affiliates.
As an Amazon Associate I earn from qualifying purchases.
Purchasing through these affiliate links will not cost you any more money, however the commission earned significantly helps fund the production of videos on my channel. - Věda a technologie
Buy the 1TB Sabrent Rocket NVMe 4.0 SSD on Amazon (Affiliate): geni.us/9AaY0Nq
Buy the Dopesplay DR138 Lapdock on AliExpress (Affiliate): geni.us/UH5itjY
Mate, don't worry about filming you build or put in your upgrades being boring. Some of us love that part and it's just pleasing seeing builds coming together. It's a form of zen really. So please, just leave it in. :)
I agree. I love home builds
I've always enjoyed I.T as a child, but I barely scratched the surface with what I knew. I dropped out of college where I was studying I.T too and worked in a different sector entirely. At 34 I've finally decided to pick it back up again and start learning, this channel is just amazing to watch, your knowledge is incredible!
Great video, Cameron. Really enjoyed it! Thanks, man 👊🏻
I find your channel really comfy. keep it up mate
Tanks for the demo and info, have a great day
That flash module to add management capability reminded me of those basic ~£10 network switches and the difference between their almost equally priced managed counterparts is just a flash chip
Thank you for the video. You put in the radar this type of second-hand server. I really liked the ability to add not only one but 2 NVME, and on top of that, a PCIe card.
Another option is the Lenovo Thinkstation. I picked up the P330, 2x NVMe and a 8x PCIe 3.0 (16x mechanically) all in a 1L case.
@seanhood980 Actually, I was looking at the Lenovo M920q, which has the PCIe 3.0. But I was missing a second NVME slot. Now, with the P330, yes, it could work. Thanks for sharing.
Those Lenovo machines were actually my initial plan for this project, my only concern was the lack of cooling for the PCIe slot which may be an issue for high power network cards so I decided to go with a machine with active expansion card cooling instead.
Always enjoy these videos :)
You might want to look at the /sys/class/hwmon interface, as it is quite likely that you could simple modify the firmware fan curves using that rather than having to be dependent on a userspace script continually running and constantly adjusting the fan pwms
I really enjoy these second hand finds. This and the Datto appliance I can spot in pride of place in your rack. I’d love an insight into the other machines lower down 👀
Thanks! As for the other machines, the 4U one with 3.5" drive bays was my NAS prior to the new one, made a video about it many years ago: czcams.com/video/9WINLuOBh3U/video.html. The 2U one at the bottom was previously used as an HTPC back when the rack was in the living room although it's had so many parts stolen over the years it's now just a case with an old AMD FX4300(?) CPU, AMD 760G motherboard and a 60gb or so SSD. Probably need to have a bit of a clear out to be honest.
Thanks for the video. I look forward to the software setup video you mentioned towards the end. Any chance of a link to those adjustable server rails?
lol the second you said why am i filming this, i instantly responded "for nerds like us who love watching it" LOL!! It's like Bob Ross is to some people. hehe
well done and subb'd! anytime I see a proxmox build I just love it.. hope to see more! keep it up! :)
I just ditched my HP DL360 and put my VMs on ProxMox running on a ThinkCentre M910. I was astonished at the improvement in performance!
you could easily exopand this to make a multi node cluster also and spinup up vms on your ws when you need even more power or compute with a gpu now and again with pass through - lots of options but qemu can work almost as well - you will want to add more ram but you have a good upgrade path - a neat and clean setup, good rack
I was just catching up on some of your videos that I had missed, and was happily surprised to see you running BookStack on your initial proxmox setup! Hope it works out well for you!
Thanks! It's definitely working really well, I need to put more content into it (I'm using it for documenting my network/home automation setup) but it looks really good so far, definitely much nicer than using a Wiki!
@@camerongray1515 That's awesome to hear, hope it continues to work well going forward!
I'm a Locksmith and I swear some of our suppliers send us more plastic than lock parts by weight. Its infuriating getting a few packs of pins, each in their own bag, inside another bag, inside a box with bubble wrap and closed up with plastic tape. I feel your pain with the overkill packaging
Nice vid thanks for sharing
I have the same Zalman external hard drive enclosure. Works great - never seen anyone else with one - lol
@camerongray1515 You can still run grafana, node red, etc outside of HA and add them to your HA UI so it pops up like it's running in HA. That way you maintain separation and have UI integration (have your cake and eat it too).
Ooh, that would be a good video. I must confess I still get a bit mixed up with Influx DB & Grafana within HA
Re the iKVM shipping, add static foam and replace the PCB with a single sheet of paper and that's how HP used to ship iLO licenses. Had half a pallet of them once took two hours to extract what could have been a kilobyte of text sent in an email.
I've installed Proxmox on 6 nodes using my Ventoy stick, so it should work just fine
That management chip reminds me of the Amazon packaging, order a pen and it comes on a pallet sort of thing haha
Whenever I have gotten some brand specific network card (HP, Dell, IBM/Lenovo, etc), it has always had some stupid firmware lock on it such that it only works in that vendor's systems. So these days I avoid them all like the plague.
And yes, 1U servers tends to be noisy, one reason my first rack server were a 2U one, though with its own set of downsides.
A video on Proxmox setup and your tips and tricks on using it would be great. I'd actually thought this was what this one was going to be about rather than hardware 😂 (not that the hardware bit wasn't fun).
The ridiculous packaging of the management controller might be theft prevention. It's a lot harder to slide this into your pocket, than some little SD card sized packaging. And I don't mean theft when it's out for delivery, but at the warehouse.
I've found setting up Home Assistant in Docker with host network mode works fine for detecting devices. I think this is the official recommndation.
With the noisy fans I would just swap them out for high pressure noctua fans. I did that even with a PSU (before being powered, voids warranty) but has been working solidly and quietly for 5+ years.
What is the external storage from which you installed Proxmox ? It doesn't look like usual external HDD
Nice!!
16GB RAM for VM's is a bit on the low end. But its easy to upgrade.
Yeah, I'm just sticking with 16GB for now because that's what it came with, but in the future I'll probably end up adding more when it's needed. The machine itself supports up to 128GB.
In the last couple of months I've bought 3 of these servers from eBay, and I'm pretty sure from the same seller given that they too were selling Decklinks.
That Xeon has integrated graphics. Might have been upgraded at some point. Most OEMs don’t combine an aspeed chip with a CPU with an iGPU.
I suspect based on the fact these machines were being sold alongside video capture cards, that the CPU with integrated graphics may have been chosen because it supports Intel's QuickSync hardware video encoding even if it wouldn't be being used for video output. System integrators offering these machines tend to offer the CPUs with iGPUs as an option or alternatively the original owner could have purchased the machine as a barebones and added the CPU, RAM and storage themselves.
25:00 Installing Proxmox 8.0.2 or older via Ventoy works no problem - seems the secure boot introduced in the 8.1 iso release broke something - just use the old version and upgrade or wait for a fix..
Hi they put small stuff in big boxes so it doesn’t get lost or jammed up in the postal machines
I've been looking into Proxmox VE to replace ESXi, but I'm a bit confused on how to handle updates. I see all the different repos, but the prod-ready ones are subscription locked. How does a hobbyst handle that?
You can just enable the standard "no-subscription" repo for both PVE and Ceph (so you don't get any annoying warnings) and you're good to go, for a homelab at least. The only difference as far as I know is that the paid repos, aside from getting official support, are usually more stable since the updates had a lot more testing time.
I use ventoy a lot both at home and work and havent had any issues with proxmox on it, have you tried making sure ventoy is up to date?
It's a relatively recent version - had to recreate the drive a couple of months ago when Proxmox wouldn't install so I ended up wiping the drive to write the ISO directly because I didn't have another drive with me. It starts booting but then sits saying that it's looking for an ISO on /dev/sda then just sits in a loop, wonder if it's something to do with the order that a given machine enumerates internal vs USB drives. Admittedly, I haven't spent really any time digging into the issue so it could be an easy fix.
Good video sir, to make it quiet you could use tome Fan LNA, units. ( Noctua 3 or 4 pin Low Nose Adapters ) thats what i do in the supermicro and asus servers.
you pur the LNR adapters between the assus chassis fans and the motherboard. @@wojtek-33
I'm pretty sure I tried some LNAs when I was initially figuring the fans out (this was a few months ago so my memory is fuzzy) but they were still too loud. The other consideration I had was using Noctua's NA-FC1 fan controller which can essentially "scale down" PWM controlled fans so the motherboard would still speed control the fans, but the fan controller would just shift all of the PWM values down slightly. Probably worth it if I needed to run an OS that didn't support fancontrol, however, for Proxmox, fancontrol works fine and is a lot more configurable than relying on hardware.
I liked the video, was godo!! @@camerongray1515
I put LNA adapters in my supermicro DUal node box and it was perfect ! @@wojtek-33
LNAs essentially work by just undervolting the fans so it really just comes down to the particular fans that you're using them with - Noctua fans will be fine but other brands can be hit or miss. Some will work fine, some may struggle and others may be fine but you could potentially run into issues as the fan ages with the low voltage not being enough to initially start a stopped fan.
looks like its missing one of the 2 screws that holds down the PCIe card bracket.... What I would do is move the single screw to the other hole to keep the card from pivoting up... Its using the riser to hold it down but the screw will help anchor it a bit more on the other hole
I don't think there is a screw missing - on the left hand side there is a screw hole and on the right hand side there is a locator pin that holds the bracket in place but isn't a screw. There are also the outer two holes however I think those are just where the two pieces of metal that form the plate are fixed together and aren't screw holes. Also bear in mind that once the top is installed, that will also serve to hold the card backplate in position.
@@camerongray1515 OK just seems like there was a screw missing on the opposite hole...
IIRC DRAMless NVME SSD's use system ram as a DRAM if I'm not mistaken. it's not terrible but not ideal either.
Under Linux even the dram-carrying ssds are cached by the block cache in Linux. RAM is still orders of magnitude faster than pcie
How much is your electricity bill?
One day I’ll watch a CZcamsr who buys something that isn’t some miraculously cheap, amazing deal that no one else has ever seen or likely to see. One day a CZcamsr will buy something and get shafted like the rest of us do.
I cant find these on Ebay in the USA and E11 any model type is thousands of dollars. Sad, a Dell 640 etc go for about 500 so much cheaper.
I think your host storage was overkill (based on the workloads you showed so far and you've demo'd in previous videos). Is there a reason you don't just mount your data over iSCSI or NFS?
1TB is definitely overkill for what I'm doing now, however the additional cost over smaller drives was minimal and I'd rather pay that now and not need to worry about storage rather than needing to take care with how much storage I'm using and potentially need to upgrade in the future. Running the storage over the network is always an option, but for this situation it would just add complexity and points of failure to save a very small amount of money on local SSDs. I don't want a situation where failure of my NAS (or needing to take it down for maintenance) would also take out my VM host which hosts services that are critical to my home automation. There's a reason that businesses that use network based VM storage spend a fortune on high end SANs where every single component in the system is redundant.
The whole Server is Overkill for the stuff He showed. The 10Gbe nic is totally unnecessary. The 1TB redundant storage is probably the Thing that makes most sense I that server :D
And now He is able to explore more Services and stuff. Having the storage in the Server and maybe doing backups to His Nas is actually a good Thing.
I've never seen on of these before
Can't find this on Ebay in US is there something similar in the US?
With eBay it's just going to be down to luck as to what people are selling at any given time. Your best bet is to keep searches broad rather than looking for specific models of server.
I've done about 30 Proxmox installs and all successful from UEFI and BIOS Ventoy USB sticks and onto both UEFI and BIOS motherboards. Maybe try to update your Ventoy drive.
I've just updated my hardware and used Ventoy to install PVE and PBS. Maybe worth a clean install/upgrade of the Ventoy drive.
The ventoy drive is pretty new (previously wiped it after I last had issues with Proxmox). It may just be an issue with certain machines or particular Proxmox versions, I admittedly haven't spent much time trying to fix the issue and just went straight to using the Zalman ODD emulator.
Does that CPU give you enough cores/threads to run multiple VMs?
Depending on your actual use case, most people find they run out of RAM before processing capability since processing time is a shared resource.
It entirely depends on the workload that's being run but for my use case it's more than enough - it's generally sitting between 1-2% CPU utilisation. CPU capacity isn't "roped off" for specific VMs in the same way that memory usually is. CPU capacity is shared between multiple VMs similarly how CPU capacity is shared across multiple processes running on a regular, non-virtualised machine.
I get the difficulties trying to build in a 1U, but something like a 10900T at 35W could probably be passively cooled and perform much better than this Xeon whilst sipping power...interesting video though pal!
That's definitely an option, but would have cost a fair bit more and for passive cooling, you'd either need a large case with large heatsinks (not going to fit in 1U) or a case with high enough airflow that you'd end up needing reasonably loud fans anyway if I had any hope of fitting it into a 1U case. I'm not too bothered about absolute silence - just something that isn't actually *loud*
Grate video but it was hard for me to keep up with the fast speaking haha. I had to scrub through your video a few times. My brain wasn't able to process the information you were giving us about the server at which the speed you were speaking. if you can slow it down a bit other then that amazing job.
What chassis is the top 2 server it?
It's in one of these www.servercase.co.uk/shop/server-cases/rackmount/2u-chassis/2u-short-atx-chassis---low-profile-pci-card-support-sc-23400-2/ with a pair of 5.25" to 6x 2.5" hot swap bays.
ASUS desperately trying to make the management controller module look more valuable than it is by using this absurd packaging should be illegal
They are probably just using the same packaging they would use for a pci card, as it is simpler for them to only have to order/keep track of a single box that they can use for all server add-in-cards.
nice)))))))))))
You should have looked at a Dell Poweredge R210 II. Way better machine and its about 1/3 the price.
Cheaper sure but I'm not sure how a machine from around 2013 with a Sandy/Ivy Bridge Xeon E3 is in any way better than this machine from 2019-2021 with a Coffee Lake Xeon E22xx CPU, DDR4 memory and NVMe support.
I would stick another 2 sticks of DDR4 RAM if that is what it takes as it might crash if you don't as my machine kept crashing till I installed 4x16GB of DDR3 RAM.
This machine uses DDR4 RAM, and the number of sticks is not related to stability, not sure what the issue with your machine is but there is absolutely nothing wrong with using 2 sticks of RAM or having unpopulated slots.
Subtitles... subtitles... Good god, Trainspotting is flashing before my eyes.
playback .75 and now i can understand
Too expensive
Feel free to suggest a cheaper equivalent option, but to me £350 for a perfect condition ~3 year old machine with only around 60 hours of use and being a model that was still available new for £1200+ up until a couple of months ago, isn't a terrible deal!
@@camerongray1515 oh just that you paid too much for it. They go for less. You can find them for 1/2 the price if you know where to look. This is for others looking for this specific equipment.
Then where should I (or others) be looking and how much should I have paid? At the time this was by far the cheapest option on eBay for this spec/CPU generation. I'm in no doubt that I could probably get something cheaper if I properly spent ages searching and hunted around outside of eBay, but there's a point where I just need to be able to buy something rather than spend my life hunting for the rare super cheap deal.
@@camerongray1515sounded like a great deal you go to me, esp with the relatively low power on time! 👍
@@camerongray1515 which country? That could be the difference