Homelab upgrade: New Raspberry Pi Cluster rackmount
Vložit
- čas přidán 27. 06. 2024
- It's time to upgrade to my rackmount Pi cluster!
You can buy the UCTRONICS Pi Rack Pro on Amazon: amzn.to/3BDZD5Y
Other products mentioned in the video:
- MyElectronics Pi Rack Mount: www.myelectronics.nl/us/raspb...
- Monoprice Cat6A SlimRun patch cables: amzn.to/3LCbhCX
- StarTech.com 25U open frame rack: amzn.to/3r6gqK1
- QNAP 20-port 2.5G/10G PoE++ switch: amzn.to/3dz4DRz
Support me on Patreon: / geerlingguy
Sponsor me on GitHub: github.com/sponsors/geerlingguy
Merch: redshirtjeff.com
2nd Channel: / geerlingengineering
Here's what I'm running on all the Pis:
- Internet Pi (Pi-Hole, DNS, Internet monitoring): github.com/geerlingguy/intern...
- Raspberry Pi Dramble (Drupal Pi): github.com/geerlingguy/drupal-pi
- Backup Pi: github.com/geerlingguy/my-bac...
- PiVPN: pivpn.io
#Homelab #RaspberryPi
Contents:
00:00 - Time for an upgrade
00:52 - Ansible, Kubernetes, Pi-Hole, and PoE
02:55 - Out with the old
05:05 - In with the new
08:00 - DNS is important
09:50 - Racked up, first boot
10:45 - Three to go
12:16 - Do they still work?
12:58 - Temperatures and enabling features
13:57 - Is it worth $290? - Věda a technologie
To those of you who don't use CC, you're missing out! Thanks Jeff for going the extra mile and the laughs
im cc
I would, but I don't have any friends to carbon copy. But, I've been using CC a lot with my MIDI. 😜
What is CC?
@@jakecobelton9876 Closed captions
CC is closed captions.
It's what most people actually mean when they say subtitles.
Respect to the creators who put in proper subtitles.
It’s really really good to see you looking so well Jeff. It’s wonderful 🥰❤️😁 Stay well and keep up the amazing videos sir.
I always learn something by watching this CZcams channel. I'm just a beginner with Rpi, but this show showed me where to use rpi-clone - a great little utility which I looked up, and now I know how to use. Thanks, Jeff!
rpi-clone is so nice for the case where you just want to move to a new microSD card, switch to SSD, or switch back from SSD to microSD.
@@JeffGeerling Ah the LTT Screwdriver
That’s makes one of us 🫤
I think this would be really great for university labs to experiment with clusters. They are high enough quality to hold up for years of use.
It might take years to get enough Pi's to put in there.
Not really, much easier and better to keep a bit of your previous cluster for that. Not being x86 is a big issue as lots of software does not work. How do I know this, well my day job is running an HPC system, for a university. Guess you guessed correctly we retained some of our old cluster for this purpose.
@@jonathanbuzzard6648 interesting info, thanks!
Why not just create N VMs? You have a virtual cluster then.
massive waste of money.
Hope you're doing well Jeff. Great to see more and more Pi-related stuff for professional use coming onto the market .
This is exactly the setup I'm working towards as well. I have 4 Pis in a Kubernetes cluster with SSDs but I'm running them all with the power adapters and in a little acrylic Pi rack. This video hit at the right time!
I love those little stanley pen screwdrivers. Just perfect for almost all your electronic needs, it's not as fancy as the ltt, but it's definitely one of the most functional and used additions to my laptop bag.
I had no idea the raw hex socket fitted the motherboard standoffs! Mind blown!!!
Love the touch of adding CC to the video. So often I have to use the auto generated CC and it's always hit or miss...
I enjoy how considerate you are of your audience by explaining levels of detail all the way to sponsors. Thank you for putting in that extra effort.
This rack mount is SO FREAKING COOL! It solves all the issues I would have with every other Pi rackmount I've seen.
Stop making everything so interesting, damn it!
Finally! Some more regular Raspberry Pi model videos! As much as I also like the compute module videos, I have yet to get one, and all I have currently are regular Pi models to use.
I really enjoy watching you build clusters of pi because it feels like you're making a mini data center. I also want to build one but I don't have usecase for it 😅
Wow. That is really awesome! It also seems like a lot of fun to have something like this in your cluster. Lots of tinkering and all the technology to learn from. I have quite some Pi's lying around, might consider getting an enclosure like that in the future.
Glad to see you back! Hope you are feeling better. Love this project but like you mentioned, the blade project looks even cooler (pun kind of intended)
Very cool rack device for the Pi setups! I like this alot!
Thanks for this Jeff. Nicely done!
Happy to see your doing better health wise Jeff, stay frosty and thanks for the continued quality content!
i love how honest you are abput products sent to you i hope more people were like you
Great to see you're back, hope you're feeling well.
Ah good thing to see you up and running again Jeff. Good news on the blades too cool.
Looks like you are doing well! So very glad to see it!
I admire you're strength Jeff 💪 invisible illnesses are hard to deal with. You're a source of inspiration 😎
I can’t wait to see the PXE boot guide when you release the video!
It's been a long time coming. Still have some work to do, it's complicated enough that to uncomplicate it for a video takes a lot of extra work!
Great content! As soon as you showed the enclosure, I had the same thought about ventilation. Keep having fun
Hey Jeff glad to see you up and around...hope you get better every day!!!
Another benefit of the proper enclosure is not having to worry about 3d printed plastic being next to electronics. Most filaments burn like napalm
I love the smell of napalm
It Smells like victory.
It really depends on the filament, but generally they are not as flammable as you think. czcams.com/video/a7l0Aaysy_8/video.html
Well yeah, don't print a 1U enclosure out of PLA. ASA has a heat deflection temperature of like 85-105C. If the air inside your server is above 80C, you've got much larger problems.
Melting / deflecting is one problem but what I meant is that I don't want an exploding capacitor or a shorted component heating up a PCB trace to ignite the plastic. Industrial electronic enclosures are made from fire retar dant plastic for that reason
I wanted to post that the CC is on point! Thank you so much for that! The extra mile really shows up here.
I pulled the trigger and bought the rack mount. Can’t wait to get it setup!
To be honest: I stumbled around your vids and NOW it is happen - with this project you gain another follower. So pls keep the good work up 👍
The only down side to all this projects requiring more and more raspberry Pies is, that the Raspberry Pi Foundation isn't able to produce them as cheap and as quickly as the market demands them :/
I always love your content Jeff! Ansible and most of kubernetes may be above my head. (I am running Truenas scale on my home server but I'm just learning) But I love learning with your vids and it strokes my inner nerd every time you drop new content. Love the channel and keep it up brotha! And so glad to see you are feeling a bit better as well!
Thanks for marking it as sponsored even though they didn't pay you. If only other youtubers realized that the free equipment, early access, and other benefits are essentially payments.
CZcams's own description of that 'paid sponsorship' badge says as much. Sadly, the FCC won't ever be able to enforce the rules for the zillions of smaller content creators.
I try to both mark it with the 'sponsorship' badge (even if no extra payment) _and_ make it clear my relationship with the company in the video, because honesty/transparency is the only way for viewers to actually make a judgement about the content itself.
I also publish my own guidelines here: github.com/geerlingguy/youtube
Love the transparency, and integrity you display - most CZcamsrs have something to live up to there!
Love the videos! Here’s an idea: setup a bunch of micro sd cards in raid and write a bunch to it until something fails. I bet they last longer than we’d think. Would also be interesting to see performance over time and how hot they get and such.
Every time I see you mention ansible. I'm reminded that is yet another thing I need to learn. This time maybe I"ll take some time and take a look. Love the video, I use a 3D printed pi-rack today as well. I do like this and other options like it a bit better especially the idea of hot swapping them easily. Take care, and see you in the next video!
Thanks, Jeff. Great video and I will check out the UC case.
Thank you for sharing your amazing video, very interesting product, I am very happy to learn about my options though your channel. And love to see you back and well-being. God bless you and your family.
Great to see you looking well Jeff! I am so tempted to pull the trigger and buy one of these. I’m itching for a new project.
Pretty cool. A quick way to improve ventilation may be to drill holes and mount fans in the back of the enclosure for the pi's. Provided theirs enough space
Wow! it's Amazing I did it well ! Perfect work !
Yes, looking forward to the NetBoot episode. 🎉🎉
It looks amazing!! I've been working on a DIY version of those, but much more simple, just with the RPI and an OLED 1.3" screen with some information.
Happy to see your getting better!
Thank you for the video, your content is always top of the line and can lear something from it! You inspire me to get my hands ditry with raspberry jam ;) :D
10:35 Those SUPER SHORT Ethernet cables are so satisfying!
Thank you for pointing out that the LTT screwdriver needs a bit that can work with board standoffs.
The exposed pins on the USB-USB adapter makes me extremely uncomfortable. I want to just reach out and put a piece of electrical tape over it.
Maybe it could be a challenge in the coming months. How many times can I service the rack without shorting a connection on the exposed plugs :D
Awesome stuff Jeff! Tinkering more with this stuff is on my list for whenever we manage to afford a house (the tiny apartment can no way hold a half rack, though I do a small stack like you started with...hmm)
That's a really nice case and a fair price for what it is. I hope they read the comments here as there are some good improvement suggestions. Great Vid as always, and happy to see that you are still Jeff! ;o)
Am reading, and these are really good suggestions.
Great looking product. My only gripe is the USB jumper being left as the green pcb, which against the black enclosure just detracts from the visuals. Will be keeping an eye on this product for future revisions for my own lab
Yeah that seams like a oversight on the part of the lower PCB designer.. There are pads on the PI that give you USB so they could have just added some more of those pins to interface in that way instead of that jumper. It just looks janky and unprofessional in my opinion.
This is so close to perfectly designed, it just needs a little shove to perfection.
The ventilation is a problem yeah, with all 4 under any real load that little box will get hot. BUT a bigger problem in my opinion is the exposed pins on the back of the USB bridge PCB, those have exposed 5v right next to a load of sensitive IO and can easily be shorted together by bumping them with anything conductive, that means any metal, certain kinds of cloth, dust, or even some errant forehead sweat, and those are all known dangers with an active rack, and it only takes 1 good short to kill the USB 3 controller on a Pi4.
I'm happy to see you posting once again
I also just realized you have the same PoE switch I picked up recently
If you're comfortable with typically Cisco-like CLI, this switch can offer that over the limited config options QNAP offers out of the box. Great switch if you're running bonds, VLANs, LLAGs, etc. and want 2.5G WITH PoE+/++.
Sweet tutorial fam !
Another excellent video, great to see you doing stuff like that :)
Thanks jeff, great video!
Thanks for sending over the rack unit!
I'm waiting impatiently for the PXE pi poject!!!! It’s one of that ideas I dreamed of for years, but never attended to study enough to realized to (I have prioritized other projects).
I enjoyed this new video. I'm running two of these (5-bay) with the 12-bay 3u also. Their SSD mounting adapter is kinda pricy for that 12-bay (12 x $20). But you don't have to boot off of SDCards. You can boot from (cheap?) 120/240GB SSD. Which somehow I had 20 new of for some weird reason. I love your network Internet-Pi scripting, BTW. I removed the Pi-Hole and such and modified it a little to be a small NMS. I like being notified when my network goes down or slows down. :) Keep up the great work, Jeff!
Thanks Jeff. I think I would also like to get a DNS running at my local and host my own website. That would be so cool. I like your setup a lot! Thanks for the video and hope you are feeling better and all is OK for now! :)
Simple and beautiful!
That montage music is awesome
Jeff, you're literally one of the best information channels right now. I appreciate your work and I learned a lot about Ansible because of you.
Thank you, it works perfect!
No wonder I can`t buy a Pi, Jeff has 40% of the world's supply! Good stuff, Jeff.
The OLEDs look super useful!
Epic stuff!
Always The Best 🎉
I discovered your channel due to linus screwdriver review. wonderful
Loved the video
This is neat, really like the power button and screen, not to mention access to almost all ports and SD card on the front, but I rather use up 2Us of rack space for vertical Pis than 1U of just four horizontal. Feel like you can get more density with that than this, even with all the extra stuff thrown in
I’ve been consuming all these Pi videos to prepare for when they ever go back in stock
Good job!
Yo Jeff!!! You, your father and Explaining Computers are the only things left on CZcams that does't SUCK!!! LOL Thanks for that! Hope you are feeling better!
Cheers!
Judson & Buddy!
THE Golden Hound Dog of OHIO!!!
Really pleased to see you're doing more with what you enjoy, Jeff. Trust you're doing well?
Better than last month!
Cool.
Built my own little cluster for five PI's and a 5VDC PSU. It is 3U, all the connectors are on the rear though, much cleaner front that way. Been running a Kafka cluster for a couple of years now, ~4 I think(using ssd's).
heyyyyy, everytime i see Jeff posting a new Raspberry vid ik im gona enjoy my coffee ! keep it up !
Loved this video. At the moment I run 8 pi4 mixture of 2gb and 4gb with mixture of Poe and Poe+ hats 1 x asterisk box, 2 x pi hole boxes. 1 homebridge box. 1 home assistant box. 1 x Bonjour gateway box and 2 x hot swap boxes. They all run under Ubuntu 20.04 except the home assistant box. Currently the all back up to a local Synology box then replicate backup to the cloud. I have been looking for an affordable case this looks great but probably a bit too expensive for me just now. I am looking at migrating the Ubuntu boxes to pxe boot from the Synology this will help me sleep better at night, I have piloted one box successfully and am looking to start moving the hosts over this next weekend.
Thank you, over the years you have been a real inspiration to me and my ip project. When I started with a pi 2 and asterisk test bench.
8:07 - DNS redundancy is highly desirable. As an option, run PiHole on another raspberry and set up Gravity Sync between them. It made my life very easy.
I have one DNS spinning on a virtualization environment, and the second on a separate Raspberry pi.
That's likely what I'll do, my plan is to build a new router "someday" (not sure when that day will be), and it will run routing/DHCP and DNS as a 2nd Pi-Hole.
Gravity sync? Cool. Looking up. Right now my piholes are not synchronized automatically.
Thanks for the tip on Gravity Sync ...
I looked at Gravity Sync, then Adguard Home with Adguard Home-Say c, and ultimately moved to an Adguard environment as the syncing was a lot better, and I've been very happy with the result.
@@SchoolforHackers На здоровье)
very cool! Recently added similar Pi rack but this is much fancier. Honestly For now I prefer my version -- with better ventilation and cheaper upfront price
Good to see you up and about. You touched on SD cards: one thing I learned from dashcams is that you need to be using High Endurance SD cards.
funky beats bro!!!
It does make me feel better that Jeff doesn't have DNS redundancy either. Thanks Jeff!
these captions are the bomb, yo
thank you man,you are a legend
The irony... I just finished designing a new Pi 4 mount for a rackmount setup (finalizing the Pi mount itself, then onto the rack) with an OLED display yesterday. I'll have to send you one when I get them finished.
I tried and it is installed thank u very much anda
for a home lab setup i recommend rack studs they are awesome
I love it. The spirit of a homeland is excessive overengineeing so this serves the purpose perfectly
I would like to see ventilation though.. not sure how I’d power it
That’s a nice setup. I was thinking about buying that 1u mount but the ventilation made me buy the open air one without the screens
I dont know anything about raspberry pies 😂😂😂 and still Watch the whole video. Amazing project man!
Lovely to see a 'normal' video.
It's just a shame that raspberry pi's are impossible to buy now and I would do this project in a flash. Thanks Jeff: awesome setup.
Put the extra cable in the Neat Patch for 'asthetics'. The Neat Patch is the equivalent of tossing something in the closet and closing the door so that Mom and Dad can't see it. 😁 We use them at work, and I have a couple at home too 😆
lol I just noticed the Storinator on your Raspberry Pi rack... my guy doesn't mess around!
Great video!! Big fan. I recommend trying something called a Raspikey - they fit in the sd card slot but uses EMMC - a lot more reliable than a SD card,
we have replaced all SD cards in our pi with these Raspi keys at work and haven’t had trouble since.
Speaking of those monoprice ultra thin patch cat6 cables, they are good for up to 30w. I run Panasonic PTZ cameras on them all the time and they are POE+ and draw about 28 watts.
Thanks. I was all ready to order until you got to the lack of ventilation. I will wait for next revision.
You look like you're doing better Jeff; I hope you are, and from someone with digestive issues, I hope you're also *feeling* better. :)
On a technical note, it would be nice if a future revision of the standard Pi included pin headers for USB so that various add-on boards could interface with the USB bus internally versus having to have male-to-male dongles on the outside.
I'm hopeful there will be some additional interface to get more IO, more easily, on the next model B boards. They are so great for so many things, but they always look a bit odd when used in any non-hobby scenario.
@@JeffGeerling I think there should be no such additions on the next model B, but rather a model C for such things, so that the price won't be such a constraint. Pi model B is meant to be as it is now while maintaining a price low enough to tinkerers, education, etc. But i think us enthusiasts (i am also an educators, so i understand the price constraint well) wouldn't mind paying more to have some extra stuff. Also, model C could hapily break the form factor. Like a bit larger, with all the IO on the same side, a sata interface and/or NVME, and why not some PCIE connectivity (even trough NVME).
I mean, i like the pi form factor, but it is quite limiting in some applications. We have 0 and CM4 for compact, A is dead for now, B for general use while remaining cheap, and C could be more power user oriented.
But perhaps the model C's role is already fullfilled by the CM4 + the right carrier board. Perhaps the pi foundation should just release more carrier boards?
I hope the current carrier board form factor is not what the one for the CM5 MUST be, that they are not bound by it!
@@AudreyRobinel True... maybe model B for hobby, model C for power users/desktop, and CM for embedded/industrial.
I agree so many of those male to male U's put out a ton of RFI also. My biggest complaint with the Pi4B though has been the 2 micro HDMI ports. I don't know anyone that uses dual display with a Pi, most of the Pi's I know about run headless. The ones I know of and have hooked to displays all the junky adapters cause more trouble than a second HDMI could possibly be worth.
Honestly with the prices right now and the annoyance of the form factor and micro HDMI's unless a Pi is absolutely necessary I use and recommend used 1L office PCs. Personally partial to the Lenovo M93p right now they go for about the same as a Pi4B by the time you get all the kit for it, More horse power, More ports, takes real SATA drives, DP standard which has good adapters to HDMI but if you look you can find em with a secondary HDMI port already optioned. Only drawback are they are a bit bigger and idle consumption is a bit more but you get a more powerful machine for it. However with Proxmox on one with an i5 it could take the place of several Pi's making the power use a wash so long as x86 is fine for what you're doing.
Can't wait for the case mod video. For my current setup I have currently removed the back cover. Otherwise the temps just went too high.
Spent my Saturday swapping from a 18u to 24u rack and yours makes me now want to fix the rats nest of cables I have....
Beside the already mentioned temperature and ventilation problems, i think they should improve the IO shield of the PI (e.g. the huge gap above the ethernet jack) and provide these USB to USB adapters with black PCBs before i consider buying it...
Jeff, I'd be interested in learning more about your career path. I'm in L2 support now, with a deep interest/focus in software development, and you seem to have a pretty holistic view of the modern tech landscape. I'm interested to hear more about how you got to where you are.
Damn I miss being able to kneel on the floor and work on my equipment. Miss being young. Really enjoy your channel and the stuff you cover.
Heh, don't worry my legs were in a bit of pain for the past two days :P