What's ACTUALLY running in my Homelab?
Vložit
- čas přidán 12. 07. 2024
- Head to www.odoo.com/r/Sc6 to get a 15 day free trial or to get your first app for free!
► Want to support the channel and unlock some perks in the process?
Become a RAID member on Patreon or CZcams!
🔓 Patreon: / hardwarehaven
🔓 CZcams: / @hardwarehaven
► @Jims-Garage Gluetun Stack Video:
• Torrent Safely Over a ...
► Prometheus SNMP Exporter: github.com/prometheus/snmp_ex...
► Prometheus Graphite Exporter: github.com/prometheus/graphit...
► TrueNAS Graphite Mapping: github.com/Supporterino/truen...
🎥 Curious About the equipment I use to make my videos?
Click Here ► hardwarehaven.media/gear
---------------------------------------------------
Music (in order):
"CRENSHAW VIBES" - GARRISON ( / garrison-brown )
"Hardware Haven Theme" -Me ( • Hardware Haven Theme M... )
---------------------------------------------------
Timestamps:
0:00 I've never really talked about my homelab
0:30 Sponsor - Odoo
1:33 Hardware Overview
4:53 TrueNAS Servers
6:00 PFSense VM In Proxmox
7:01 Proxmox Server and TinyPilot KVM
7:23 CasaOS
7:33 n8n
9:36 Uptime Kuma and MySpeed
10:30 More CasaOS Containers
11:19 Tailscale LXC
11:33 Jellyfin LXC
12:08 Portainer (Home Assistant, Immich, Gluetun Stack)
13:56 Prometheus and Grafana
17:24 Synology NAS
17:35: Future Plans - Věda a technologie
"...services I haven't moved over..." "...I will eventually get rid of that..." There is no solution more permanent than a temporary one.
**cough cough** my raspberry pi 4 nas...
Thanks for the mention, really appreciate it. Great setup and video btw, I'm still to play with CasaOS. This has spurred me on!
Absolutely, it was a great video!
There is sooo much CasaOS is capable of...but currently it's in it's infancy but it's growing and maturing all the time...hopefully it can grow into a full bore setup similar to the gui/server combo like in TrueNAS or UnRaid, just a bunch of scripting on top of an underlying powerful server distro...
@@haydenc2742 I'm keen to see how it compares to something like kasm
Frigate is your answer for webcams. Great home assistant integration.
Not entirely. It's super cool but lacking features, hence why i didn't make the switch from Synology.
@@HardwareHaven hmm wonder what features are you missing?
@@HardwareHaven have you checked out 0.14 yet? The new interface is really nice and brings it a lot closer to something like scrypted nvr
Was going to say the same. I use Frigate (with home assistant) for my home security and love it. Using a google coral for object detection.
I use frigate, but I've found it's missing a lot of things that something like BlueIris has. Talking with the Frigate guys, they are overhauling several things this next update, so I'm excited to see how it turns out.
Completely agree with victualing pf-sense and any other thins in this mater.
- Why change it if all still works just fine
- If i want to try something new, just spin new VM
This is a beauty of home-lab / self-hosting. You can try so many things without messing up main services.
Plus you can snapshot the VM before making a change, and revert if it breaks something.
Thumbs up for having Bluey on your Jellyfin. haha
Yo peter!
Yes, that is the backup for when the internet goes down and we lose disney+ haha. Gotta keep our toddler sane.
Hardware Haven is running magic in his homelab. That's how the videos are so good.
Nah...his homelab is simple and hodgepodge...just like the bulk of other everyday joe "homelabbers" running on self built hardware...not these donated mega boxes that some other channels try to play off as budget or hand me down hardware....
When you get everything moved over from the old TrueNAS server to the new one, you should setup the old server to be a PBS server to backup your Proxmox VMs and CTs. I have been running that for over a year and have 4x 800GB Intel SSDs in RAID10 and it is plenty storage for me. I also have all of my servers on 10G SFP+ connections on my network to help speed up backups and restores. Also, Replication is your friend with moving stuff over from 1 TrueNAS instance to another!
15m26s I was very concerned about your network closet temp until I noticed it was in F. :D
Hahahaha
same 😆 like "solid over 75 degree? holy shit", but well, it's not celsius. would make more sense to keep everything in the same unit, tho
Thanks for the inside peek at your setup. I don't have anything half that elaborate or interesting 😅. Thanks for sharing!
Thanks for sharing you lab setup! Super relatable and reassuring that I’m not alone postponing all those little tasks. Its great that you aren’t sugar coating anything, because that’s how it is for a lot of us. We need to enjoy what we have, and stay motivated to improve our projects one step at a time.
Thank you for the video. You got me some ideas that I should include for me setting up my homelab soon.
Very cool look at the home lab. Thanks for the vid. 👍
Thanks for watching!
_“Nothing is more permanent than a temporary solution.” -Russian proverb_
You just gave me so many ideas for homelab services thank you
"Messy, clunky software. This is the last thing a business needs". Obviously never worked in an SME. Lots of software is in the catagory of "Dont touch it. It was written three decades ago. We dont know how it works, and needs specific versions of this ancient OS". All held together with "workarounds" and tape, that never get a redo to make them production ready.
I work in a giant datacenter that focuses mainly on networking and high performance computing and I confirm that this is indeed very true 😂
Great video. Thanks for sharing.
I tested Frigate, Shinobi, Zoneminder and others. Ended up with Blue Iris. This software is just amazing for a NVR.
Another containers that I run: Remotely, Plex (I prefer Plex over Jellyfin), Plex Media Manager, Tautulli, TDARR, Overseer, Syncthing, NPM (Migrating to Traefik), Authentik, Homer (migrating to Homarr), Czkawka, NextCloud, EmulatorJS (for the kids), Vaultwarden, Loki, ZABBIX, Immich and Photoprism (Haven't decided yet which one to keep), Mealie and Netdata.
And finally, I've been testing TrueNAS scale, UnRAID and OpenMediaVault for almost a year. But after all that time messing around with all 3, I've choosed UnRAID. It's an All-In-One solution that have it all. And it's very easy to use and maintain.
@Jims-Garage is awasome too!!
Thanks, always good info. -Dino
The only service I run right now is Mealie. Has helped my family enjoy interesting dishes a little more often.
I want to run paperless-ngx next. Right now it's a higher priority to get a backup system in place.
Thank You very much i was waiting for this video way too long after viewing youtube videos of some other hoelaber youtubers.
Another crafty user! I've been running crafty for several years - love (most of) How it works
Can you make low budget secured cloud storage with alternative for google disk, google photos (maybe Photoprism)? Having jellyfin would be great too... (all secured and accessible from anywhere on almost anything)
Why not run a reverse proxy manager with your own domain for your local services? It’s pretty simple, just point DNS Overrides in like Unbound DNS to the reverse proxy. Reverse proxy should have a cert from your domain provider. If you wanna keep everything local and not expose any ports, DNS Validation is great :)
I've been struggling with getting TrueNas Scale into Grafana, so these pointers are helpful. It may be too narrow or tight of a focus for you, but I'd love to see a step-by-step of getting TN analytics from start to finish.
The guide on TrueNAS-Graphite Exporter I linked was super helpful. I might make a video on it at some point! I wouldn't mind doing some shorter, more focused tutorials.
@@HardwareHaven I finally got it working - thanks for all the pointers. I hadn't fully integrated the mapping and, of course, that made all the diff.
@@KeithWeston AWESOME! Glad to hear it
Can you share some info about the rack at 3:00? And generally, I wonder about cheap racks (
Maybe this one ?
StarTech.com 2-Post 8U Desktop Server Rack
It was sort of a pain, but I already had it in storage and it fit, haha. For dusting, I have plans to just shut everything down once every few months, pull everything out, and clean it. I keep everything labeled fairly well and have no real need for 24/7 uptime.
Up to TWO printers, eh? When you are finally overcome with filament, you will have to start that 3D printing channel... just to clear out your inventory of course :)
Video idea : how have you made it easier for your family to manage (or dispose of) your homelab in the event that something happens to you?
Thanks for the homelab tour 👍
As an actual user of Blue Iris i can say it's a very good software, it does not cost much compared to other solutions, it have a very good support and i have never had a problem... i'm using it on a mini pc with an intel N97 and 8gb of ram and it goes flowlessly recording 9 full hd cameras, just make sure you are using substreams for live view so the cpu usage stays low.
Thanks for the tips!
This is good info, Thanks!
Thank you.
You're welcome.
1:41 I like both your audio and video just fine.
18:51 Not a lot?! :O You showed us so much!
I run Blue Iris here at the lab. I tried several programs before I settled for it. In my opinion it is well worth the cost. It is easy enough to navigate that my wife can use it to view the 4 "light bulb" cams attached to it.
Your Proxmox setup is amazingly similar to mine, down to the virtualized PFSense AND the version of Proxmox!! 😁. Makes me feel less guilty for not having updated LOL!
Love to see your thought on the 3d printed nas 6 bay
I've setup frigate on home assistant, with a coral m.2 best self hosted CCTV software I have used if you have a reolink doorbell don't update the firmware it prevents the mic function working in home assistant at the moment.
Don't count that Mac Mini out just yet. Those machines are absolutely epic with running Linux or *BSD. Since 2006 I have been running Mac Mini as "TV-PC's". Switched to a 2012 when they came out. Twelve years later it still runs like a charm (running Debian). And another 2012 is my testing machine. It has been tried with a ton of Linux distro's and all of the BSD's.
Hey quick question, did casa os launched the user profile feature, so other people can use casa os but not edit it
Nice setup, from trash to lan till your own home lab,
Really appreciate your content. An angel from hardware Haven
Not sure... I mostly just have it there for really quick containers and for testing
My Pfsense Box is also virtualised. Tried to run it bare metal, but having some "unsupported" broadcom nics; running it through a linux bridge actually makes it stable.
If you haven't heard of scrutiny before, its a really cool application/service for monitoring HDD and SSD S.M.A.R.T data.
Thanks!
Thank you!
Finally a homelab I can relate to 😃
Awesome video. I would highly recommend Frigate over Blue Iris. I used Blue Iris for a long time and Frigate is a breath of fresh air and runs in Docker which is great. Their new v14 is also coming out soon. I’m running the Beta and the refreshed UI is great.
Hehe, anyone criticizing running pfSense as a VM honestly doesn't know what they are talking about. pfSense as a VM is VERY convenient. Aside from getting a simple snapshot any time you want, you can spool up the same VM on another machine in a minute and have your network back up and running in case of main machine failure or maintenance. Can even setup failover but I haven't done that.
What about security? If there is a vulnerability on proxmox?
@@okanerdem Certainly always a possibility, but how realistic is it? To be frank, if you're that paranoid then pfSense itself probably isn't for you.
Having recently jumped through this rabbit hole with my TP-Link switch with Noctua fans, are you sure the PoE isn't working?
I thought an orange fan light was fine (I don't use Omada) but it turns out that PoE power was getting temporarily cut every so often by the fan sensor triggering a fault. This interruption was enough to trip my Unifi APs which is what ultimately led me to figuring this out. There are a few guides out there to properly ground the noctua fans and turn that light green -- after doing so my APs have been rock solid.
I was able to confirm it with a multimeter. To be fair, it was a unit that my work was tossing. I imagine POE not working was the reason lol
I run CasaOS on a mini pc with MakeMKV and JellyFin for a simi portable disc ripper with a USB DVD drive (gonna upgrade to blueray some time soon)
@sagandavis91 this mini pc ripping machine is a great idea! I'm curious which mini pc you went with?
keep it up, i like your content!!!
you can say nathan for n8n but n-eight-n works too ^^
Great video again! I appreciate you sharing your current setup. Have you thought about keeping the Synology NAS and giving it to your parents instead of the current TrueNAS server they currently have? It should be easier to manage for the other person and most likely cheaper to run as it is a lower powered device then the TrueNAS server currently running at your parents.
the ARR stack, seems like it would make more sense to setup a vlan with pfsense and connect to your vpn with openvpn module in pfsense and go that route? thats what I do, as an added benefit you can assign a SSID to that vlan for your wireless.
Maybe, but it works flawlessly at the moment
Connect to Tor and then a free VPN, then no subscription fee and no payment details to blow your anonymity. (The only reason VPN is needed is as a UDP over TCP tunnel, Tor doesn't forward UDP, set the VPN to use TCP.) Certainly not going to be the fastest but if you just want to download something every now and then, it works well enough.
I Love Immich. Ive switched off completely from my google photos so I would love for you to share your experiance with using Immich
Would also love to see an Immich setup! Google photos worked great for my wife and I to be able to easily see each others pics of the kids and such without constantly sharing or texting pictures back and forth (we just logged into the same shared google account on our phones and let it do the photo back up). Only problem was that I ran out of cloud storage. I don’t wanna pay for more when I’ve got hard drives, sitting unused in my Home server.
Would love to see you set it up, move pictures off the phones and setup a library that can be viewed by my whole household.
POV: I was just making a script for my computer channel about my homeserver🤭
hey! you dutch by any chance?
@@brandieboy maybe
@@Coentjeeee duuus dat is een ja?
@@Coentjeeee ik heb mn Antwoord Al.
whooooohooooo!!! Ben niet de enige nederlander waarvan ik weet!!!!
This convo made me happy.
We're in the stages of building our future house, I want to have a server closet with a similar layout to yours, was wondering if you had any ideas for airflow/system to install while building. Should I be looking to make a custom AC zone just for that closet? Should I just have a simple outtake fan like in the bathroom? Should I run the air in a loop? Sucked in from the bottom in the wall, pushed in from the ceiling?
Wouldnt mind watching how u put your blue ray ripping set up together
Out of curiosity, who is your ISP? I see people with 2.5gb ports, and 10gb ports but most ISPs offer 1700mbs max, so I’m not sure where they get their speeds… sorry I’m a bit new to all the home lab stuff 😅
I can't quite figure out how to update immich, I'm running it in casa os though. Have you had any problems with updating it? Also, great video!
I bet you could make a great video about setting up Obico to monitor that new 3D printer of yours. Their software is free if you self-host it!
Added it to my idea list! 👍
Obico doesn't work with bambulabs printers out of the box, you can either run octoprint to bridge it but it's way more resource intensive than necessary, but there's a home assistant HACS integration that gives you sensors and limited control, then another that bridges that camera entity to an obico instance. If you google "BambuLabs Home assistant" and "Bambulabs spaghetti detection" both githubs should come up. Works flawlessly.
A comparison of Nextcloud photos and Immich would be pretty cool, including the mobile app integration (I certainly can’t be the only one tired of paying Apple for 2TB of iCloud storage each month 🥵)
Am I sensing some more automation being setup soon?? 🙂 Wake On lan to power up backup NAS and after some verification run the replication task ooooh and maybe a shutdown task? Oooh I am excited now to have a look at what I can do with my setup. 🤘 Thanks for the awesome video and that idea.
If not doing so yes, you should have a serious look at Proxmox Backup server, the compression rate is crazy cool, i made my switch just a few weeks ago, and i have to say im amazed by how much storage im saving just because of that.
I just have a single debian laptop running minecraft, 2 discord bots, and some random flask apps I made
When you report power usage from the Kill-A-Watt, could you report both Watts and VA? It would be helpful if you report both since VA is what you pay for and watts is the power the devices actually use (PF). It would also give us an idea of the efficiency of the device/power supply. Thanks, you have a great channel.
strongly recommend to switch to baremetal on the long term. buy dirt cheap 4x 16gb optane m.2 and use a pair as ZFS for pfsense with a qotom box and keep another pair with some stable backup from the exported config. Basic things like enabling SSL or regenerating certificates from a new CA can brick a hypervisor.
you have stuff going on - personally i'd like to see you go dual wan with opnsense HA and also get more into enterprise servers (refurb) a couple 10 core or 16 core server boxes with lots of memory could be fun additions if you can find a place to put them. you are going dual nas basically - that is great but i would like to see you boost the network a bit more - connect your ws to dual nas with a dual port 25g card - you can do it over cat8 - maybe even get 56g cards and run 40gbe. so those are my only requests go a bit more enterprise/upscale but still use budget refurb parts and make sure to write them off - who knows it could even drop you down a tax bracket - double win
Can you share 2:51 the brand name of the network rack you are using?
Mostly to watch The Office! 😆 That's like 90% of what my Jellyfin server does too!
I'd love an in-depth video on immich!
How do you Get casaos access to your phisical drives in Proxmox ?
Where did you get the rj45 module
I have Lenovo mini pc and I am searching this module for a few months
Either ali-express or amazon. You might check the description for my router video
you should definitively try out NTFY and integrate it in your setup, it can be a lifesaver sometimes
Any plans to set up your proxmox machines in a cluster? You could set it so the router VM is able to migrate between the hosts while maintaining the wan/lan with either vlans or separate switches.
Sounds cool (and also like more work than I want to do lol)
10:19 i think the server its going to is your lxc container itself
Adguard >>> pihole by the way. You can consolidate so much stuff onto two machines
Probably so, but I already have pihole setup, and really it's just for local DNS.
adguard is deffo better than pihole
I love these videos, but i don't have the money neither the network expertise to interconnect all the homelab 🤣
someday 😅
immich is amazing
Do you just remember all the IPs or do you have a dashboard for all your services/links?
Is there a service like Jellyfin (or Jellyfin itself) that's good for audiobooks? I have accumulated so many and being able to organize them better than Dropbox folders would be great
whats the name of that ups?
I'd love to have camera outside but I can't make hole in the wall to get PoE cable and I have flat roof so no space to have cable (and it stops at the wall, it don't go further) so I can't put camera 😭😩
do you have any video about Nextcloud and what you think about it?
Can you give a little in depth review of how you are using n8n? I am helping a news outlet and for what I saw this could be a great tool to have.
Has an entire production server, uses it for almost nothing
It's nice to see someone with a sensible homelab setup that isn't worth 10k and 5x as much horsepower as they need, lol
Are you using ipmi with normal case fans or do you have server fans on those? I’ve found I’ve gotta leave my fans at 100% otherwise it’ll rise and fall like it’s a failing fan and I can’t get it fixed.
Normal case fans. I had to setup an init script to run an ipmitool command. I can't remember anything about it now though haha. I just copy pasted it from my old TrueNAS box to the new one. If you google ipmitool truenas init command you might come up with my solution
@@HardwareHaven yeah I’ve heard as long as it stays above 300 it’s okay. And if that’s the case I think noctua makes a module that shows 300rpm but I’m not sure
6:21 upgrading proxmox is super easy, even if you fck it up, just backup vms and cts, copy backup to other pc and do w/e you want, worst case you would need to reinstall proxmox and copy vms and cts back to it and restore them from backup. I was afraid of it the first time, but its like 30min job at worst.
It's less about how easy or how long and more about whether or not I remember to do it when I have the time lol
Keen to get your thoughts on immich!
And i'm here, running a Atlhon x4 with 8gigs DDR3 running Homeassistant, Immich, SMB, minecraft, spotifyd and pihole. All with docker composer over ubuntu server. Baremetal all the way HAHAHAHA
But i'm a power efficiency weirdo, running only 2 disks and 2 ssds in mirror.
I turned off even the unused serial and USB ports in BIOS, CPU is in conservative power profile and even tried spining down the drives (i do not access very often) but couldnt make it work correctly.
This server is enough for most services, but with 5+ people in minecraft it strugles a bit. My next upgrade will be a 3400G (one guy in reddid achievet 5w idle with this CPU, insane) i have laying around. And it will enable me to transcode in the iGPU.
I don't know anyone who has used 3400g for hardware encoding ( other than FFMpeg).... can you please point me in the right direction?
is tp link sg105e good for link aggregation?
19:00 not really a recommendation, more like a question, but how about HA, i do run two Adguard and unbound instances (its not really HA, just primary and secondary dns server and both forward requests to both unbound instances) but im kinda struggling to implement like two docker hosts that will be copies of each other and will run like my wireguard vpn, so even if one of them goes down i still can connect, i did try docker swarm and keepalived but it was not really working as intended.
You might be asking the wrong guy... haha
@@HardwareHaven i was not expecting a direct answer, you are youtuber not my personal it support :D but im a bit surprised that none of tech youtubers i watch have HA setup ( or i did not saw any video where they are explaining how they have it done )
Nice
I wonder why you're not using Synology more for casual home stuff like Photos, Audio Station etc...? their web/phone integration is fairly decent for trouble-free runtime
Here’s a big question: a lot of your services run on databases what do you use for database in the container or how do you manage databases for the services?
Also check out agentdvr for the NVR Blueiris is kinda too clunky imo
I think all the services I'm running which require a DB are running in portainer stacks (docker-compose), so the DB is running in a container inside the stack.
@@HardwareHaven interesting I guess that means I should switch to that I’ve been using unraid and finding my containers are starting to grow because so many DBs lol guess I’m hosting portainer 😂
I would recommend trying lodestone instead of crafty and runtipi instead of cada os
3d printers are part of the homelab!
Immich is under major development so the dependencies often change with each update making maintenance more difficult, maybe even impossible. It is really cool but it is still alpha stage software.
Yeah, maybe not the best solution for that reason. But I haven't liked anything else as much at the moment. We'll see!
Video idea: Pikvm as it’s an alternative to IPMI.
Immich doesn't work yet for cloudflare tunnels till they get chunking working...just fyi
I'll gladly take that Synology off your hands when you get ready to retire it. I need one to store data for my phone as well as my moms and my sisters phones and that would be perfect. We're currently using Google Drive but I'd like to get off cloud data storage if I can.
Who knows! It might end up on one of my "garage sales" I do for RAID members. lol
So wait.. How does tailscale sync your nas at your house and your parent's house?
It doesn't, it syncs via zfs-replication. Tailscale is just how I'm able to network them easily.
@@HardwareHaven ah
What's your power consumption?
i really want a virtualized router but i don't have the tools and mini pcs are absurdly priced where i live
bro I feel your pain
Usenet baby!
I find virtualizing your router perfectly fine, especially if you use it to separate routing-related services. Logically, that device is your router, nothing else. It also does DNS and VPN, just inside a container but outside the actual router-software. Arguably that's cleaner and more flexible than having a "monolithic" bare-metal router, and running these services either not at all or on different system.
What wouldn't be ideal is running non-related services on there, too. Like jellyfin or something. I think the people criticizing you for this really haven't understood WHY this is generally not recommended and just mindlessly repeat what they "learned". Again, perfectly fine and modern use of virtualization and still proper system separation. Don't listen to the nay-sayers.
What about security? If there is a vulnerability on proxmox?
@@okanerdem depends on the type, but generally it's not a concern. Proxmox in a setup like this isn't exposed to the Internet any more than it would be when just connected by network. The only vulnerability of additional concern in theory would be one where escape from the vm-"sandbox" is possible. For it to be a threat, an attached would have needed to have accessed/hacked into the firewall first (pfsense in his case), to then "escape" into proxmox. Not happening.
This isn't a scenario I would even think about in a home setup.