My new Proxmox Monitoring Tools: InfluxDB2 + Grafana
Vložit
- čas přidán 31. 05. 2024
- I recently added some new Monitoring Tools for my Proxmox Server at Home! I installed InfluxDB2 in Docker and used it as an external Metrics Server for Proxmox. Grafana is used to visualize the data in a nice Dashboard. #Proxmox #Grafana #InfluxDB
Grafana Dashboard: grafana.com/grafana/dashboard...
Teleport-*: goteleport.com/thedigitallife
Follow me:
TWITTER: / christianlempa
INSTAGRAM: / christianlempa
DISCORD: / discord
GITHUB: github.com/christianlempa
PATREON: / christianlempa
MY EQUIPMENT: kit.co/christianlempa
Timestamps:
00:00 - Introduction
00:50 - My current monitoring setup
02:01 - The new setup
03:16 - InfluxDB2
06:50 - How to secure InfluxDB2?
10:24 - (Advertisement) Teleport-*
11:12 - Send Proxmox Metrics to InfluxDB2
14:10 - Visualize Metrics in Grafana
________________
All links with "*" are affiliate links.
Just have to say between this and the SSL video, you have helped my step up my game in my homelab HUGE! Thank you for everything you do and bring to the community!
Returned to this video and completed my initial set up of InfluxDB2 with Grafana for my Proxmox server. Always good to use your content for reference. Thanks!
Just curious, does the metrics contain CPU temperature stuff?
Great Video, I've followed along and was able to get this setup and monitor my 3 homelab ProxMox servers! Thank you for the time and effort!
You're welcome! I'm glad it helped you!
Again. Packed with tons of useful information and background knowledge. Thank you Christian.
Thank you! :)
Thanks for the reference to the grafana dashboard, I already had the metrics in influxdb since quite some time, but couldn't find a dashboard I liked, now I do. :)
Awesome! You're welcome ;)
I do really like watching this content when CZcams algo recently started showing me this . Can't get enough thanks . .. Only issue is no matter how many videos you say the link to that video is in the description...! IT NEVER IS 🤷🏾♂️
Wonderful. Thanks for showing this. I abandoned InfluxDB a while ago, nice to see that version 2 does work well here. I´ll put a influx2 docker container on my to-do list.
Oh thats nice! Thank you ;)
This is Awesome!! been wanting a nice grafana dash for proxmox but had no idea how to begin to build one myself
Thanks, glad you liked it 😁
Great video Christian!
Thanks! All inspired by you 😉
@@christianlempa Love it!
Awesome, can't wait for the Cert / TLS video. Great stuff as usual appreciate your knowledge.
Thank you :)
I'm looking it forward too. 👍
I want to know if it's possible to remove the warning for self signed certificate when entering the site.
There is an warning triangle in the address bar.
Thank you! 👍
Thanks for this. Touched all points perfectly.
Glad to hear it!
Yesss please make that Tutorial!🙏
Oh and btw i Love your Tutorials u explain everything so nice and detailed much respect to you 😄
Oh sure it will come! :D Thank you so much, that makes me happy!
Awsome video, I also tried influx and grafana a few weeks ago and tested if i can put traefik access logs into a dashboard, it partially worked
Thank you! Great stuff :D What I'm doing is, I'm using traefik to expose the grafana dashboard, same self-signed certs like the influxdb.
Awesome tutorial, as usual! And yes, would be great that SSL certificates tutorial. Peace. ✌️
Thank you :D Of course, I'll do it!
Absolutely would love a deep dive into SSL both self signed and with Traefik!
Great idea! 😀
Hello, can we get an updated video on how to get this working with Traefik
Thanks for the great tutorial! To reach a larger audience, I really want to see non-automatic subtitles. I'm watching from another country, and I don't speak the language, but subtitles help a lot!
Thanks mate, uff I can see why you're asking this but I guess that will just completely go beyond my available time :/ I hope that I will find a solution for this in the future.
Hi Christian, great tutorial (as always btw ;-) ). I like the way you make your videos and content.
Thank you so much for the feedback! I wasn't sure if the pacing and highly edited style is the right one for a video like this, but I wanted to try it. And that you like the way I make my videos makes me happy :)
Also thank you so much for supporting the Channel :D
@@christianlempa It's my pleasure! :)
Awesome! Works great in few minutes.
But have you find any native way to include SMART metrics to the flow?
I found a way by installing telegraf with a smart plugin but i'd like to avoid installing something to my pve. I try to keep it as clean as possible.
As to SSL tutorial, sure that will be very interesting. Such an important topic!
This is really awesome, thanks for sharing ;)
Sure! Thank you mate :)
Great video as always thanks.
SSL certs (self-signed) for homelabs will be great ! I always wondered how to move self signed ssl cert and root ca certs for trust on all devices so eveything is nice and trusted in the end from everywhere at home. I can think of manual methods but if there are any automation available will be great.
Thank you for the feedback! Hope you like the cert video (when it's coming :D)
Great vid as always. I did the same setup a few weeks ago but without the SSL, definitely looking forward to that video when you make it :) How did you get the dark Proxmox theme?
Thank you mate :) The dark mode is a nice project on GitHub that I recently found: github.com/Weilbyte/PVEDiscordDark
Looking at setting this up at the moment. For the self-signed cert issue, could you get around that by using traefik, or is that a bad idea?
If you make an API token with read permissions only on the bucket where you store proxmox data the dashboard opens in the right bucket straight away. If you use the admin api token you'll also have access to the default buckets of influxdb like _monitoring and it will default to that.
Wow thank you such a nice information before your comments i never look's at api options and use admin api everywhere
Danke Christian, kurz und bundig. Ich habe so lange gesucht nach einen weg. Dies ist genau was ich gesucht habe. Viele Grüsse aus Holland
Vielen Dank für deinen Support! Grüße zurück, ich komm bald mal wieder Urlaub bei euch machen :D
Very good and professional video Christian and very nice and usefull content - thanks a lot for your time invest :-)
Thank you so much :)
Hi! Awesome video. Thanks!
amazing video!!! I really need to get this deployed!
OMG - tons of gold nuggets inside! thanks again, Christian
Thank you so much ;)
Amazin stuff! thank you!
Glad you liked it!
Great Video, just what I was looking for....
Awesome! Thx ;)
Hi... Because of the SSL Connection from Grafana to influxdb, the hostname within the certificate is the one thing, but you also need the ca.crt itself in the root of the grafana container, don't you?
good tutorial, thank you for that! i'l be wait video about ssl!
Thanks!
5:28 I've watched most of your video explaining docker networking, but I still don't understand what you mean by custom dns lookups here? Is the custom network supposed to be a bridge or host network or one of the other ones?
If you create a docker network as a bridge it supports dns lookups inside with the containers hostname, something the default network doesn't offer
excellent used this to create a CT in proxmox to monitor my servers
Cool!
Hi thanks for the great video, have you managed to setup proxmox and nginx pm ?
Been loving your videos so far...
After watching this one for a while, one thing kept bugging me....
What's holding that mic up??? Are you a wizard and using magic? :) Nice setup, since I can't see what's holding it up :)
Hey thanks mate! Haha I'm a tech wizard :D, No it's just a Mic arm that's directly behind the mic itself, from the current angle you can't see it ;)
Thanks for this great video.
I have an issue though when displaying the dashboard. Here are 3 errors showing up:
Templating: Failed to upgrade legacy queries e.replace is not a function
Templating [Bucket]: Error updating options: e.replace is not a function
Templating [server]: Error updating options: e.replace is not a function
Any idea where this could come from?
It's possible to use this grafana dashbord with a current InfluxDB v1.10 ?
@christianlempa As I couldn't find it mentioned in the comments, you can disable the SSL verification by checking the Advanced box and unchecking the Verify Certificate box.
Hi Cristian, The SSL tutorial would be great!! Very helpful also the different types of cypher protocol ECDSA TLS ecc.....
Good video as always!!. Thanks
Hey, great, thank you! Don't hope for much regards cryptography, I'm a complete noob there :D
I did same few days ago but it’s great you made this video 😀
Cool! Do you have set up any alerts for the metrics?
@@christianlempa not yet… still learning but will learn from you
Hey, I'm wondering if Grafana's docker image has brute force protection by default? As much as it is stated as such on their website, just trying to "brute force" it myself conflicts with this. I'm never actually blocked or anything.
Puff Idk honestly. But I wouldn't be too worried about brute force, you can always add any IPS/IDS system before your containers handling that.
Hi friend, do you have any templates, I use a cluster with replication in zfs, and I need to monitor this
End your virtual disk?
If possible Can you please make a video for the integration of portainer and cockpit ? Because I believe this will be more beneficial for DevOps guys
Mh great suggestion I haven't thought about, yet. Let me add it to the long long list :D
can we get the installation doc's for Ubuntu
Thanks very much for your nice work
Kindly what advantages to use Proxmox instead of Prometheus ?
You mean InfluxDB, I guess? Well it just seemed the straightforward method that's officially implemented by Proxmox. That's why I went with it.
yes, please make a video for SSL certificates 📌- great videos !
Thanks mate!
you look like grew i love it
thank you!!! its working but now I saw that TrueNas can use graphite with influxdb and grafana aaannnnddddd its now unsupported since influxdb v2.0 :( what can we do now ? how to add graphite to docker and make it working with influx or directly with grafana ? Im not an IT for your information.
Honestly, I have no idea :D I'm setting up TrueNAS in a few weeks so maybe I'll figure it out then ;)
非常有趣，学习一下。👍👍👍
if you had Home Assistant, you would not have to install extras for Proxmox - influxdb and grafana are "the must" for home assistant ;-)
Hey Christian, have you had a chance to check out Grafana Loki too? Its their answer to Splunk, Loggly, etc.
I have watched TechnoTim's video about it, really nice! But I didn't have the time yet to start working with it.
can i get cpu temp ?
Excellent video, it is possible to recreate these containers with podman (grafana, influxdb, prometheus) with the same operation. Greetings from Costa Rica
Thank you mate! Sure, because they are based on the container standard it should also work in podman.
Is it possible to install InfluxDB2 on my Proxmox server and still have it run like you are showing?
I wouldn't do that, better put that in a VM at least
Great now I need to figure out how to get data from sensors for example so I can get temperatures aswell :)
Thank you, :D Please tell me if you found out how ;)
@@christianlempa I know that there is a lm-sensor exporter for fact. So it should not be so hard I hope :D
@The Digital Life thank you for your video, I did enjoy it.
I am sharing some thoughts here:
1. You mentioned, that you will create a separate video for SSL, certificates, I m interested in this video and looking forward to watching it. Thanks in advance.
2. Is there another tool for monitoring the VM from inside the VM's standpoint of view? On the contrary with your current video and illustrations are very good and interesting of course, and it would be monitoring the hypervisor data about those VM, but not about processes running inside the VM.
I wondering about a tool to use with Grafana and Prometheus to display information, which you get the different processes running inside VM, the most CPU intensive process inside the VM, and the most RAM intensive process inside each VM or LXC, etc.
Here guys, here, everyone,
What do you think?,
Do you think would be interesting or of some advantage to monitor from inside the VM standpoint of view? or not? and why not?
Thanks in advance.
Hey,
Here guys, here, everyone,
What do you think?,
Do you think would be interesting or of some advantage to monitor from inside the VM standpoint of view? or not? and why not?
Thanks.
Thanks for your feedback ;) I'm monitoring the vms with nodeexporter, prometheus and grafana. This checks the stuff running inside a vm.
@@christianlempa Again, really good video, and very good content, I will then google how to do the nodeexporter, if you have some videos about it, pls let me know, I would appreciate it. thanks.
@@EduardoSantanaSeverino In my last monitoring video I talk about it. Link is in description
good。
Great video, you keep going off topic so its hard to follow, you start talking about something and then start clicking on settings etc just a bit hard to follow sometimes
How…did you get dark mode in ProxMox?????!!!!!!
It's a project on GitHub I recently found, really cool stuff: github.com/Weilbyte/PVEDiscordDark
On your youtube homepage can you please include uploads, so that the most recent videos could be found on your youtube homepage
I have done this to organize it better, you can find all new videos in the "Best of The Digital Life" playlist.
Please make a self signed SSL tutorial video!!!!!
+1 :D
Self signed ssl video please
+1 :D
Könntest du auch eventuell deutsche Videos machen?
Eventuell kommt mal ein zweit Kanal in deutsch, aber bisher habe ich da keine konkreten Pläne. Der hier nimmt schon so viel Zeit in Anspruch ;)
Zabbix
Cacti: tested, legacy, obsolate; Centreon: tested, the free version is unusable; Nagios: tested, similar; icinga: tested, similar; Zabbix: tested, overcomplicated, I/O hungry, RAM-hungry, don't try to run on VM to monitor more than a few dozen hosts; CheckMK: tested, won. We run it with AD authentication on 18 servers countrywide for more than 300 hosts, one server is the aggregator. It takes a few minutes to set up, and it takes just minutes to add hosts. No huge database, no performance problems. There is nothing more useful than distributed monitoring. But stay on Zabbix, use what you like.
Friend… You are the guy. I luv ya!
However;
Who is your audience?
No… STOP.
You are doing a tutorial on something technical…
It is directed at someone who is NEW. (N00b).
Why are you blasting through screen grabs like you are Roger Rabbit?
WHY ARE YOU TALKING SO FAST?
Take a breath… you are good… with good information… calm down (or lay off the cocaine).
I want to hear what you are saying. I am new (and generally smart), so I need time to process and learn (I am new).
Please slow down (or get help). I mean this from a good place.
zabbix +1
Hi friend, do you have any templates, I use a cluster with replication in zfs, and I need to monitor this