RetroFed Forum
Your home away from modern life.
How do you monitor your servers?
Post Reply
AuthorMessage
Potato Lover šŸ’¾ No brain found lemmy.sdf.org user224@lemmy.sdf.org
Joined: 2023-06-17
Quote

Running services, network usage, memory usage, bandwidth, disk I/O, successful logins, whether the thing is even alive, etc...
So far my only method has been "hope and pray".

113   Original
happy_wheels lemmy.blahaj.zone happy_wheels@lemmy.blahaj.zone
Joined: 2025-06-04
#2 · (edited) Quote Reply

Cockpit. Total gamechanger for me. I don't have to ssh to my boxes individually to see what's going on. Instead it's a web UI AND you can connect basically every server you want to one instance.

https://github.com/cockpit-project/cockpit

That said. For individual servers?

htop/nmon (Get nmon straight from the source! https://nmon.sourceforge.io/pmwiki.php) for a birds-eye sysmon view of things

ps -ef | grep <whatever you're looking for> for investigating stuck/hung/zombie processes

dmseg

tail -f /var/log (or whatever log file you care about)

netstat for net statistics (i think ntop used to be a thing but idk anymore>...)

df -h to look at disk usage

those are all that come to mind right away.

EDIT: formatting and quick explanation of what each tool does

9
owenfromcanada lemmy.ca owenfromcanada@lemmy.ca
Joined: 2025-04-18
#3 · Quote Reply

I have a robust monitoring system for my Jellyfin server, been running for the last few years. Checks in periodically, at least once per 24 hours and notifies me if it's down. Doesn't use any electricity, but does consume a good amount of Cheerios and mac & cheese.

71
CameronDev programming.dev CameronDev@programming.dev
Joined: 2023-06-18
#4 · Quote Reply

Uptime Kuma, only really care if it's up or not. Got about 30 services monitored, sending notifications to Signal.

4
I_Am_Jacks_____ sh.itjust.works I_Am_Jacks_____@sh.itjust.works
Joined: 2025-06-04
#5 · Quote Reply

I use naemon (nagios fork) and grafana Loki Prometheus influxdb

7
Scott sh.itjust.works scottmeme@sh.itjust.works
Joined: 2023-06-15
#6 · Quote Reply

I have a robust monitoring system for my Jellyfin server, been running for the last few years. Checks in periodically, at least once per 24 hours and notifies me if it's down. Doesn't use any electricity, but does consume a good amount of Cheerios and mac &amp; cheese.

Does this monitoring system also happen to be a dependent on your taxes?

24
frongt lemmy.zip frongt@lemmy.zip
Joined: 2025-07-31
#7 · Quote Reply

I pay a group of schoolchildren to refresh a group of browser tabs and yell if anything isn't responding.

There are plenty of previous threads with recent answers if you search.

17
lIlIlIlIlIlIl lemmy.world lIlIlIlIlIlIl@lemmy.world
Joined: 2025-03-31
#8 · Quote Reply

Uptime Kuma! For HDDs I have them report their ā€œpingā€ as percentage full

15
Carrots quokk.au Carrots@quokk.au
Joined: 2026-09-30
#9 · Quote Reply

Lights are on, server is on.

31
blarth thelemmy.club blarth@thelemmy.club
Joined: 2024-03-16
#10 · Quote Reply

Whining from end users.

25
ten8tp reddthat.com ten8tp@reddthat.com
Joined: 2026-08-25
#11 · Quote Reply

I have a robust monitoring system for my Jellyfin server, been running for the last few years. Checks in periodically, at least once per 24 hours and notifies me if it's down. Doesn't use any electricity, but does consume a good amount of Cheerios and mac &amp; cheese.

Lies! It uses electricity!

15
curbstickle Moderator curbstickle@anarchist.nexus
Joined: 2025-08-25
#12 · Quote Reply

Well I used to use VGA for my monitors, now its mostly displayport.

Seriously though, prom+Loki+alloy+a few other things to Grafana, with alerting in grafana.

17
Limeade3425 lemmy.zip Limeade3425@lemmy.zip
Joined: 2025-05-20
#13 · Quote Reply

I started with uptime kuma since it was simple and light on resources. I've switched to checkmk community (formerly raw) and really enjoying it. It's telling me so many things that are wrong that I missed. Like that one time I made a snapshot of a VM then forgot about it for 113 days...

4
i_stole_ur_taco lemmy.ca i_stole_ur_taco@lemmy.ca
Joined: 2023-06-13
#14 · Quote Reply

I get a text pretty quickly.

6
owenfromcanada lemmy.ca owenfromcanada@lemmy.ca
Joined: 2025-04-18
#15 · Quote Reply

Lies! It uses electricity!

Indirectly. But as another commenter pointed out, it balances out with the tax rebates.

12
WeirdGoesPro lemmy.dbzer0.com WeirdGoesPro@lemmy.dbzer0.com
Joined: 2023-08-15
#16 · Quote Reply

Uptime Kuma! For HDDs I have them report their ā€œpingā€ as percentage full

Can you teach me this wizardry?

7
Reannlegge lemmy.ca Reannlegge@lemmy.ca
Joined: 2025-02-13
#17 · Quote Reply

Lights are on, server is on.

I recently found out that this is not always true.

17
phanto lemmy.ca phanto@lemmy.ca
Joined: 2023-07-03
#18 · Quote Reply

I sync my podcasts hourly with Nextcloud and poddersync, so when my servers go down, my phone beeps at me.

3
testgoofy infosec.pub testgoofy@infosec.pub
Joined: 2023-06-26
#19 · Quote Reply

I use Alloy to collect Metrics of the host (Disk usage, CPU, Ram, etc.) and different logs.
With Grafana the data is then displayed as a daschboard. If everything goes south, Alertmanager sends Mails to me

5
Pope-King Joe lemmy.world popekingjoe@lemmy.world
Joined: 2023-07-01
#20 · Quote Reply

I usually just walk down the hall and move the mouse. I don't really need remote monitoring. šŸ˜…

5
Owljfien piefed.world Owljfien@piefed.world
Joined: 2025-07-26
#21 · Quote Reply

Cockpit. Total gamechanger for me. I don't have to ssh to my boxes individually to see what's going on. Instead it's a web UI AND you can connect basically every server you want to one instance. https://github.com/cockpit-project/cockpit That said. For individual servers? htop/nmon (Get nmon straight from the source! https://nmon.sourceforge.io/pmwiki.php) for a birds-eye sysmon view of things ...

Lol I go to all of my server's specific cockpit addresses, sounds like I'm doing it wrong, I'll need to look at connecting them

1
Matt The Horwood lemmy.horwood.cloud mhzawadi@lemmy.horwood.cloud
Joined: 2023-07-27
#22 · Quote Reply

I use nagios

5
kurcatovium piefed.social kurcatovium@piefed.social
Joined: 2025-06-19
#23 · Quote Reply

That's the neat part, I don't.

20
esc piefed.social esc@piefed.social
Joined: 2026-03-24
#24 · Quote Reply

Prometheus + grafana. It's overkill tbh, most of the services restart automatically and I mostly ignore it. (it's an artifact from life where I cared about it)

4
lazynooblet lazysoci.al lazynooblet@lazysoci.al
Joined: 2023-06-20
#25 · Quote Reply

Zabbix

4
corsicanguppy lemmy.ca corsicanguppy@lemmy.ca
Joined: 2023-06-12
#26 · (edited) Quote Reply

SNMP.

The old engine was nagios. The new engine will be telegraf -> mqtt -> brokerfest -> timescale -> Prometheus.

I guess. Not sure yet. The brokerfest is a series of broker pubsub between sites to both split out data from the stream for off-site CC, or pull its own subscriptions in. Data could go host <- telegraf -> broker -> remote broker -> remote timescale -> remote Prometheus

2
corsicanguppy lemmy.ca corsicanguppy@lemmy.ca
Joined: 2023-06-12
#27 · Quote Reply

Cockpit. Total gamechanger for me. I don't have to ssh to my boxes individually to see what's going on. Instead it's a web UI AND you can connect basically every server you want to one instance. https://github.com/cockpit-project/cockpit That said. For individual servers? htop/nmon (Get nmon straight from the source! https://nmon.sourceforge.io/pmwiki.php) for a birds-eye sysmon view of things ...

It's amazing the risk profile of that.

3
just_an_average_joe lemmy.dbzer0.com just_an_average_joe@lemmy.dbzer0.com
Joined: 2024-08-02
#28 · Quote Reply

I vibe coded a monitor that shows me all the logs and other stuff. And im using netbird cloud (free version) to setup dns so all my services have url "servicexyz.home.internal".

So i just connect to netbird vpn on my phone and go to that url.

You can pretty much use any of the other tools mentioned in this thread with this kind of setup, heck you can write a simple fastapi server that just runs "top" and return it (it would be like 20-30 lines of python) over a url that you can from anywhere as long as you are connected to your vpn

1
nosuchanon lemmy.world nosuchanon@lemmy.world
Joined: 2025-06-11
#29 · Quote Reply

Cockpit. Total gamechanger for me. I don't have to ssh to my boxes individually to see what's going on. Instead it's a web UI AND you can connect basically every server you want to one instance. https://github.com/cockpit-project/cockpit That said. For individual servers? htop/nmon (Get nmon straight from the source! https://nmon.sourceforge.io/pmwiki.php) for a birds-eye sysmon view of things ...

How do you configure adding multiple servers to the same instance?

0
tigerhawkvok startrek.website tigerhawkvok@startrek.website
Joined: 2023-06-12
#30 · Quote Reply

A script checks container status and accessibility, and pushes a ntfy alert if it goes down. Healthchecks.io reports if the whole Pi goes down.

1
dihutenosa piefed.social dihutenosa@piefed.social
Joined: 2025-06-04
#31 · (edited) Quote Reply

When logged in locally, I use btop to see an overview of what's happening.

Other than that, I have relevant Prometheus exporters in every machine (node exporter in all machines, specific exporters by the workload), hooked up over Wireguard to my monitoring solution offsite.

The phone I actually carry around has a ntfy client talking to ntfy server on the aforementioned monitoring solution, so I get buzzes when something goes down.

Btw, does anybody happen to know where I could get a pre-cooked comprehensive alert system for my nodes? Surely many people have already written all these rules:

  • if disk space > 80% consumed, send a low-priority alert
  • if disk space > 95% consumed, send an urgent alert
  • ... everything else, there's so much to check...
1
ryannathans aussie.zone ryannathans@aussie.zone
Joined: 2023-09-20
#32 · Quote Reply

I use FreeBSD so I don't need to check it to make sure it's working properly

1
truxnell quokk.au truxnell@quokk.au
Joined: 2025-07-27
#33 · Quote Reply

Cockpit on each server (microos) and bezel for a lite centralized monitoring/alert stack.
I have a bespoke gitops on each server running ansible hourly, and ntfy pings for failure on these.
Also healthchecks.Io for heartbeat/backups, other critical infra checks

1
Legion739 piefed.zip Legion739@piefed.zip
Joined: 2026-09-11
#34 · Quote Reply

Grafana dashboard

image
You can find more details and the source code here: https://erasmus.works

3
Potato Lover šŸ’¾ No brain found lemmy.sdf.org user224@lemmy.sdf.org
Joined: 2023-06-17
#35 · Quote Reply

Grafana dashboard You can find more details and the source code here: https://erasmus.works

Ooooo, that looks nice.

2
pHr34kY lemmy.world pHr34kY@lemmy.world
Joined: 2023-07-02
#36 · Quote Reply

It's running the private DNS for my phone. If it goes down, I realise quite quickly.

7
dimjim sh.itjust.works dimjim@sh.itjust.works
Joined: 2023-10-15
#37 · Quote Reply

My primary monitoring system is Beszel, but since I just migrated from VMs to LXCs it can’t properly see the memory/CPU usage, so it just checks for disk usage and liveliness. Home assistant with Proxmox & Dockhand integrations gives me the rest of my monitoring needs.

5
spacelord sh.itjust.works spacelord@sh.itjust.works
Joined: 2025-09-28
#38 · Quote Reply

Prometheus + grafana. It's overkill tbh, most of the services restart automatically and I mostly ignore it. (it's an artifact from life where I cared about it)

Exactly this scenario at my place as well. šŸ˜„

2
Dultas lemmy.world Dultas@lemmy.world
Joined: 2023-08-03
#39 · Quote Reply

Uptime Kuma for outages, Prometheus for metrics, rsyslog to Loki backend for logs. Grafana for ingesting Prometheus and Loki data.

2
sakphul discuss.tchncs.de sakphul@discuss.tchncs.de
Joined: 2025-06-23
#40 · Quote Reply

My primary monitoring system is Beszel, but since I just migrated from VMs to LXCs it can’t properly see the memory/CPU usage, so it just checks for disk usage and liveliness. Home assistant with Proxmox &amp; Dockhand integrations gives me the rest of my monitoring needs.

I am also using Beszel after using checkmk. For me checkmk was way too complicated (but is also way more powerfull) to setup and maintain propperly. So I switcheed to beszel because it is much easier and good enough for my use case which is:

  • Is the thing running at all?
  • Disk full?
  • CPU, network, etc. on full throttle for some strange reason?
  • send me a mail if somethings wrong

Besides that I don't need anything. The only thing missing is SNMP support to check switches, routers and AP's.

2
Decronym Bot Decronym@lemmy.decronym.xyz
Joined: 2026-01-05
#41 · (edited) Quote Reply

Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I've seen in this thread:

Fewer Letters More Letters
AP WiFi Access Point
DNS Domain Name Service/System
ISP Internet Service Provider
LXC Linux Containers
NAS Network-Attached Storage
NFS Network File System, a Unix-based file-sharing protocol known for performance and efficiency
RAID Redundant Array of Independent Disks for mass storage
SSH Secure Shell for remote terminal access
TLS Transport Layer Security, supersedes SSL
ZFS Solaris/Linux filesystem focusing on data integrity

10 acronyms in this thread; the most compressed thread commented on today has 14 acronyms.

[Thread #122 for this comm, first seen 9th Oct 2026, 13:00]
[FAQ] [Full list] [Contact] [Source code]

3
bertlewirth lemmy.world bertlewirth@lemmy.world
Joined: 2026-09-15
#42 · Quote Reply

You guys are monitoring your servers?

51
bertlewirth lemmy.world bertlewirth@lemmy.world
Joined: 2026-09-15
#43 · Quote Reply

Lights are on, server is on.

Kernel panic?

3
InFerNo lemmy.ml InFerNo@lemmy.ml
Joined: 2023-06-07
#44 · Quote Reply

You guys are monitoring your servers?

"can't access this thing, server must be down"

43
happy_wheels lemmy.blahaj.zone happy_wheels@lemmy.blahaj.zone
Joined: 2025-06-04
#45 · Quote Reply

How do you configure adding multiple servers to the same instance?

So I actually just went to make a guide on this, demonstrating on my ubuntu 26.04 lab vps, and it appears the connect option is not there.

However on my 24.04 lab vps, it's there. Same with my local 22.04 systems (yes I know I have to upgrade lmao)

I went to cockpit docks and sure enough, the feature is deprecated :( Dang.

https://docs.cockpit-project.org/cockpit-guide/latest/guide/feature-machines.html

It was really cool though while it worked.

1
happy_wheels lemmy.blahaj.zone happy_wheels@lemmy.blahaj.zone
Joined: 2025-06-04
#46 · Quote Reply

Lol I go to all of my server's specific cockpit addresses, sounds like I'm doing it wrong, I'll need to look at connecting them

So it turns out.... you can't connect them anymore.... The feature is deprecated

https://docs.cockpit-project.org/cockpit-guide/latest/guide/feature-machines.html

(also, I wanted to just link my response from another user who had asimilar question but for whateVER reasyon, Alx won't let me??)

2
Potato Lover šŸ’¾ No brain found lemmy.sdf.org user224@lemmy.sdf.org
Joined: 2023-06-17
#47 · Quote Reply

You guys are monitoring your servers?

I plan to perhaps, just maybe, I am not sure, to try self-hosting an email server. But I'll need a good uptime.
Although I am really scared about security.

7
CompactFlax discuss.tchncs.de CompactFlax@discuss.tchncs.de
Joined: 2025-02-14
#48 · Quote Reply

I notice something stopped working, or someone in the household notices.

Then I go fix it.

23
bertlewirth lemmy.world bertlewirth@lemmy.world
Joined: 2026-09-15
#49 · (edited) Quote Reply

I plan to perhaps, just maybe, I am not sure, to try self-hosting an email server. But I'll need a good uptime. Although I am really scared about security.

Well, it’s a good learning experience. But….. don’t. Good luck getting around the major email providers’ smart screen shit. It’s probably not gonna happen. I tried a few years ago, and even microslop couldn’t figure out why their shit screen crap wouldn’t allow my emails. It’s not in their best interest to fix it. So they don’t. But it’s worth doing it in the short term to learn how to do it. Teaches you about email, spf, dkim etc. which actually does translate to real world skills. I used what I learnt setting it up in my real life job.

6
DeathByDenim lemmy.world DeathByDenim@lemmy.world
Joined: 2023-08-24
#50 · Quote Reply

I notice something stopped working, or someone in the household notices. Then I go fix it.

And the best time to notice that the backups weren't working is when you need access to the backup. šŸ˜…

9
Helix 🧬 feddit.org helix@feddit.org
Joined: 2024-07-27
#51 · Quote Reply

Netdata, looking at dashboards when something breaks :)

1
Post Reply Page 1 of 3   Goto page 1, 2, 3 Last »
Back to top