I would add Alertmanager to your stack if you haven't already. It's pretty tightly integrated with prometheus. There's some canned alerting rules based on predicting disk space full in X number of days. We wire Alertmanager to Pagerduty.
Machindo
joined 1 year ago
I'm running Grafana Loki for my company now and I'll never go back to anything else. Loki acts like grep, is blazing fast and low maintenance. If it sounds like magic it kind is.
I saw this post and genuinely thought one of my teammates wrote it.
I had to manage an ELK stack and it was a full time job when we were supposed to be focusing on other important SRE work.
Then we switched to Loki + Grafana and it's been amazing. Loki is literally k8s wide grep by default but then has an amazing query language for filtering and transforming logs into tables or even doing Prometheus style queries on top of a log query which gives you a graph.
Managing Loki is super simple because it makes the trade off of not indexing anything other than the kubernetes labels, which are always going to be the same regardless of the app. And retention is just a breeze since all the data is stored in a bucket and not on the cluster.
Sorry for gushing about Loki but I genuinely was that rage wojak before we switched. I am so much happier now.
I hear you and I feel for you.
I'll be sure to try this one.
How does this compare to something like https://github.com/lllyasviel/Fooocus. I have used it and quite like the results.
Nice!
I love using Obsidian.
Do you post any writing online? I'd like to hear more. Your quotes and analysis were pretty poetic.
Worth the read! Thanks.
I'm pretty hype. I tried out the new parts but haven't done any ranked yet. I played a fair bit of 1v1 and 3v3 when the game first came out.
With that number of cat toys it makes me think you really care about your kitty.
We spoil ours as well.