So, quick update here. The site was down for most of the night because the database cluster shot itself in the head. I had restarted a machine to install updates, and this caused the backend cluster to entire to entirely loose its mind. Unfortunately, I didn't have a manual dump of the database made, just a VM snapshot, since, well, I wasn't tinkering with it directly. I've mostly been trying to patch things to the point that I can sleep, and leaving things down like IRC and email which need to be seriously overhauled before they can go back up.
As far as damages go, it looks like we lost 10 or so days of messages, which uh, sucks for multiple reasons. We're currently on ##soylentnews on Libera.Chat while I pull bits of the site out of the flames, but I'm at the point that if I don't sleep, I will make things worse. Corruption in the production database is very much not what I wanted, and we're very much in limp mode for the moment. I'm going to let staff handle IRC and comments while I sleep, and then I'll post another update when I'm awake.
See you in a few hours
~ NCommander
(Score: 3, Interesting) by RamiK on Saturday November 12 2022, @03:16PM
Yeah it sounds more like what I originally thought where you got stuck with old libraries and distro bases since there wasn't anyone comfortable enough to start rewriting logic to use the new APIs.
Got it. Just don't let Lemmy being a small project ( https://join-lemmy.org/instances [join-lemmy.org] ) fool you: It's low resources (written in Rust and uses PostgreSQL) and separates the front and back ends so there's nothing stopping you from sculpting a soylent-news like web facing frontend UI around it like how LemmyBB does for phpBB: https://join-lemmy.org/news/2022-11-02-_First_release_of_LemmyBB [join-lemmy.org]
But yeah, probably too soon to talk about this right now.
compiling...