SoylentNews is people
SoylentNews
So, quick update here. The site was down for most of the night because the database cluster shot itself in the head. I had restarted a machine to install updates, and this caused the backend cluster to entire to entirely loose its mind. Unfortunately, I didn't have a manual dump of the database made, just a VM snapshot, since, well, I wasn't tinkering with it directly. I've mostly been trying to patch things to the point that I can sleep, and leaving things down like IRC and email which need to be seriously overhauled before they can go back up.
As far as damages go, it looks like we lost 10 or so days of messages, which uh, sucks for multiple reasons. We're currently on ##soylentnews on Libera.Chat while I pull bits of the site out of the flames, but I'm at the point that if I don't sleep, I will make things worse. Corruption in the production database is very much not what I wanted, and we're very much in limp mode for the moment. I'm going to let staff handle IRC and comments while I sleep, and then I'll post another update when I'm awake.
See you in a few hours
~ NCommander
(Score: 0) by Anonymous Coward on Saturday November 12 2022, @09:28AM (20 children)
Coincidentally I posted in my journal recently.
Similar thing happened some years(?) ago when I posted in my journal. Data loss included what I posted in my journal.
¯\_(ツ)_/¯
(Score: 1, Insightful) by Anonymous Coward on Saturday November 12 2022, @09:32AM (7 children)
I'm going with coincidence. I don't think there's any sort of conspiracy. Remember yesterday's meta? This site is held together with chewing gum and string.
(Score: 5, Insightful) by Anonymous Coward on Saturday November 12 2022, @10:07AM (5 children)
(Score: 2) by RS3 on Saturday November 12 2022, @05:59PM (4 children)
Hmmm. Blanket? As in, never ever anywhere?
I'm the only IT / admin for a smallish hosting / server operation. I took over for departed staff about 15 years ago. A bunch of the sites are WordPress, and I've never had any problems. I've updated, upgraded, migrated, no problems, ever, with mysql, or php or WordPress or plugins.
My only worry about mysql is Oracle, so I may switch to mariadb soon, but for now everything has been great.
What problems have you seen or had with mysql or derivatives?
(Score: 0) by Anonymous Coward on Sunday November 13 2022, @06:41AM (3 children)
Is your brain running on MySQL too? Has it lost info on the recent/regular noticeable data loss on SoylentNews?
If you store stuff in a real DB it won't get lost like that so easily.
There's no good reason to use MySQL other than "legacy" aka some fools made the wrong choice years ago and you're stuck with it.
(Score: 3, Funny) by janrinok on Sunday November 13 2022, @09:25AM (2 children)
What a load of rubbish. Have you bothered to find out why we lost data?
(Score: 0) by Anonymous Coward on Sunday November 13 2022, @10:44AM
(Score: 0) by Anonymous Coward on Sunday November 13 2022, @10:48AM
So what DB software is that DB cluster running?
(Score: 4, Funny) by janrinok on Saturday November 12 2022, @12:09PM
(Score: 5, Informative) by janrinok on Saturday November 12 2022, @10:17AM (9 children)
We have also lost 493 'user' accounts, over 50 current submissions, and all of the work that had been prepared for the front page to cover the weekend, etc
Yep, we might have also lost your journal.
Of the accounts that were lost, only a handful of genuine accounts were among them (no more than 5). There were also 5 sock puppet accounts but fortunately somebody's spam bot was filling up the vast majority of the remainder (475+). If you think that your account was among those lost please email your nickname to [my_user_name][at]protonmail.com and I'll see what I can do to recover it. Sock puppets need not bother applying.
(Score: 1) by Runaway1956 on Saturday November 12 2022, @10:59AM (7 children)
Journal entries are missing. McGrew posted a journal entry just a couple days ago. DannyB and I both commented in that journal, and I just looked to see what DannyB may have replied. It's gone.
I don't know how may others may have been affected.
Abortion is the number one killed of children in the United States.
(Score: 2) by turgid on Saturday November 12 2022, @11:23AM (6 children)
I've lost some journal entries too, but I can live without them. I am sorry to have lost the comment I posted on yesterday's Meta, though.
I refuse to engage in a battle of wits with an unarmed opponent [wikipedia.org].
(Score: 2) by janrinok on Saturday November 12 2022, @11:55AM (5 children)
https://web.archive.org/web/20221111011540/https://soylentnews.org/meta/article.pl?sid=22%2F11%2F10%2F1428220 [archive.org]
Enjoy! Thanks to the AC who provided the link.
(Score: 3, Insightful) by turgid on Saturday November 12 2022, @12:10PM
That is both impressive and very troubling.
I refuse to engage in a battle of wits with an unarmed opponent [wikipedia.org].
(Score: 2) by Unixnut on Saturday November 12 2022, @03:53PM (3 children)
oooh, I got responses to my post! Alas the site had the hiccup while I was asleep, so I didn't get to see any of that, let alone respond.
Thanks for the link! Shame can't respond on the thread though.
(Score: 2) by janrinok on Saturday November 12 2022, @03:59PM (2 children)
(Score: 3, Interesting) by maxwell demon on Sunday November 13 2022, @10:03AM (1 child)
But couldn't a new comment eventually get that same number? After all, the system doesn't know about that old comment any more.
The Tao of math: The numbers you can count are not the real numbers.
(Score: 2) by janrinok on Monday November 14 2022, @06:00AM
Yep - but the comment numbers printed on the Wayback machine copy are not going to change. The reference would be only be valid for the comment numbers shown on that unchanging page.
(Score: 1) by Runaway1956 on Saturday November 12 2022, @11:04AM
Also, unable to connect to IRC here. "Disconnected (Remote host closed socket)."
Abortion is the number one killed of children in the United States.
(Score: 3, Funny) by maxwell demon on Saturday November 12 2022, @10:49AM
So actually you are the one who caused the problem, by posting in your journal? :-)
The Tao of math: The numbers you can count are not the real numbers.
(Score: 2) by mcgrew on Sunday November 13 2022, @08:45PM
Not the first time, my last journal I posted Friday was lost, too, but it's not really lost; it's at mcgrew.info. I had unread messages that were lost, too, but it's no big deal either, as they were all about a journal that wasn't lost.
My guess is only newer stuff was lost, and if they lost your stuff and it wasn't backed up, that's your own fault. I'm thankful that they posted this. Shit happens.
Carbon, The only element in the known universe to ever gain sentience