Stories
Slash Boxes
Comments

SoylentNews is people

Meta
posted by cmn32480 on Thursday January 11, @09:06PM   Printer-friendly
from the reboots-are-like-getting-new-shoes dept.

We recently received notifications that Linode, our hosting provider, will be performing "Emergency Security Maintenance" as a result of the recently Disclosed Meltdown and Spectre security issues.

So far, we have been informed of maintenance windows for two of our servers: magnesium and fluorine.

There is a two hour window for these reboots starting on Friday January 12th at 10:00AM UTC. Reboots should take on the order of about 10 minutes per server.

The reboot of magnesium should cause no service disruption as it is one of our redundant front-end servers. The same cannot be said for fluorine as TheMightyBuzzard so succinctly summed it up: "slashd and site payments won't work while fluorine's down".

We have not yet received any information as to when our other systems will be rebooted -- we will keep you advised as we learn more.


Original Submission

Related Stories

System Reboots: beryllium reboot successful; lithium, sodium, and boron soon to come [updated] 18 comments

[Update: Reboot of beryllium was successful and our IRC services were restored without issue. Hat tip to our sysops who made this happen so smoothly! --martyb]

Linode, which hosts our servers, is rolling out fixes for the Meltdown/Spectre bugs. This necessitates a hard reboot of their servers, and that means any guest servers will be down while this happens. beryllium is scheduled for a reboot with a two-hour window starting at 2018-01-17 07:00 AM UTC (02:00 AM EST). The outage should be relatively brief — a matter of just a few minutes.

We expect this will cause our IRC (Internet Relay Chat) service to be unavailable. We do not anticipate any problems, but if things go sideways, I'm sure the community will find a way to let us know via the comments.

Planning ahead, we have learned that lithium, sodium, and boron are all scheduled for a reboot at on 2018-01-18 at 09:00 AM UTC.

We appreciate your understanding and patience as we strive to keep the impact to the site to a minimum.

[TMB Note]: Sodium is our currently configured load balancer and we weren't given enough notice to switch to Magnesium (DNS propagation can take a while), so expect ten minutes or less of site downtime. Or temporarily add 23.239.29.31 to your hosts file if ten minutes is more than you can wait.

Previously: Scheduled SN Reboots Due to Meltdown and Spectre; 2-Hour Window Starts: Fri 2018-01-12 @ 10:00:00UTC


Original Submission

Display Options Threshold/Breakthrough

Reply to Article

Mark All as Read

Mark All as Unread

The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
(1)
  • (Score: 0) by Anonymous Coward on Thursday January 11, @09:17PM (12 children)

    by Anonymous Coward on Thursday January 11, @09:17PM (#621092)

    Why in the world would it take that long to reboot?!

    • (Score: 0) by Anonymous Coward on Thursday January 11, @09:22PM (2 children)

      by Anonymous Coward on Thursday January 11, @09:22PM (#621094)

      Does this mean Soylent is going to be 10% slower?

      • (Score: 5, Informative) by The Mighty Buzzard on Thursday January 11, @09:38PM (1 child)

        Given our database load, almost certainly. I'm not especially concerned though. I mean we cut comment rendering time by like 75% with the last big update, so we're still damned fast even with a 10% hit.

        --
        We've got #BieberFever [soylentnews.org]!
        • (Score: -1, Flamebait) by Anonymous Coward on Thursday January 11, @09:54PM

          by Anonymous Coward on Thursday January 11, @09:54PM (#621123)

          O Mightie Uzzard, let me pay you what you deserve in compensation for your self-serving work: one ass-nugget, fresh and hot, dropped out of my inflamed anus.

    • (Score: 0) by Anonymous Coward on Thursday January 11, @09:24PM

      by Anonymous Coward on Thursday January 11, @09:24PM (#621095)

      It requires work to compromise systems, I mean really you expect the NSA to work through lunch??!!!

    • (Score: 0) by Anonymous Coward on Thursday January 11, @09:26PM (2 children)

      by Anonymous Coward on Thursday January 11, @09:26PM (#621100)

      failure to read...

      > There is a two hour window for these reboots starting on Friday January 12th at 10:00AM UTC.
      > Reboots should take on the order of about 10 minutes per server.

      • (Score: 0) by Anonymous Coward on Thursday January 11, @09:33PM (1 child)

        by Anonymous Coward on Thursday January 11, @09:33PM (#621105)

        Why in the world would it take that long to reboot?!

        • (Score: 3, Informative) by martyb on Thursday January 11, @10:06PM

          by martyb (76) Subscriber Badge on Thursday January 11, @10:06PM (#621130) Journal

          From the parent comment:

          Why in the world would it take that long to reboot?!

          FTFS:

          Reboots should take on the order of about 10 minutes per server.

          The key part of that sentence is "on the order of" as in order-of-magnitude (i.e. power of 10):

          • So, about a minute? Doubt it; would probably take more than that.
          • Well, how about 10 minutes? Yep, someplace around there, give or take, likely less, but not as short as one minute.
          • As much as 100 minutes? Heck no, that's a whole 'nuther order of magnitude more than what it should take.

          Not only does the operating system of our server get rebooted, but all of the attendant processes that rehash (the code that runs the site) depends on, such as mysql, apache, nginx, etc.

          Does that help?

          --
          Wit is intellect, dancing.
    • (Score: 2) by The Mighty Buzzard on Thursday January 11, @09:33PM

      That's just the window when it'll be happening. It should only take a few minutes for the actual reboot. And I'll go in and tweak the load balancer so that all traffic goes to hydrogen before it happens so everyone can still get to and make use of the site though.

      What won't be working during the actual reboot: comment counts will not update, messages will not be delivered, the rss/atom feeds will not update, and we won't be able to find out a payment was processed if one gets made. That's all the relevant stuff I can think of off the top of my head since most of our slashd (run on a schedule) stuff is daily and runs shortly after midnight UTC. Everything that didn't get done while fluorine is rebooting should happen shortly after it comes back up though, including payment processing.

      --
      We've got #BieberFever [soylentnews.org]!
    • (Score: 1) by Sulla on Thursday January 11, @09:57PM (3 children)

      by Sulla (5173) on Thursday January 11, @09:57PM (#621125) Journal

      It happens in the middle of TheMightyBuzzard's nap time so we have to wait for him to bring it back up.

      --
      I post without karma bonus, you should too
      • (Score: 0) by Anonymous Coward on Thursday January 11, @10:06PM (2 children)

        by Anonymous Coward on Thursday January 11, @10:06PM (#621129)

        s/nap time/fishing time

        FTFY

  • (Score: 4, Informative) by Justin Case on Thursday January 11, @09:41PM

    by Justin Case (4239) Subscriber Badge on Thursday January 11, @09:41PM (#621111)

    You Stewards of Soylentry keep doing a great job. It is noticed and appreciated, though probably not enough said.

    --
    When the government can crack your encryption, criminals can crack your encryption and drain your bank account.
  • (Score: -1, Troll) by Anonymous Coward on Thursday January 11, @09:45PM (14 children)

    by Anonymous Coward on Thursday January 11, @09:45PM (#621116)

    Just take ShitStainN down permanently and never come back.

    • (Score: 4, Touché) by maxwell demon on Thursday January 11, @10:04PM (3 children)

      by maxwell demon (1608) Subscriber Badge on Thursday January 11, @10:04PM (#621128) Journal

      and never come back.

      You first.

      --
      The Tao of math: The numbers you can count are not the real numbers.
      • (Score: -1, Offtopic) by Anonymous Coward on Thursday January 11, @10:12PM (2 children)

        by Anonymous Coward on Thursday January 11, @10:12PM (#621137)

        But if I never come back, how will I see the glorious domain-parking page that will replace it when ShitStain is gone?

        • (Score: 3, Interesting) by Anonymous Coward on Thursday January 11, @10:27PM (1 child)

          by Anonymous Coward on Thursday January 11, @10:27PM (#621148)

          Let's see if Slashdot reports our death or we report their death first.

          • (Score: 0) by Anonymous Coward on Friday January 12, @01:27PM

            by Anonymous Coward on Friday January 12, @01:27PM (#621356)

            I'll only believe it when Netcraft confirms it.

    • (Score: 2, Insightful) by Anonymous Coward on Thursday January 11, @10:36PM (9 children)

      by Anonymous Coward on Thursday January 11, @10:36PM (#621151)

      Just take ShitStainN down permanently and never come back.

      One has to wonder about a poster who, saying the site is so bad it should never come back up, returns — again and again — to that same site.

      When I dine at a restaurant and have a poor experience, I ask for the manager and politely explain what I experienced so that they have an opportunity to (1) be made aware of it and (2) to have an opportunity to make amends for the experience. After all, we are all human and occasionally things just go wrong, or happen in unexpected ways. If they make a satisfactory response, I will return there. Otherwise, I do something really outlandish... I go someplace else.

      If there is something genuinely amiss with the site's operation, please explain it so the staff may have an opportunity to address it (NB: "I want a pony" ain't gonna happen). If it is unacceptable, you are free to read and comment on other sites.

      • (Score: 3, Touché) by The Mighty Buzzard on Thursday January 11, @11:31PM (2 children)

        Everyone needs a hobby.

        --
        We've got #BieberFever [soylentnews.org]!
        • (Score: 2) by martyb on Friday January 12, @12:34AM (1 child)

          by martyb (76) Subscriber Badge on Friday January 12, @12:34AM (#621202) Journal

          Everyone needs a hobby.

          So, Tilting at WindmillsSoylentNews!

          --
          Wit is intellect, dancing.
          • (Score: 0) by Anonymous Coward on Friday January 12, @12:42AM

            by Anonymous Coward on Friday January 12, @12:42AM (#621204)

            Onward, noble Rocinante!

      • (Score: 1, Insightful) by Ethanol-fueled on Friday January 12, @02:14AM (3 children)

        by Ethanol-fueled (2792) Subscriber Badge on Friday January 12, @02:14AM (#621231) Homepage Journal

        What an asshole, you must be a retired baby-boomer. What, you like to be the big man at the Wednesday-night singles romp at the local Black Angus?

        People like you are the reason why cooks piss in the jars of bulk pickles and scratch their nuts before plating your food.

        • (Score: 0) by Anonymous Coward on Friday January 12, @04:43AM (1 child)

          by Anonymous Coward on Friday January 12, @04:43AM (#621259)

          If they don't want me to bitch to the manger, all they have to do is not fuck up in the first place.

          • (Score: 3, Funny) by kazzie on Friday January 12, @04:52AM

            by kazzie (5309) Subscriber Badge on Friday January 12, @04:52AM (#621260)

            If they don't want me to bitch to the manger, all they have to do is not fuck up in the first place.

            I'd love to see you in a nativity play with that language...

        • (Score: 4, Informative) by The Mighty Buzzard on Friday January 12, @05:16AM

          To paraphrase Freud: sometimes a nut scratch is just a nut scratch. The boys are gonna itch whether you hold malice towards someone or not. They're balls. That's what balls do.

          --
          We've got #BieberFever [soylentnews.org]!
      • (Score: 3, Touché) by isostatic on Friday January 12, @11:11AM (1 child)

        by isostatic (365) on Friday January 12, @11:11AM (#621333) Journal

        NB: "I want a pony" ain't gonna happen

        Go to https://soylentnews.org/my/homepage [soylentnews.org]
        Change theme to "OMG PWNIES"

        • (Score: 2) by AssCork on Friday January 12, @10:24PM

          by AssCork (6255) Subscriber Badge on Friday January 12, @10:24PM (#621582) Journal

          Me: follows link, changes theme
          Me: MY EYES!!! THE PINK...IT BURNS!!!
          Me: reviews themes
          Me: Oh neat a nighttime theme!
          Me: click, clicks 'save'
          Me: *F5* [ strange feeling begins. ]
          Me: Strange, that typically only emerges on other sites ending in 'Hub', 'Tube', and 'Hamster'
          Me: *F5* on all SN tabs
          Me: [feeling intensifies]

  • (Score: 2) by stretch611 on Friday January 12, @02:12PM

    by stretch611 (6199) on Friday January 12, @02:12PM (#621376)

    Too late to inject my exploit into your front end servers now...

    Hopefully I'll get it on to your back end servers before they're fixed 😜

  • (Score: 2) by hendrikboom on Friday January 12, @05:20PM (1 child)

    by hendrikboom (1125) on Friday January 12, @05:20PM (#621453) Homepage

    Just possibly, instead of rebooting, they also have to correct the problem.

    • (Score: 0) by Anonymous Coward on Friday January 12, @08:45PM

      by Anonymous Coward on Friday January 12, @08:45PM (#621551)

      Usually franchises reboot first only further down the line, perhaps after a hiatus. And the second movie is never as good as the first.

(1)