Stories
Slash Boxes
Comments

SoylentNews is people

Meta
posted by martyb on Friday June 25 2021, @12:50PM   Printer-friendly
from the The-Mod-Squad dept.

There has been some discussion about moderation on this site leading to some misconceptions and misstatements. This story is an attempt to set things straight. It lays out the historical underpinnings for moderation, history of its implementation on Slashdot, and its later refinement on SoylentNews.

Before that, though, I am going to take this opportunity to thank fnord666 who is out Alternate Editor-in-Chief. I could not handle the load alone and his efforts have made a huge difference! Further, please join me in thanking him as he reached a new milestone: over 6,500 stories posted to the site! Many a late night or rare free moment has been generously given to the site. Teamwork++!

History:
The code for this site is a fork of code written for Slashdot. In that site's early days, it was apparent that some comments were much more interesting and informative than others. It was just as apparent that some users would just as gleefully troll the community. Moderation was conceived as a way to sift the wheat from the chaff and help users more easily avoid the "lesser" comments and more easily find the "gems".

Further, to encourage posting "good" comments, Karma was introduced. "Good" comments earned Karma; "bad" comments lost Karma. Moderation was a mechanism by which Karma could be allocated.

Slashdot experimented with several ways to moderate comments. First, it was just the staff who could moderate. Soon, there were too many comments to keep up, so a select group of members from the community were invited to moderate comments. Again, that failed to scale up, so those who had been selected were invited to recommend still other users to moderate. And, again, there were scaling issues.

Solution: make Mod Points (modpoints) available to every registered user in good standing and who indicated in their preferences that they were willing to moderate.

Originally, mod points were handed out randomly and expired after something like 6 hours: "Use 'em or lose 'em".

For the most part, that seemed to work. But there were some perceived issues and meta-moderation was implemented and introduced — moderate the moderations. Unfortunately, it experienced many of the same issues that it was supposed to rectify with comments, just one level abstracted. Further, it was unwieldy and when all was said and done, didn't work all that well, anyway.

Early Tweaking:
Such was the state of things when SoylentNews started. Well sort of. The code base we started with was not current and the meta-moderation code was broken. So much so, that meta-moderation was ripped out of the code just so regular moderation could be made to work. With that behind us, we finally we had a working moderation system on our site. Yay!

That worked okay for a while, but we found ourselves with complaints from many users that they wanted to moderate and lacked mod points. Nice problem to have, right? This was combined with many more comments than moderations. It was thought that we needed more mod points made available to the community. So, after unsuccessfully tweaking the mod point allocation algorithm, it was decided to just not expire mod points until day's end. Every user in good standing got 5 mod points each morning (00:10 UTC) and those were available until day's end whereupon any remaining modpoints were reset and a new set of 5 of modpoints were allocated.

That helped! But jerks will be jerks.

Mod Bombs:
We started to run into problems with "mod bombs" where one user "A" would apply all 5 of their mod points to downmod one other user "B". So code was written to allow checking for such moderations. Staff could generate a report and find such activity. It was decided that:

If you used ALL of your modpoints to downmod ONE user, that was a modbomb. IOW, 5 downmods bad; 4 downmods were permitted.

Initially, anyone who "modbombed" was manually given a "timeout". The first time earned a one month suspension of moderation privileges. A second occurrence earned a six month suspension.

Later, because there were still many more comments than moderations, the number of modpoints allocated to each registered user having good Karma was increased from 5 to 10 per day. The modbomb threshold was, however, kept the same: 4 downmods was still okay, 5 (or more) downmods to the same user was "bad".

A complication arose in that there is no easy way for users to keep track of how many downmods they had made on one other user. User "A" may do 3 downmods of user "B" in the morning and 4 down mods of other (unrelated) users. In the afternoon they might perform 2 more downmods of user "B". Purely unintentional transgression. When you only have 5 mod points it was reasonable to assume that a user could mentally track how many times they downmodded a single user in one day. With 10 daily mod points available, that became less reasonable.

So, along with the allocation of 10 modpoints per day (easy) it was intended to have code written that would kick in when processing moderations: when the threshold was exceeded, the excess downmods would be automatically rejected. And that is still the intent.

The upshot of all that is that when checking for modbombs, we no longer give a "timeout" for 5 downmods against a single user in one day. We just revert the excess mods. We do take note of repeated excesses and are fully prepared to issue a "timeout" when warranted. (e.g. 8 downmods in one day, or several days in close proximity targeting the same user. This is not done unilaterally but rather in consultation with other staff for confirmation.)

Sock Bombs:
First, there some who failed to take the hint that, maybe, they should take a look at what they were posting when they received repeated downmods. We are a community, not your personal soapbox. So, they created new ("sock puppet") accounts and proceeded to upmod their own comments, aka a "sockbomb". Staff have ways to note such behavior based on the IPID and SUBNETID that is recorded with every comment and every moderation. We try to give the benefit of the doubt. But, certain patterns do become apparent and are not tolerated. Upmodding your own comment is grounds for an immediate moderation ban.

Second, just as there is a limit on how many downmods can be targeted at one user in a day, so there is a limit on upmods. The same limits apply, each user "A" is limited to 4 upmods of user "B" in a given day, just like for "modbombs". Again with the caveat of no up-mods of your own account..

Summary:
Our experience is that the current system could stand some refinement, automation of transgression detection and mitigation is in plan (but it will be a while), but for the most part, what we have works well in the vast majority of cases. In short, Wheaton's Law still applies: "don't be a dick". Following that seems to work the best for the most. (With apologies to anyone named Richard. =)


Original Submission

 
This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 5, Insightful) by turgid on Friday June 25 2021, @02:13PM (9 children)

    by turgid (4318) Subscriber Badge on Friday June 25 2021, @02:13PM (#1149087) Journal

    There are many calm, rational, informative and insightful things posted by AC these days. It would be a pity to lose that.

    Starting Score:    1  point
    Moderation   +4  
       Insightful=4, Total=4
    Extra 'Insightful' Modifier   0  
    Karma-Bonus Modifier   +1  

    Total Score:   5  
  • (Score: 0) by Anonymous Coward on Friday June 25 2021, @02:43PM

    by Anonymous Coward on Friday June 25 2021, @02:43PM (#1149100)

    you're playing with fire...

  • (Score: 2, Funny) by Anonymous Coward on Friday June 25 2021, @02:44PM

    by Anonymous Coward on Friday June 25 2021, @02:44PM (#1149102)

    There are many calm, rational, informative and insightful things posted by AC these days.

    Oh, what has the world became these days. ACs post "calm, rational, informative and insightful things", hackers no longer abide by rfc3514.

  • (Score: 5, Insightful) by janrinok on Friday June 25 2021, @03:13PM (6 children)

    by janrinok (52) Subscriber Badge on Friday June 25 2021, @03:13PM (#1149114) Journal

    I agree, and I for one would be very reluctant to go down the path of stopping ACs from posting at all. As another has just pointed out, creating another 'live' account is simple to do and we would be back to square 1, but we would be giving those ACs mod points too.

    One solution to get around this is that creating a live account still requires an email address, but using that account to post could be delayed by 24/48 hours. There are simple ways of overcoming this too so we just end up in a silly cycle of measure versus countermeasure, which requires a lot of work from the support team.

    The current solution of modding trolls etc downwards is the best solution that anyone has come up with so far, and without a current active dev we cannot today make any code changes to Rehash.

    • (Score: 4, Funny) by Anonymous Coward on Friday June 25 2021, @03:59PM (4 children)

      by Anonymous Coward on Friday June 25 2021, @03:59PM (#1149139)

      The obvious solution is to require all AC accounts to be created from a secure operating system protected by TPM 2.0, like the upcoming Windows 11, and then requiring ACs to send a notarized copy of their passport and/or driver's license in with a sample of their DNA for verification to ensure they haven't been using another AC account.

      • (Score: 2) by turgid on Friday June 25 2021, @05:30PM

        by turgid (4318) Subscriber Badge on Friday June 25 2021, @05:30PM (#1149184) Journal

        Priti Patel, is that you?

      • (Score: 0) by Anonymous Coward on Friday June 25 2021, @05:47PM

        by Anonymous Coward on Friday June 25 2021, @05:47PM (#1149197)

        also the monitor built-in camera needs to be ON when pressing "submit"!

      • (Score: 0) by Anonymous Coward on Saturday June 26 2021, @03:43PM (1 child)

        by Anonymous Coward on Saturday June 26 2021, @03:43PM (#1149660)

        Stop giving social media sitea ideas.

        No
          Wait. Some already do this kind of thing...

        • (Score: 0) by Anonymous Coward on Saturday June 26 2021, @09:23PM

          by Anonymous Coward on Saturday June 26 2021, @09:23PM (#1149752)
          Many employers already do that. But it's so easy to say "the camera isn't working."
    • (Score: 0) by Anonymous Coward on Saturday June 26 2021, @11:24PM

      by Anonymous Coward on Saturday June 26 2021, @11:24PM (#1149782)

      I agree that there is sometimes a need for anonymous postings, so perhaps allow anonymous posts by logged in users...

      When a logged in user wants to post anonymously, they tick an anonymous box and their nick is not shown with the post but any mods should still affect their karma.

      We could have another name displayed for 'logged in anonymous' so that readers can tell the difference between true ACs and logged in ACs.

      All true AC posts would automatically get a low initial mod score and 'logged in AC' postings would get an initial mod points based on the users karma just like a normal post.

      I would hope that this would only need a relatively minor change to the code.