Researchers propose a new approach for dismantling online hate networks
How do you get rid of hate speech on social platforms? Until now, companies have generally tried two approaches. One is to ban individual users who are caught posting abuse; the other is to ban the large pages and groups where people who practice hate speech organize and promote their noxious views.
But what if this approach is counterproductive? That's the argument in an intriguing new paper out today in Nature from Neil Johnson, a professor of physics at George Washington University, and researchers at GW and the University of Miami. The paper, "Hidden resilience and adaptive dynamics of the global online hate ecology," explores how hate groups organize on Facebook and Russian social network VKontakte — and how they resurrect themselves after platforms ban them.
As Noemi Derzsy writes in her summary in Nature:
Johnson et al. show that online hate groups are organized in highly resilient clusters. The users in these clusters are not geographically localized, but are globally interconnected by 'highways' that facilitate the spread of online hate across different countries, continents and languages. When these clusters are attacked — for example, when hate groups are removed by social-media platform administrators (Fig. 1) — the clusters rapidly rewire and repair themselves, and strong bonds are made between clusters, formed by users shared between them, analogous to covalent chemical bonds. In some cases, two or more small clusters can even merge to form a large cluster, in a process the authors liken to the fusion of two atomic nuclei. Using their mathematical model, the authors demonstrated that banning hate content on a single platform aggravates online hate ecosystems and promotes the creation of clusters that are not detectable by platform policing (which the authors call 'dark pools'), where hate content can thrive unchecked.
[...] The researchers advocate a four-step approach to reduce the influence of hate networks.
- Identify smaller, more isolated clusters of hate speech and ban those users instead.
- Instead of wiping out entire small clusters, ban small samples from each cluster at random. This would theoretically weaken the cluster over time without inflaming the entire hive.
- Recruit users opposed to hate speech to engage with members of the larger hate clusters directly. (The authors explain: "In our data, some white supremacists call for a unified Europe under a Hitler-like regime, and others oppose a united Europe. Similar in-fighting exists between hate-clusters of the KKK movement. Adding a third population in a pre-engineered format then allows the hate-cluster extinction time to be manipulated globally.)
- Identify hate groups with competing views and pit them against one another, in an effort to sow doubt in the minds of participants.
Hidden resilience and adaptive dynamics of the global online hate ecology[$], Nature (DOI: 10.1038/s41586-019-1494-7)
(Score: 5, Informative) by Thexalon on Tuesday August 27 2019, @05:27PM (14 children)
The people who have written extensive manifestos either declaring themselves to be Nazis or sharing similar ideology to Nazis, and then gone on shooting rampages. For example, the guy who shot up a synagogue in Pittsburgh did so because he was a Nazi, and he was very clear on that point. So was the guy who killed a bunch of people in a Walmart for being brown, and the guy who murdered his own sibling and a bunch of their friends and random bystanders because said sibling was dating a black guy.
I know you don't want to associate your own political ideology with mass murder, because it looks bad. But the fact of the matter is that you have people matching your ideology who have been committing mass murders, and instead of saying "mass murder is wrong, period", you've instead tried to pretend it's not happening.
The only thing that stops a bad guy with a compiler is a good guy with a compiler.
(Score: 0, Disagree) by Anonymous Coward on Tuesday August 27 2019, @05:44PM (8 children)
It's happening, but not on any significant scale.
(Score: 3, Informative) by PartTimeZombie on Tuesday August 27 2019, @10:23PM (7 children)
50 people murdered in Christchurch in one afternoon sounds significant to me.
Fewer than 6 million I suppose, but you need concentration camps for that sort of scale.
(Score: 1, Insightful) by Anonymous Coward on Tuesday August 27 2019, @11:06PM (6 children)
No, in a world with billions of people (and over 300 million in the US), that is insignificant. More so if you look at the total deaths per year from such events, so even though 50 dead in one attack sounds like a lot, it isn't in the grand scheme of things. Even 9/11 was insignificant, to the point where the damage caused to ourselves by us responding to 9/11 was many thousands of times worse than the attack itself, and the damage from that response just continues on. That's what happens when you react to terrorism by taking away people's liberties.
(Score: 2) by PartTimeZombie on Wednesday August 28 2019, @12:30AM (1 child)
Sorry, but that's wrong and also wrong.
The Christchurch shootings didn't happen in a world of billions of people, and didn't happen in the US at all.
It happened in a city of fewer than 300,000 people, which has a murder rate of about 5 per year.
So, to recap. One Nazi did 10 years worth of murders in a small city in one afternoon.
(Score: 2, Informative) by Anonymous Coward on Wednesday August 28 2019, @05:49AM
Christchurch is a perfect counter-example to your argument. The person who shot up the mosque there was not even from the same country. He chose that location, traveled to it, and then shot it up. It's the exact same thing with El Paso where the shooter was again not a native, somewhat ironically. You're looking at a literally global phenomena and you're left with a handful of incidents. I don't think people understand the scale of violence in the past.
Let's look at two things, 9/11 and the Holocaust. 9/11 killed 2,996 people including the 19 attackers. The latest figure for the Holocaust is around 6 million. The Holocaust would have been equivalent to a 9/11 scale of death happening every single day for 2023 days. That's a 9/11 scale event each and every day for more than 5 years. And that actually dramatically understates the damage since populations have increased dramatically since then. If you scale these events up to modern population sizes you end up with the Holocaust being equivalent to a 9/11 scale event happening each and every day for more than 18 years. That is, a child who is just born will reaching voting age with a 9/11 event happening literally every single day of his life - against a single demographic.
To hyperbolize these idiots with a manifesto and a gun as anything more than that is just absurd. It's just the media trying to rile up fear and emotions for clicks.
(Score: 3, Touché) by Azuma Hazuki on Wednesday August 28 2019, @01:38AM (3 children)
Tell me, would it be "significant" enough if it was your family it happened to, or you?
I am "that girl" your mother warned you about...
(Score: 3, Touché) by PartTimeZombie on Wednesday August 28 2019, @02:35AM (2 children)
The worst year New Zealand has ever had for murders was 1987, with 24.
A Nazi from Australia doubled that in one afternoon, but A/C idiot above thinks that is "not significant".
Sometimes the level of debate on this site is disappointing.
Here's link to the Police's list. [police.govt.nz]
(Score: -1, Flamebait) by Anonymous Coward on Wednesday August 28 2019, @03:17AM (1 child)
Just wait until the muzzies hit critical mass there. You'll reminisce wistfully of the old days when there was only 50 in a mass killing event.
(Score: 2) by rylyeh on Wednesday August 28 2019, @04:25AM
Seriously son - the 'muzzies'!?!?
The only Muzzy I know eats clocks.
You going to need a gallon of 'Preparation H' to soothe that inflamed territorial imperative.
"a vast crenulate shell wherein rode the grey and awful form of primal Nodens, Lord of the Great Abyss."
(Score: 0) by Anonymous Coward on Tuesday August 27 2019, @06:19PM
The Walmart incident is highly suspect in many ways, including the alleged shooter's political views.
The Ohio shooter was antifa supporter, his alleged "racism" does not fit your narrative, unless your narrative is that all whites are bad.
The last two(mosque and synagogue) are only connected in so much as "nazism" overlaps with Eco-fascism and state communism and of course that they were white and anti immigration. Government sponsored terrorism is likely to use white actors in the US or New Zealand, unless they are trying to frame the immigrant groups, but since the governments are captured by enemies they do the opposite.
Shooters need to do their duty and clean up their own criminal governments before blaming the ""refugees".
(Score: 1) by khallow on Tuesday August 27 2019, @07:07PM
So not many people, right? Speaking of cowardice, why is it that we're supposed to get all worked up over a few dastardly deeds? Law enforcement has that all fixed. You can't keep the crazy people from being crazy, but you can jail for very long periods of time people who think that killing a few people here and there is ok. It's not going to be perfect, but it will get nazi rampages to below lightning strikes as a cause of death.
(Score: 2) by jmorris on Tuesday August 27 2019, @10:21PM (2 children)
Citation needed. Show me a "Nazi" shooter. The goof that shot up the synagogue a year or so back might qualify, dunno really. I was on Gab, where he supposedly was, but never saw anything from him and, like every other social media :( they purged every hint he ever existed so fast nobody managed to save much. All we really know is his supposed final post of "screw your optics, I'm going in" which kinda implies somebody had been telling him it might be a bad idea to do something rash, but we don't really know the details of that final thread. And despite full cooperation with the Feds, Gab was deplatformed yet again over the incident. The M.O. for that one is at least consistent with a Nazi. But one incident does not a pattern make.
Christchurch guy's manifesto is super suspicious and is missing the Nazi markers other than "Black Sun" inspired cover art. Nazis can generally be counted on to hate Jews, he didn't, he had in fact visited Israel recently. He livestreamed his rampage on Facebook. Facebook was not deplatformed.
El Paso shooter was confused, more "Yang Gang" than Nazi except he was really worked up over immigration, seemed to be inspired by the Christchurch shooter somehow. Again, that manifesto is also super suspicious. Appears to have been posted to Instagram and cross posted to 8chan, where it was removed after around fifteen minutes. 8chan was of course deplatformed, Instagram not so much. But the day of the event I was lurking 8chan and they were reporting the story faster then even Drudge, in fact it really looked like Drudge was also lurking and posting from 8chan's boards that day. Nothing gets em fired up on the chans like a "Happening."
Then of course there was the Dayton shooter. He was Antifa and generally messed up so that story went into the memory hole since it wasn't politically useful. The shooter the week before also turned out to not be very politically useful, so also memory holed. Seeing a pattern yet? The only one I see is in which random shooters get massive media coverage and which social media gets deplatformed.
(Score: 3, Insightful) by Thexalon on Tuesday August 27 2019, @10:52PM (1 child)
I see no reason to supply evidence that you're already determined to declare "super suspicious" if it happens to say something you don't want to admit.
The only thing that stops a bad guy with a compiler is a good guy with a compiler.
(Score: 1, Troll) by jmorris on Tuesday August 27 2019, @11:14PM
Have you actually read the two manifestos? There was a pretty good discussion here back when Christchurch was news. I wasn't the only one smelling a rat. We know the accused did it of course, he livestreamed it, but whether he wrote that manifesto alone is dubious. If he did have help they author is still out there somewhere. El Paso is just weird, that guy ain't right. Assuming he actually wrote it or posted it, lot of doubt on that question. And he wanted to shoot up illegals, so he drives from Dallas to El Paso? Have you ever been in Dallas? Hello, it was equally target rich. His manifesto is silent on why he felt he needed to go to Beta Male O'Roark's hometown to shoot up a Walmart. He lived so we might at least get an answer to some of those questions eventually.