Stories
Slash Boxes
Comments

SoylentNews is people

posted by chromas on Wednesday July 25 2018, @12:40PM   Printer-friendly
from the Oh-yeah?-Yeah! dept.

Averting Toxic Chats: Computer Model Predicts When Online Conversations Turn Sour

The internet offers the potential for constructive dialogue and cooperation, but online conversations too often degenerate into personal attacks. In hopes that those attacks can be averted, researchers have created a model to predict which civil conversations might take a turn and derail.

After analyzing hundreds of exchanges between Wikipedia editors, the researchers developed a computer program that scans for warning signs in the language used by participants at the start of a conversation -- such as repeated, direct questioning or use of the word "you" -- to predict which initially civil conversations would go awry.

Early exchanges that included greetings, expressions of gratitude, hedges such as "it seems," and the words "I" and "we" were more likely to remain civil, the study found.

"We, as humans, have an intuition of whether a conversation is about to go awry, but it's often just a suspicion. We can't do it 100 percent of the time. We wonder if we can build systems to replicate or even go beyond this intuition," Danescu-Niculescu-Mizil[*] said.

The computer model, which also considered Google's Perspective, a machine-learning tool for evaluating "toxicity," was correct around 65 percent of the time. Humans guessed correctly 72 percent of the time.

[...] The study analyzed 1,270 conversations that began civilly but degenerated into personal attacks, culled from 50 million conversations across 16 million Wikipedia "talk" pages, where editors discuss articles or other issues. They examined exchanges in pairs, comparing each conversation that ended badly with one that succeeded on the same topic, so the results weren't skewed by sensitive subject matter such as politics.

[*] Cristian Danescu-Niculescu-Mizil: assistant professor of information science and co-author of the paper Conversations Gone Awry: Detecting Early Signs of Conversational Failure. (pdf)

The technique sounds useful for non-internet conversations, too... is there an app for that?


Original Submission

 
This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 0) by Anonymous Coward on Wednesday July 25 2018, @02:49PM (1 child)

    by Anonymous Coward on Wednesday July 25 2018, @02:49PM (#712382)

    It's wikipedia. Toxicity is expected.

  • (Score: 2) by takyon on Wednesday July 25 2018, @03:16PM

    by takyon (881) <reversethis-{gro ... s} {ta} {noykat}> on Wednesday July 25 2018, @03:16PM (#712404) Journal

    Every single one of the exchanges in the quiz from Wikipedia. So you have to pick which one will become more toxic. :-)

    --
    [SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]