Stories
Slash Boxes
Comments

SoylentNews is people

posted by Fnord666 on Wednesday April 29 2020, @11:40AM   Printer-friendly
from the fun-with-words dept.

Arthur T Knackerbracket has found the following story:

MIT researchers have built a system that fools natural-language processing systems by swapping words with synonyms:

The software, developed by a team at MIT, looks for the words in a sentence that are most important to an NLP classifier and replaces them with a synonym that a human would find natural. For example, changing the sentence "The characters, cast in impossibly contrived situations, are totally estranged from reality" to "The characters, cast in impossibly engineered circumstances, are fully estranged from reality" makes no real difference to how we read it. But the tweaks made an AI interpret the sentences completely differently.

The results of this adversarial machine learning attack are impressive:

For example, Google's powerful BERT neural net was worse by a factor of five to seven at identifying whether reviews on Yelp were positive or negative.

The paper:

-- submitted from IRC


Original Submission

 
This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 4, Insightful) by DannyB on Wednesday April 29 2020, @03:17PM (4 children)

    by DannyB (5839) Subscriber Badge on Wednesday April 29 2020, @03:17PM (#988206) Journal

    that fools natural-language processing systems by swapping words with synonyms

    If wee replace they're words with homonyms wee wood bee sew much less board. AIs wood be band from reading hour text. It wood caws a hire chants of them two miss reed. But peephole wood grown and mini size wood be herd because they our to dents too tri two reed it allowed. AIs in discussed wood cry Fowl! and sensor hour text and cawl us cereal killers. Wee wood halve two chute the AIs, being unable two convents them of hour superior waze.


    Looser Loser translation:
    If we replace their words with homonyms we would be so much less bored. AIs would be banned from reading our text. It would cause a higher chance of them to misread. But people would groan and many sighs would be heard because they are too dense to try to read it aloud. AIs in disgust would cry Foul! and censor our text and call us serial killers. We would have to shoot the AIs, being unable to convince them of our superior ways.

    --
    To transfer files: right-click on file, pick Copy. Unplug mouse, plug mouse into other computer. Right-click, paste.
    Starting Score:    1  point
    Moderation   +2  
       Insightful=2, Total=2
    Extra 'Insightful' Modifier   0  
    Karma-Bonus Modifier   +1  

    Total Score:   4  
  • (Score: 0) by Anonymous Coward on Wednesday April 29 2020, @03:28PM (3 children)

    by Anonymous Coward on Wednesday April 29 2020, @03:28PM (#988212)

    It sounds like a dodgy New Zealand accent.

    • (Score: 2) by DannyB on Wednesday April 29 2020, @04:34PM (2 children)

      by DannyB (5839) Subscriber Badge on Wednesday April 29 2020, @04:34PM (#988235) Journal

      It's still fun when trapped at home in times of emergent seas.

      --
      To transfer files: right-click on file, pick Copy. Unplug mouse, plug mouse into other computer. Right-click, paste.
      • (Score: 1, Funny) by Anonymous Coward on Wednesday April 29 2020, @06:19PM (1 child)

        by Anonymous Coward on Wednesday April 29 2020, @06:19PM (#988279)

        Shhh, you can't talk about rising sea levels.

        Folks get all gun-totin' when you mention climate change.

        • (Score: 2) by DannyB on Wednesday April 29 2020, @08:42PM

          by DannyB (5839) Subscriber Badge on Wednesday April 29 2020, @08:42PM (#988325) Journal

          Rising C levels demand more efishient compilers. More efishency is wanted for every porpoise.

          --
          To transfer files: right-click on file, pick Copy. Unplug mouse, plug mouse into other computer. Right-click, paste.