Stories
Slash Boxes
Comments

SoylentNews is people

posted by janrinok on Monday July 17, @11:22AM   Printer-friendly

A placebo effect can make users overconfident when they think tech is helping them:

A new study suggests that a placebo effect is at play when people expect their performance to be enhanced by augmentation technologies, such as artificial intelligence (AI). The researchers found that individuals with high expectations of these technologies engage in riskier decision-making, which could be a problem as people adopt these technologies without properly understanding their benefits and limits.

Augmentation technologies boosting our physical, cognitive, or sensory performance have become commonplace. Some are so widely in use that they've become invisible – spellcheck, for example – and new technologies are emerging that could push our abilities beyond human limits, like exoskeletons and AI-based vision-enhancement. But the hype around these technologies also builds expectations, which could lead people to change their behaviour.

'Individuals are more inclined to take risks when they believe they are enhanced by cutting-edge technologies like AI or brain-computer interfaces,' says Robin Welsch, assistant professor at Aalto University. 'This occurs even if no actual enhancement technology is involved, indicating that it's about people's expectations rather than any noticeable improvement. The findings also imply that a strong belief in improvement, based on a fake system, can alter decision-making.'

[...] 'The hype surrounding these technologies skews people's expectations,' says Steeven Villa, doctoral researcher at LMU Munich. 'It can lead people to make riskier decisions and favourable user evaluations, which can have real consequences.'

[...] 'AI-based technologies that enhance users are increasingly common and play a role in real-life decisions that impact people's lives, well-being, confidence, and safety.' says Thomas Kosch, professor at HU Berlin. 'To ensure the effectiveness of new technologies beyond the hype, placebo-controlled studies are necessary for accurate evaluation and validation to tell apart snake-oil from real innovation.'

Journal Reference:
Steeven Villa, Thomas Kosch, Felix Grelka, Albrecht Schmidt, Robin Welsch (2023). The placebo effect of human augmentation: Anticipating cognitive augmentation increases risk-taking behavior, Computers in Human Behavior, Volume 146. doi: https://doi.org/10.1016/j.chb.2023.107787


Original Submission

 
This discussion was created by janrinok (52) for logged-in users only. Log in and try again!
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 2, Insightful) by khallow on Monday July 17, @01:39PM (1 child)

    by khallow (3766) Subscriber Badge on Monday July 17, @01:39PM (#1316458) Journal
    Then again, with the hype on AI, we have had a few stories about such overconfidence already. Hmmm, here [soylentnews.org] and here [soylentnews.org] for glaring examples.
    Starting Score:    1  point
    Moderation   +1  
       Insightful=1, Total=1
    Extra 'Insightful' Modifier   0  

    Total Score:   2  
  • (Score: 4, Interesting) by HiThere on Monday July 17, @01:51PM

    by HiThere (866) on Monday July 17, @01:51PM (#1316459) Journal

    He wasn't claiming that it didn't happen with AI. It does. It's just that it happens all over the place. In the drug industry it's called the placebo effect...and it's basically the same thing. (And, IIUC, it even happens to existing AIs. I think it's called "model blindness" in that area. But this is basically a guess, as I only read a brief overview.)

    --
    Javascript is what you use to allow unknown third parties to run software you have no idea about on your computer.