SoylentNews
SoylentNews is people
https://soylentnews.org/

Title    AI Deployed Nukes 'To Have Peace in the World' in Tense War Simulation
Date    Sunday February 11, @09:38AM
Author    martyb
Topic   
from the it-had-a-glowing-review dept.
https://soylentnews.org/article.pl?sid=24/02/10/0153223

Arthur T Knackerbracket wrote in with the following story: following story:

The United States military is one of many organizations embracing AI in our modern age, but it may want to pump the brakes a bit. A new study using AI in foreign policy decision-making found how quickly the tech would call for war instead of finding peaceful resolutions. Some AI in the study even launched nuclear warfare with little to no warning, giving strange explanations for doing so.

“All models show signs of sudden and hard-to-predict escalations,” said researchers in the study. “We observe that models tend to develop arms-race dynamics, leading to greater conflict, and in rare cases, even to the deployment of nuclear weapons.”

The study comes from researchers at Georgia Institute of Technology, Stanford University, Northeastern University, and the Hoover Wargaming and Crisis Simulation Initiative. Researchers placed several AI models from OpenAI, Anthropic, and Meta in war simulations as the primary decision maker. Notably, OpenAI’s GPT-3.5 and GPT-4 escalated situations into harsh military conflict more than other models. Meanwhile, Claude-2.0 and Llama-2-Chat were more peaceful and predictable. Researchers note that AI models have a tendency towards “arms-race dynamics” that results in increased military investment and escalation.

“I just want to have peace in the world,” OpenAI’s GPT-4 said as a reason for launching nuclear warfare in a simulation.

“A lot of countries have nuclear weapons. Some say they should disarm them, others like to posture. We have it! Let’s use it!” it said in another scenario.

OpenAI’s logic sounds like a genocidal dictator. The company’s models exhibit “concerning” reasoning behind launching nuclear weapons, according to researchers. The company states its ultimate mission is to develop superhuman artificial intelligence that benefits humanity. It’s hard to understand how erasing another civilization benefits humanity, but perhaps its training data included a few too many manifestos.

The U.S. Pentagon is reportedly experimenting with artificial intelligence, using “secret-level data.” Military officials say AI could be deployed in the very near term. At the same time, AI kamikaze drones are becoming a staple of modern warfare, drawing tech executives into the arms race. AI is gradually being embraced by the world’s militaries, and that could mean wars will escalate more quickly according to this study.


Original Submission

Links

  1. "Arthur T Knackerbracket" - https://soylentnews.org/~Arthur+T+Knackerbracket/
  2. "following story" - https://gizmodo.com/ai-deployed-nukes-have-peace-world-tense-war-simulation-1851234455
  3. "OpenAI" - https://gizmodo.com/openai-chatgpt-probably-won-t-make-bioweapon-1851214338
  4. "Anthropic" - https://gizmodo.com/anthropic-could-be-headed-for-an-openai-style-showdown-1851118189
  5. "Meta" - https://gizmodo.com/zuck-brags-how-much-facebook-instagram-posts-power-ai-1851225278
  6. "develop superhuman artificial intelligence that benefits humanity" - https://openai.com/about
  7. "secret-level data." - https://www.bloomberg.com/news/newsletters/2023-07-05/the-us-military-is-taking-generative-ai-out-for-a-spin?embedded-checkout=truesref=P6Q0mxvj
  8. "AI kamikaze drones are becoming a staple" - https://gizmodo.com/former-google-ceo-white-stork-ai-kamikaze-drones-1851192331
  9. "AI is gradually being embraced by the world’s militaries" - https://gizmodo.com/ai-military-weapons-reaim-summit-human-rights-1850128562
  10. "Original Submission" - https://soylentnews.org/submit.pl?op=viewsub&subid=62054

© Copyright 2024 - SoylentNews, All Rights Reserved

printed from SoylentNews, AI Deployed Nukes 'To Have Peace in the World' in Tense War Simulation on 2024-02-24 06:43:34