Slash Boxes

SoylentNews is people

posted by hubie on Saturday September 09 2023, @01:42AM   Printer-friendly
from the think-of-the-AI-generated-children dept.

On Wednesday, American attorneys general from all 50 states and four territories sent a letter to Congress urging lawmakers to establish an expert commission to study how generative AI can be used to exploit children through child sexual abuse material (CSAM). They also call for expanding existing laws against CSAM to explicitly cover AI-generated materials.

"As Attorneys General of our respective States and territories, we have a deep and grave concern for the safety of the children within our respective jurisdictions," the letter reads. "And while Internet crimes against children are already being actively prosecuted, we are concerned that AI is creating a new frontier for abuse that makes such prosecution more difficult."

In particular, open source image synthesis technologies such as Stable Diffusion allow the creation of AI-generated pornography with ease, and a large community has formed around tools and add-ons that enhance this ability. Since these AI models are openly available and often run locally, there are sometimes no guardrails preventing someone from creating sexualized images of children, and that has rung alarm bells among the nation's top prosecutors. (It's worth noting that Midjourney, DALL-E, and Adobe Firefly all have built-in filters that bar the creation of pornographic content.)

"Creating these images is easier than ever," the letter reads, "as anyone can download the AI tools to their computer and create images by simply typing in a short description of what the user wants to see. And because many of these AI tools are 'open source,' the tools can be run in an unrestricted and unpoliced way."

As we have previously covered, it has also become relatively easy to create AI-generated deepfakes of people without their consent using social media photos.

Original Submission

This discussion was created by hubie (1068) for logged-in users only, but now has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 2) by khallow on Saturday September 09 2023, @11:31PM (1 child)

    by khallow (3766) Subscriber Badge on Saturday September 09 2023, @11:31PM (#1323917) Journal

    As a parent and a grandparent, and as a former Boy Scout and Girls Scout leader, I want to say that a single case of child sexual abuse is a pressing problem. A large part of who I am says that you can't possibly get too draconian with efforts to track down, prosecute, and execute child traffikers.

    And yet, here we are already getting too draconian. The fake porn activity in question is harmless, it just might hide something bad hypothetically. The problem is that you go from prosecuting child traffickers to prosecuting people who have nothing to do with the trafficking - not even buying economic products of the trafficking.

    Starting Score:    1  point
    Karma-Bonus Modifier   +1  

    Total Score:   2  
  • (Score: 0, Flamebait) by Runaway1956 on Saturday September 09 2023, @11:55PM

    by Runaway1956 (2926) Subscriber Badge on Saturday September 09 2023, @11:55PM (#1323918) Journal

    Correct. Case in point: []

    A teen sexting case revealed how judges let police invade children's privacy
    The overcriminalization of personal behavior and qualified immunity for officers is a dangerous mix.

    Whether the police have the right to force your teenage son to masturbate in front of them in order to incriminate himself is a legal question few parents would think they’d have to consider.

    And yet Trey Sims’ legal guardians had to do exactly that. In an effort to prosecute the 17-year-old for sexting his 15-year-old girlfriend, Manassas police detective David Abbott obtained a search warrant authorizing him to take “photographs of [Sims’] genitals,” including “a photograph of the suspect’s erect penis.” According to court documents, in the process of executing the search warrant, Abbott took the teenager to a juvenile detention center, took him to a locker room and, with two uniformed, armed officers looking on, ordered Sims to pull down his pants.

    After taking pictures with his cell phone of the teenager’s genitals, Abbot then ordered the minor to masturbate so that he could take a picture of his erection. Sims tried but failed to comply with the officer’s orders; Abbott later threatened Sims’ lawyer that, if police couldn’t get a picture of the teenager’s erection by forcing the kid to masturbate, he would obtain a photo of the teenager’s engorged genitals by subjecting him to “an erection-producing injection” at a hospital.

    Now that's draconian.

    ‘Never trust a man whose uncle was eaten by cannibals’