SoylentNews
SoylentNews is people
https://soylentnews.org/

Title    Dark Web ChatGPT Unleashed: Meet DarkBERT
Date    Sunday May 21 2023, @01:19PM
Author    janrinok
Topic   
from the sounds-more-sinister-than-DarkERNIE-I-suppose dept.
https://soylentnews.org/article.pl?sid=23/05/20/1451235

fliptop writes:

A language model trained on the fringes of the dark web... for science:

We're still early in the snowball effect unleashed by the release of Large Language Models (LLMs) like ChatGPT into the wild. Paired with the open-sourcing of other GPT (Generative Pre-Trained Transformer) models, the number of applications employing AI is exploding; and as we know, ChatGPT itself can be used to create highly advanced malware.

As time passes, applied LLMs will only increase, each specializing in their own area, trained on carefully curated data for a specific purpose. And one such application just dropped, one that was trained on data from the dark web itself. DarkBERT, as its South Korean creators called it, has arrived — follow that link for the release paper, which gives an overall introduction to the dark web itself.

DarkBERT is based on the RoBERTa architecture, an AI approach developed back in 2019. It has seen a renaissance of sorts, with researchers discovering it actually had more performance to give than could be extracted from it in 2019. It seems the model was severely undertrained when released, far below its maximum efficiency.

Originally spotted on The Eponymous Pickle.

Related: People are Already Trying to Get ChatGPT to Write Malware


Original Submission

Links

  1. "fliptop" - https://soylentnews.org/~fliptop/
  2. "for science" - https://www.tomshardware.com/news/dark-web-chatgpt-unleashed-meet-darkbert
  3. "DarkBERT, as its South Korean creators called it" - https://arxiv.org/pdf/2305.08596.pdf
  4. "the model was severely undertrained when released" - https://arxiv.org/abs/1907.11692
  5. "The Eponymous Pickle" - https://eponymouspickle.blogspot.com/2023/05/dark-web-chatgpt-unleashed-meet-darkbert.html
  6. "People are Already Trying to Get ChatGPT to Write Malware" - https://soylentnews.org/article.pl?sid=23/01/09/1655235
  7. "Original Submission" - https://soylentnews.org/submit.pl?op=viewsub&subid=59692

© Copyright 2024 - SoylentNews, All Rights Reserved

printed from SoylentNews, Dark Web ChatGPT Unleashed: Meet DarkBERT on 2024-07-22 13:59:10