Stories
Slash Boxes
Comments

SoylentNews is people

You Can Now Run a GPT-3-Level AI Model on Your Laptop, Phone, and Raspberry Pi

posted by janrinok on Thursday March 16 2023, @06:24PM   Printer-friendly
from the welcome-future-dystopian-AI-overlords dept.

Freeman writes:

https://arstechnica.com/information-technology/2023/03/you-can-now-run-a-gpt-3-level-ai-model-on-your-laptop-phone-and-raspberry-pi/

Things are moving at lightning speed in AI Land. On Friday, a software developer named Georgi Gerganov created a tool called "llama.cpp" that can run Meta's new GPT-3-class AI large language model, LLaMA, locally on a Mac laptop. Soon thereafter, people worked out how to run LLaMA on Windows as well. Then someone showed it running on a Pixel 6 phone, and next came a Raspberry Pi (albeit running very slowly).

If this keeps up, we may be looking at a pocket-sized ChatGPT competitor before we know it.
[...]
For example, here's a list of notable LLaMA-related events based on a timeline Willison laid out in a Hacker News comment:

Related:
DuckDuckGo's New Wikipedia Summary Bot: "We Fully Expect It to Make Mistakes"
Robots Let ChatGPT Touch the Real World Thanks to Microsoft (Article has a bunch of other SoylentNews related links as well.)
Netflix Stirs Fears by Using AI-Assisted Background Art in Short Anime Film
Paper: Stable Diffusion "Memorizes" Some Images, Sparking Privacy Concerns
The EU's AI Act Could Have a Chilling Effect on Open Source Efforts, Experts Warn
Pixel Art Comes to Life: Fan Upgrades Classic MS-DOS Games With AI

Original Submission

 
This discussion was created by janrinok (52) for logged-in users only, but now has been archived. No new comments can be posted.
You Can Now Run a GPT-3-Level AI Model on Your Laptop, Phone, and Raspberry Pi | Log In/Create an Account | Top | 30 comments | Search Discussion
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.

  • (Score: 4, Touché) by maxwell demon on Friday March 17 2023, @04:51AM (6 children)

    by maxwell demon (1608) on Friday March 17 2023, @04:51AM (#1296632) Journal

    Eliza, is that you?

    --
    The Tao of math: The numbers you can count are not the real numbers.
    Starting Score:    1  point
    Moderation   +2  
       Touché=2, Total=2
    Extra 'Touché' Modifier   0  
    Karma-Bonus Modifier   +1  
    Total Score:   4  

  • (Score: 2) by Tork on Friday March 17 2023, @05:31PM (5 children)

    by Tork (3914) Subscriber Badge on Friday March 17 2023, @05:31PM (#1296715)
    My name is doctor Sbaitso. I am here to help you.
    --
    🏳️‍🌈 Proud Ally 🏳️‍🌈

    • (Score: 2) by coolgopher on Saturday March 18 2023, @01:04AM (4 children)

      by coolgopher (1157) on Saturday March 18 2023, @01:04AM (#1296785)

      I wonder where the "tso" in the name from?
      Sb = Sound Blaster
      ai = artificial intelligence
      tso = ???

      • (Score: 2) by Tork on Saturday March 18 2023, @01:09AM (3 children)

        by Tork (3914) Subscriber Badge on Saturday March 18 2023, @01:09AM (#1296788)
        text-to-speech operator
        --
        🏳️‍🌈 Proud Ally 🏳️‍🌈

        • (Score: 2) by coolgopher on Saturday March 18 2023, @01:11AM (2 children)

          by coolgopher (1157) on Saturday March 18 2023, @01:11AM (#1296789)

          Hmm! Do you know for a fact, or "merely" an educated deduction? /curious

          • (Score: 2) by Tork on Saturday March 18 2023, @01:35AM (1 child)

            by Tork (3914) Subscriber Badge on Saturday March 18 2023, @01:35AM (#1296791)
            I remembered it from when I played with it as a kid, but I did double-check with wikipedia just to be safe. Heh
            --
            🏳️‍🌈 Proud Ally 🏳️‍🌈