SoylentNews

Freeman [soylentnews.org] writes:

https://arstechnica.com/information-technology/2023/03/you-can-now-run-a-gpt-3-level-ai-model-on-your-laptop-phone-and-raspberry-pi/ [arstechnica.com]

Things are moving at lightning speed in AI Land. On Friday, a software developer named Georgi Gerganov created a tool called "llama.cpp" [github.com] that can run Meta's new GPT-3-class AI large language model, LLaMA [arstechnica.com], locally on a Mac laptop. Soon thereafter, people worked out how to run LLaMA on Windows [github.com] as well. Then someone showed it running [twitter.com] on a Pixel 6 phone, and next came a Raspberry Pi [twitter.com] (albeit running very slowly).

If this keeps up, we may be looking at a pocket-sized ChatGPT competitor [arstechnica.com] before we know it.
[...]
For example, here's a list of notable LLaMA-related events based on a timeline [ycombinator.com] Willison laid out in a Hacker News comment:

• February 24, 2023: Meta AI announces [arstechnica.com] LLaMA.
• March 2, 2023: Someone leaks the LLaMA models [ycombinator.com] via BitTorrent.
• March 10, 2023: Georgi Gerganov creates llama.cpp [github.com], which can run on an M1 Mac.
• March 11, 2023: Artem Andreenko runs LLaMA 7B (slowly) on a Raspberry Pi 4 [twitter.com], 4GB RAM, 10 sec/token.
• March 12, 2023: LLaMA 7B running on NPX [github.io], a node.js execution tool.
• March 13, 2023: Someone gets llama.cpp running on a Pixel 6 phone [twitter.com], also very slowly.
• March 13, 2023, 2023: Stanford releases Alpaca 7B [stanford.edu], an instruction-tuned version of LLaMA 7B that "behaves similarly to OpenAI's "text-davinci-003 [arstechnica.com]" but runs on much less powerful hardware.

Related:
DuckDuckGo's New Wikipedia Summary Bot: “We Fully Expect It to Make Mistakes” [soylentnews.org]
Robots Let ChatGPT Touch the Real World Thanks to Microsoft [soylentnews.org] (Article has a bunch of other SoylentNews related links as well.)
Netflix Stirs Fears by Using AI-Assisted Background Art in Short Anime Film [soylentnews.org]
Paper: Stable Diffusion “Memorizes” Some Images, Sparking Privacy Concerns [soylentnews.org]
The EU's AI Act Could Have a Chilling Effect on Open Source Efforts, Experts Warn [soylentnews.org]
Pixel Art Comes to Life: Fan Upgrades Classic MS-DOS Games With AI [soylentnews.org]

Original Submission