{"author_name":"y_daigo","title":"Mac\u3067\u52d5\u304fLLM\u306eAlpaca.cpp","description":"\u306f\u3058\u3081\u306b Alpaca.cpp\u3068\u306f Mac\u3067Alpaca.cpp\u3092\u8a66\u3059 \u304a\u308f\u308a\u306b \u306f\u3058\u3081\u306b \u3053\u3093\u306b\u3061\u306f\u3001\u5c71\u672c\u3067\u3059\u3002\u6700\u8fd1(2023/3/28)\u306eChatGPT\u306e\u30d6\u30fc\u30e0\u306b\u306f\u76ee\u3092\u898b\u5f35\u308b\u3082\u306e\u304c\u3042\u308a\u307e\u3059\u306d\u3002\u6bce\u65e5\u3001\u4f55\u304b\u3057\u3089\u306eChatGPT\u3084LLM\u306e\u30cb\u30e5\u30fc\u30b9\u3092\u76ee\u306b\u3057\u307e\u3059\u3002 \u305d\u306e\u3088\u3046\u306a\u30cb\u30e5\u30fc\u30b9\u306e\u4e2d\u3067\u7b46\u8005\u304c\u4e00\u756a\u9a5a\u3044\u305f\u3082\u306e\u306fLLM\u3092Rasberry Pi 4\u3067\u52d5\u304b\u3057\u305f\u3068\u3044\u3046\u5185\u5bb9\u3067\u3059\u3002 I've sucefully runned LLaMA 7B model on my 4GB RAM Raspberry Pi 4. It's super slow about 10sec/token. But it looks w\u2026","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/y/y_daigo/20230329/20230329074926.jpg","url":"https://blog.hapins.net/entry/2023/03/29/080347","blog_title":"HapInS Developers Blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fblog.hapins.net%2Fentry%2F2023%2F03%2F29%2F080347\" title=\"Mac\u3067\u52d5\u304fLLM\u306eAlpaca.cpp - HapInS Developers Blog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","provider_url":"https://hatena.blog","width":"100%","blog_url":"https://blog.hapins.net/","height":"190","provider_name":"Hatena Blog","published":"2023-03-29 08:03:47","author_url":"https://blog.hatena.ne.jp/y_daigo/","type":"rich","categories":["\u30c6\u30c3\u30af\u30d6\u30ed\u30b0"],"version":"1.0"}