{"title":"Mac\u3067AirLLM\u3067\u52d5\u304b\u3059","provider_name":"Hatena Blog","published":"2024-01-02 00:21:32","version":"1.0","url":"https://ayousanz.hatenadiary.jp/entry/2024/01/02/002132","blog_url":"https://ayousanz.hatenadiary.jp/","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fayousanz.hatenadiary.jp%2Fentry%2F2024%2F01%2F02%2F002132\" title=\"Mac\u3067AirLLM\u3067\u52d5\u304b\u3059 - yousan\u306e\u30e1\u30e2\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","author_url":"https://blog.hatena.ne.jp/ayousanz/","height":"190","width":"100%","blog_title":"yousan\u306e\u30e1\u30e2","type":"rich","categories":["AI"],"provider_url":"https://hatena.blog","author_name":"ayousanz","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/a/ayousanz/20240102/20240102001251.png","description":"\u521d\u3081\u306b \u74b0\u5883 \u6e96\u5099 \u30b3\u30fc\u30c9\u306e\u4f5c\u6210 \u63a8\u8ad6 \u7d50\u679c tokens = 3\u306e\u5834\u5408 tokens = 100\u306e\u5834\u5408 \u307e\u3068\u3081 \u521d\u3081\u306b Mac\u3067LLM\u3067\u52d5\u304f\u30e9\u30a4\u30d6\u30e9\u30ea\u300cAirLLM\u300d\u304c\u3042\u308b\u3068\u805e\u3044\u305f\u306e\u3067\u3001\u5b9f\u969b\u306b\u8a66\u3057\u3066\u307f\u307e\u3059 github.com \u53c2\u8003\u30b5\u30a4\u30c8 note.com \u74b0\u5883 CPU : M1Max Mac \u30e1\u30e2\u30ea : 64GB \u30e2\u30c7\u30eb : elyza/ELYZA-japanese-Llama-2-13b-instruct \u6e96\u5099 \u74b0\u5883\u3092\u69cb\u7bc9\u3057\u307e\u3059 python3 -m venv air_llm source bin/activate \u30e9\u30a4\u30d6\u30e9\u30ea\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059 pip install mlx airl\u2026"}