{"published":"2023-11-29 05:39:29","provider_name":"Hatena Blog","title":"GoogleColob\u3067TheBloke/calm2-7B-chat-AWQ\u3092\u52d5\u304b\u3059","blog_url":"https://ayousanz.hatenadiary.jp/","categories":["AI"],"blog_title":"yousan\u306e\u30e1\u30e2","description":"\u306f\u3058\u3081\u306b \u74b0\u5883 \u6e96\u5099 \u63a8\u8ad6 \u63a8\u8ad6\u306b\u5fc5\u8981\u306a\u30ea\u30bd\u30fc\u30b9 \u306f\u3058\u3081\u306b \u4eca\u66f4\u3067\u3059\u304c\u3001CALM2\u306eAWQ\u7248\u3092\u52d5\u304b\u3057\u3066\u307f\u307e\u3059\u3002 huggingface.co \u74b0\u5883 Google Colob A100 (GPU RAM\u309225GB\u4f7f\u3046\u305f\u3081\u3001\u7121\u6599\u67a0\u3060\u3068\u7121\u7406\u3067\u3057\u305f) \u6e96\u5099 \u5fc5\u8981\u306a\u30e9\u30a4\u30d6\u30e9\u30ea\u306e\u8ffd\u52a0\u3057\u307e\u3059 !pip -q install --upgrade accelerate autoawq !pip install torch==2.1.0+cu121 torchtext==0.16.0+cpu torchdata==0.7.0 --index-url https://download.pytorch.org/whl\u2026","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fayousanz.hatenadiary.jp%2Fentry%2F2023%2F11%2F29%2F053929\" title=\"GoogleColob\u3067TheBloke/calm2-7B-chat-AWQ\u3092\u52d5\u304b\u3059 - yousan\u306e\u30e1\u30e2\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","author_url":"https://blog.hatena.ne.jp/ayousanz/","provider_url":"https://hatena.blog","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/a/ayousanz/20231129/20231129053800.png","type":"rich","version":"1.0","author_name":"ayousanz","url":"https://ayousanz.hatenadiary.jp/entry/2023/11/29/053929","height":"190","width":"100%"}