{"blog_url":"https://nikkie-ftnext.hatenablog.com/","blog_title":"nikkie-ftnext\u306e\u65e5\u8a18","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fnikkie-ftnext.hatenablog.com%2Fentry%2Fllm-quantize-first-step-cyberagent-calm2-7b-chat\" title=\"llama.cpp\u3067LLM\u3092\u91cf\u5b50\u5316\u3057\u3001ollama\u3067\u52d5\u304b\u305b\u305f\uff01\u3053\u308c\u3067\u52dd\u3064\u308b\uff01\uff08cyberagent/calm2-7b-chat\u91cf\u5b50\u5316\u8a18\u4e8b\u306e\u518d\u73fe\u7de8\uff09 - nikkie-ftnext\u306e\u65e5\u8a18\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","categories":["LLM"],"published":"2024-05-20 08:02:00","url":"https://nikkie-ftnext.hatenablog.com/entry/llm-quantize-first-step-cyberagent-calm2-7b-chat","type":"rich","width":"100%","height":"190","description":"\u306f\u3058\u3081\u306b \u611b\u8863\u3061\u3083\u3093\u5927\u52dd\u5229\u301c\uff01\uff01 nikkie\u3067\u3059\u3002 \u4e16\u306f\u307e\u3055\u306b\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb1\u6642\u4ee3\uff01 ollama\u3092\u4f7f\u3063\u3066LLM\u3092\u3082\u3075\u3082\u3075\u624b\u5143\u306ePC\uff08CPU\u306e\u307f\uff09\u3067\u3082\u52d5\u304b\u3057\u3066\u3044\u307e\u30592\u304c\u3001\u305d\u306e\u79d8\u5bc6\u306f\u91cf\u5b50\u5316\u3002 \u4eca\u56de\u306f\u3001\u4eca\u307e\u3067\u5229\u7528\u3059\u308b\u3060\u3051\u3060\u3063\u305f\u91cf\u5b50\u5316\u3092\u81ea\u5206\u3067\u3082\u3084\u3063\u3066\u307f\u307e\u3059 \u76ee\u6b21 \u306f\u3058\u3081\u306b \u76ee\u6b21 \u300c\u975e\u529b\u306a\u30d1\u30bd\u30b3\u30f3\u3067\u3082LLM\u3092\u52d5\u304b\u3057\u305f\u3044!? llama.cpp\u306e\u7d39\u4ecb\u300d cyberagent/calm2-7b-chat\u3092q5_k_m\u306b\u91cf\u5b50\u5316 \u74b0\u5883\u69cb\u7bc9 1. Hugging Face\u306b\u7f6e\u3044\u3066\u3042\u308b\u30e2\u30c7\u30eb\u3092GGUF\u5f62\u5f0f\u306b\u5909\u63db 2. GGUF\u5f62\u5f0f\u304b\u3089\u91cf\u5b50\u5316 3. \u91cf\u5b50\u5316\u3057\u305f\u30e2\u30c7\u30eb\u3092llama.cpp\u3067\u52d5\u304b\u3059 \u91cf\u5b50\u5316\u3057\u305f\u30e2\u30c7\u30eb\u2026","provider_name":"Hatena Blog","provider_url":"https://hatena.blog","author_url":"https://blog.hatena.ne.jp/nikkie-ftnext/","version":"1.0","title":"llama.cpp\u3067LLM\u3092\u91cf\u5b50\u5316\u3057\u3001ollama\u3067\u52d5\u304b\u305b\u305f\uff01\u3053\u308c\u3067\u52dd\u3064\u308b\uff01\uff08cyberagent/calm2-7b-chat\u91cf\u5b50\u5316\u8a18\u4e8b\u306e\u518d\u73fe\u7de8\uff09","author_name":"nikkie-ftnext","image_url":null}