{"author_url":"https://blog.hatena.ne.jp/sc_bakushu/","author_name":"sc_bakushu","provider_url":"https://hatena.blog","description":"https://github.com/ggerganov/llama.cpp/pull/5747 llama.cpp \u3067\u306f\u6700\u8fd1\u3001ikawrakow\u6c0f\u306b\u3088\u308b\u91cf\u5b50\u5316\u624b\u6cd5\u306e\u30a2\u30c3\u30d7\u30c7\u30fc\u30c8\u304c\u71b1\u5fc3\u306b\u884c\u308f\u308c\u3066\u3044\u307e\u3059\u3002 \u65b0\u3057\u3044\u91cf\u5b50\u5316\u306e\u5b9f\u88c5\u304c\u91cd\u306a\u308a\u500b\u4eba\u7684\u306b\u5206\u304b\u308a\u3065\u3089\u304f\u306a\u3063\u3066\u304d\u305f\u306e\u3067\u3001\u7c21\u5358\u306b\u6574\u7406\u3057\u3066\u304a\u3053\u3046\u3068\u601d\u3044\u307e\u3059\u3002 quantize.cpp\u306e\u30aa\u30d7\u30b7\u30e7\u30f3\u3092\u53c2\u7167\u3059\u308b\u3068\u3001\u73fe\u5728\uff082024.02\uff09\u306eGGUF\u30d0\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u306f\u4ee5\u4e0b\u306e\u3068\u304a\u308a\u3067\u3059\u3002 github.com \u975e\u91cf\u5b50\u5316GGUF\uff1a\"F32\", \"F16\"\u3002\u91cf\u5b50\u5316\u3057\u3066\u3044\u306a\u3044\u5de8\u5927\u306aGGUF\u3002 \u65e7\u91cf\u5b50\u5316GGUF\uff1a\"Q4_0\"\u3001\"Q4_1\"\u3001\"Q5_0\"\u3001\"Q5_1\"\u3001\"Q8_\u2026","blog_title":"\u30ed\u30fc\u30ab\u30ebLLM\u81ea\u7531\u5e33 (Local LLM Diary)","version":"1.0","published":"2024-02-26 06:25:47","height":"190","type":"rich","provider_name":"Hatena Blog","categories":[],"blog_url":"https://sc-bakushu.hatenablog.com/","url":"https://sc-bakushu.hatenablog.com/entry/2024/02/26/062547","title":"llama.cpp\uff1a\u8907\u96d1\u5316\u3059\u308b\u91cf\u5b50\u5316\u30d0\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u306e\u6574\u7406\uff082024.02\u73fe\u5728\uff09","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/s/sc_bakushu/20240228/20240228052943.png","width":"100%","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fsc-bakushu.hatenablog.com%2Fentry%2F2024%2F02%2F26%2F062547\" title=\"llama.cpp\uff1a\u8907\u96d1\u5316\u3059\u308b\u91cf\u5b50\u5316\u30d0\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u306e\u6574\u7406\uff082024.02\u73fe\u5728\uff09 - \u30ed\u30fc\u30ab\u30ebLLM\u81ea\u7531\u5e33 (Local LLM Diary)\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>"}