{"published":"2024-10-20 15:44:58","categories":["LLM"],"author_url":"https://blog.hatena.ne.jp/loner49th/","version":"1.0","title":"Hugging Face Hub\u306eGGUF\u30e2\u30c7\u30eb\u3092ollma\u3067\u4f7f\u3063\u3066\u307f\u305f","description":"Hugging Face Hub\u306eGGUF\u30e2\u30c7\u30eb\u3092ollama\u3067\u4f7f\u3063\u3066\u307f\u305f\u306e\u3067\u3001\u305d\u306e\u65b9\u6cd5\u3092\u30e1\u30e2 \u74b0\u5883\u306e\u6e96\u5099 !curl -fsSL https://ollama.com/install.sh | sh !nohup ollama serve & !ollama pull hf.co/<\u30e6\u30fc\u30b6\u30fc\u540d>/<\u30ea\u30dd\u30b8\u30c8\u30ea\u540d> !pip install ollama \u30e2\u30c7\u30eb\u3092\u5b9f\u884c import ollama message = \"\"\" \u5b9f\u884c\u3057\u305f\u3044\u30d7\u30ed\u30f3\u30d7\u30c8\u3092\u8a18\u8f09\u3059\u308b \"\"\" response = ollama.chat(model='hf.co/<\u30e6\u30fc\u30b6\u30fc\u540d>/<\u30ea\u30dd\u30b8\u30c8\u30ea\u540d>', messages=[ \u2026","height":"190","type":"rich","width":"100%","blog_url":"https://loner49th.hatenablog.com/","blog_title":"SE\u304c\u6700\u8fd1\u8d77\u3053\u3063\u305f\u3053\u3068\u3092\u66f8\u304f\u30d6\u30ed\u30b0","url":"https://loner49th.hatenablog.com/entry/2024/10/20/154458","author_name":"loner49th","provider_url":"https://hatena.blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Floner49th.hatenablog.com%2Fentry%2F2024%2F10%2F20%2F154458\" title=\"Hugging Face Hub\u306eGGUF\u30e2\u30c7\u30eb\u3092ollma\u3067\u4f7f\u3063\u3066\u307f\u305f - SE\u304c\u6700\u8fd1\u8d77\u3053\u3063\u305f\u3053\u3068\u3092\u66f8\u304f\u30d6\u30ed\u30b0\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","provider_name":"Hatena Blog","image_url":null}