{"author_name":"ayousanz","blog_url":"https://ayousanz.hatenadiary.jp/","title":"TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF\u3092llama.cpp\u3067\u52d5\u304b\u3059","blog_title":"yousan\u306e\u30e1\u30e2","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fayousanz.hatenadiary.jp%2Fentry%2F2024%2F01%2F04%2F092307\" title=\"TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF\u3092llama.cpp\u3067\u52d5\u304b\u3059 - yousan\u306e\u30e1\u30e2\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","published":"2024-01-04 09:23:07","author_url":"https://blog.hatena.ne.jp/ayousanz/","provider_url":"https://hatena.blog","provider_name":"Hatena Blog","image_url":null,"url":"https://ayousanz.hatenadiary.jp/entry/2024/01/04/092307","categories":["AI"],"type":"rich","height":"190","description":"\u74b0\u5883 \u6e96\u5099 \u5b9f\u884c \u307e\u3069\u30de\u30ae\u30c6\u30b9\u30c8 \u5bcc\u58eb\u5c71\u306e\u9ad8\u3055\u306f\uff1f What American movies do you recommend that make you cry? \u74b0\u5883 Linux(ubuntu22.04) L4 GPU \u6e96\u5099 TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF\u306etinyllama-1.1b-chat-v1.0.Q4_K_M.gguf\u3092 \u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u307e\u3059 llama.cpp\u306e\u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u306e\u30eb\u30fc\u30c8\u76f4\u4e0b\u306b\u5165\u308c\u307e\u3059 \u5b9f\u884c \u307e\u3069\u30de\u30ae\u30c6\u30b9\u30c8 \u63a8\u8ad6 ./main -ngl 35 -m tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf -\u2026","version":"1.0","width":"100%"}