{"author_url":"https://blog.hatena.ne.jp/bwgift/","author_name":"bwgift","version":"1.0","url":"https://bwgift.hatenadiary.jp/entry/2024/01/07/152025","provider_url":"https://hatena.blog","type":"rich","title":"vLLM\u3067Qweb_7b_chat_AWQ\u3092\u8a66\u3059","height":"190","image_url":null,"width":"100%","provider_name":"Hatena Blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fbwgift.hatenadiary.jp%2Fentry%2F2024%2F01%2F07%2F152025\" title=\"vLLM\u3067Qweb_7b_chat_AWQ\u3092\u8a66\u3059 - \u5730\u5e73\u7dda\u307e\u3067\u884c\u3063\u3066\u304f\u308b\u3002\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","blog_title":"\u5730\u5e73\u7dda\u307e\u3067\u884c\u3063\u3066\u304f\u308b\u3002","blog_url":"https://bwgift.hatenadiary.jp/","categories":["AI","Colaboratory","IT","LLM","Python","\u304a\u52c9\u5f37","\u81ea\u7136\u8a00\u8a9e\u51e6\u7406"],"published":"2024-01-07 15:20:25","description":"\u30d0\u30c3\u30c1\u3067\u9ad8\u901f\u306aLLM\u51e6\u7406\u3092\u5b9f\u73fe\u3057\u3066\u3044\u308b\u3068\u3044\u3046vLLM\u3092\u8a66\u3057\u3066\u898b\u305f\u3002Qweb\u3082\u89e6\u3063\u3066\u307f\u305f\u304b\u3063\u305f\u306e\u3067\u3001colab\u306e\u7121\u6599\u67a0\u3067\u52d5\u304f\u304b\u5b9f\u9a13\u3057\u307e\u3057\u305f\u3002 github.com vLLM\u306f\u5bfe\u5fdc\u3057\u3066\u3044\u30e2\u30c7\u30eb\u3067\u3042\u308c\u3070\u3059\u3050\u306b\u52d5\u304f\u3002\u52d5\u304b\u3057\u305f\u3068\u304d\u306b\u306fbug\u304c\u3042\u308a\u3001LLM\u3067\u751f\u6210\u90e8\u5206\u3092\uff12\u5ea6\u5b9f\u884c\u3059\u308b\u3068\u30a8\u30e9\u30fc\u3068\u306a\u308b\u3002github issues\u3092\u53c2\u7167\u3059\u308b\u3068fix\u306f\u3082\u3046\u3058\u304d\u53cd\u6620\u3055\u308c\u308b\u3088\u3046\u3060\u3002\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3082\u30d1\u30e9\u30e1\u30fc\u30bf\u304c\u4e00\u90e8\u3057\u304b\u4f8b\u793a\u3055\u308c\u3066\u306a\u3044\u3002\u3053\u308c\u304b\u3089\u6574\u5099\u3055\u308c\u3066\u3044\u304f\u306e\u304c\u697d\u3057\u307f\u3060\u3002 github.com \u6587\u7ae0\u306f\u3001\u3042\u307e\u308a\u7834\u7dbb\u3057\u3066\u306a\u3055\u305d\u3046\u3060\u3051\u308c\u3069\u3082\u3001\u6b63\u89e3\u306b\u306f\u306a\u304b\u306a\u304b\u53b3\u3057\u3044\u7d50\u679c\u3068\u306a\u3063\u305f\u3002rinna\u793e\u306eQwen\u30e2\u30c7\u30eb\u3060\u3063\u305f\u3089\u9055\u3046\u306e\u304b\u3082\u3057\u308c\u306a\u3044\u3002\u2026"}