{"blog_title":"V\u30dd\u30a4\u30f3\u30c8\u30de\u30fc\u30b1\u30c6\u30a3\u30f3\u30b0\uff5cTECH LAB\u306e Tech Blog","title":"LLMs\u306e\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u624b\u6cd5\"Prompt Tuning\"\u306b\u3064\u3044\u3066\u8ad6\u6587\u3092\u8aad\u3093\u3067\u8abf\u3079\u3066\u307f\u307e\u3057\u305f\uff01","categories":["LLM"],"version":"1.0","url":"https://techblog.vpoint.co.jp/entry/2023/09/05/144119","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/m/miu4930/20230905/20230905094628.jpg","published":"2023-09-05 14:41:19","type":"rich","blog_url":"https://techblog.vpoint.co.jp/","author_url":"https://blog.hatena.ne.jp/miu4930/","author_name":"miu4930","provider_url":"https://hatena.blog","width":"100%","provider_name":"Hatena Blog","description":"\u3053\u3093\u306b\u3061\u306f\u3001CCCMK\u30db\u30fc\u30eb\u30c7\u30a3\u30f3\u30b0\u30b9TECH LAB\u306e\u4e09\u6d66\u3067\u3059\u3002 9\u6708\u306b\u306a\u308a\u307e\u3057\u305f\u3002\u307e\u3060\u307e\u3060\u6691\u3044\u65e5\u304c\u7d9a\u3044\u3066\u3044\u307e\u3059\u304c\u30019\u6708\u306b\u306a\u308b\u3068\u79c1\u306f\"\u590f\u306f\u7d42\u308f\u3063\u305f\u3093\u3060\u306a\"\u3068\u3044\u3046\u6c17\u6301\u3061\u306b\u306a\u308a\u307e\u3059\u3002\u5c11\u3057\u5bc2\u3057\u3044\u6c17\u3082\u3057\u307e\u3059\u304c\u3001\u3068\u306b\u304b\u304f\u65e9\u304f\u6dbc\u3057\u304f\u306a\u3063\u3066\u307b\u3057\u3044\u306a\u30fb\u30fb\u30fb\u3068\u601d\u3046\u4eca\u65e5\u3053\u306e\u9803\u3067\u3059\u3002 \u4ee5\u524d\u3053\u306e\u30d6\u30ed\u30b0\u3067QLoRA\u3092\u4f7f\u3063\u3066LLMs\u3092\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3059\u308b\u3001\u3068\u3044\u3063\u305f\u3053\u3068\u306b\u53d6\u308a\u7d44\u3093\u3067\u3044\u308b\u3053\u3068\u3092\u3054\u7d39\u4ecb\u3057\u307e\u3057\u305f\u3002QLoRA\u306e\"LoRA\"\u306e\u90e8\u5206\u306e\u5b9f\u88c5\u306fHuggingFace\u306ePEFT\u3068\u3044\u3046\u30e9\u30a4\u30d6\u30e9\u30ea\u3092\u6d3b\u7528\u3057\u305f\u306e\u3067\u3059\u304c\u3001\u3053\u306ePEFT\u306b\u306f\u4ed6\u306b\u3082LLMs\u3092\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3059\u308b\u624b\u6cd5\u304c\u5b9f\u88c5\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u305d\u306e\u3046\u3061\u306e\u4e00\u3064\u304c\"Prompt Tuning\u2026","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Ftechblog.vpoint.co.jp%2Fentry%2F2023%2F09%2F05%2F144119\" title=\"LLMs\u306e\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u624b\u6cd5&quot;Prompt Tuning&quot;\u306b\u3064\u3044\u3066\u8ad6\u6587\u3092\u8aad\u3093\u3067\u8abf\u3079\u3066\u307f\u307e\u3057\u305f\uff01 - V\u30dd\u30a4\u30f3\u30c8\u30de\u30fc\u30b1\u30c6\u30a3\u30f3\u30b0\uff5cTECH LAB\u306e Tech Blog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","height":"190"}