{"width":"100%","blog_url":"https://yasagurenlp.hateblo.jp/","provider_url":"https://hatena.blog","title":"LLM\u306b\u3064\u3044\u3066\u5b66\u3073\u76f4\u30593\u9031\u9593","blog_title":"\u82f1\u8a9e\u5e1d\u56fd\u3092\u6253\u5012\u3057\u3088\u3046","version":"1.0","url":"https://yasagurenlp.hateblo.jp/entry/2023/11/01/192307","height":"190","author_name":"yasagurenlp","categories":[],"provider_name":"Hatena Blog","author_url":"https://blog.hatena.ne.jp/yasagurenlp/","type":"rich","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fyasagurenlp.hateblo.jp%2Fentry%2F2023%2F11%2F01%2F192307\" title=\"LLM\u306b\u3064\u3044\u3066\u5b66\u3073\u76f4\u30593\u9031\u9593 - \u82f1\u8a9e\u5e1d\u56fd\u3092\u6253\u5012\u3057\u3088\u3046\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","published":"2023-11-01 19:23:07","description":"\u9031\uff13\u65e5\u3050\u3089\u3044\u53d6\u308c\u305d\u3046\u306a\u306e\u3067\u3001\u4e00\u65e5\uff11\u3064\u3050\u3089\u3044\u3067\u3084\u3063\u3066\u3044\u304d\u305f\u3044 \u3068\u308a\u3042\u3048\u305a\u4f5c\u3063\u3066\u307f\u308b\u2192 LLM\u69cb\u7bc9\u30bf\u30a4\u30e0\u30a2\u30bf\u30c3\u30af - yasagurenlp\u2019s diary transformer\u306e\u4e26\u5217\u8a08\u7b97\u306b\u3064\u3044\u3066\u3002\u4f55\u3092\u3069\u3046\u4e26\u5217\u5316\u3057\u3066\u308b\u3093\u3060\u3063\u3051 -> \u5165\u529b\u3068\u51fa\u529b\u304b\u3089\u8fbf\u308btransformer(\u8a08\u7b97\u91cf\u7b49) - yasagurenlp\u2019s diary hf\u306egenerate\u95a2\u6570\u3001train\u95a2\u6570\u306e\u5f15\u6570\u5168\u90e8\u8aad\u3093\u3067\u307f\u305f \u30e2\u30c7\u30eb\u3054\u3068\u306b\u30af\u30e9\u30b9\u304c\u5206\u304b\u308c\u3066\u308b\u3051\u3069\u3001\u3053\u308c\u304c\u4f55\u3057\u3066\u308b\u304b\u3002head\u3068\u304b\u4e91\u3005\u3068\u304b\u3082 \u30c7\u30b3\u30fc\u30c0\u30fc\u306ebackward\u306e\u4ed5\u7d44\u307f\u3088\u304f\u5206\u304b\u3063\u3066\u306a\u3044\u6c17\u304c\u3059\u308b\u3002\u3068\u308a\u3042\u3048\u305a\u3001decoder-base\u30e2\u30c7\u30eb\u3092pytorch\u3067\u66f8\u3044\u3066\u2026","image_url":null}