{"blog_title":"StatsBeginner: \u521d\u5b66\u8005\u306e\u7d71\u8a08\u5b66\u7fd2\u30ce\u30fc\u30c8","categories":[],"height":"190","published":"2023-09-18 12:13:40","type":"rich","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/m/midnightseminar/20230918/20230918120138.png","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fblog.statsbeginner.net%2Fentry%2F2023%2F09%2F18%2F121340\" title=\"\u82f1\u65e5\u7ffb\u8a33Transformer\u3092\u5c11\u3057\u3060\u3051\u5927\u304d\u304f\u3057\u3066\u307f\u305f\u7d50\u679c - StatsBeginner: \u521d\u5b66\u8005\u306e\u7d71\u8a08\u5b66\u7fd2\u30ce\u30fc\u30c8\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","width":"100%","title":"\u82f1\u65e5\u7ffb\u8a33Transformer\u3092\u5c11\u3057\u3060\u3051\u5927\u304d\u304f\u3057\u3066\u307f\u305f\u7d50\u679c","provider_url":"https://hatena.blog","version":"1.0","description":"\u7814\u7a76\u3067Transformer\u3092\u4f7f\u3044\u305f\u3044\u306e\u3067\uff08\u53bb\u5e74\u3061\u3087\u3063\u3068\u5b9f\u969b\u306b\u4f7f\u3044\u307e\u3057\u305f\u304c\uff09\u3001\u57fa\u672c\u304b\u3089\u52c9\u5f37\u3057\u3088\u3046\u3068\u601d\u3044\u3001\u5148\u65e5\u81ea\u5206\u3067Transformer\u306b\u82f1\u65e5\u7ffb\u8a33\u3092\u5b66\u7fd2\u3055\u305b\u3066\u307f\u305f\u306e\u3067\u3059\u304c\uff08\u30a8\u30f3\u30c8\u30ea1\u30fb\u30a8\u30f3\u30c8\u30ea2\uff09\u3001GPU\u3092\u8907\u6570\u679a\u4e26\u5217\u3067\u52d5\u304b\u305b\u308b\u74b0\u5883\u3092\u624b\u306b\u5165\u308c\u305f\u306e\u3067\u3001\u30b3\u30fc\u30d1\u30b9\u3068\u30e2\u30c7\u30eb\u3092\u5c11\u3057\u5927\u304d\u304f\u3057\u3066\u307f\u307e\u3057\u305f\u3002 \u5bfe\u8a33\u30da\u30a2\u6570\u306f\u3001128\u4e07\u304b\u3089175\u4e07\u3078\uff08Wikimatrix\u3068\u3044\u3046\u65b0\u3057\u3044\u30b3\u30fc\u30d1\u30b9\u3092\u8ffd\u52a0\uff09\u3002 Transformer\u306e\u30d6\u30ed\u30c3\u30af\u6570\u3092\u3001\u4e21\u50743\u5c64\u304b\u3089\u4e21\u50746\u5c64\u3078\u3002 \u305f\u3060\u3057Byte-Pair Encoding\u306e\u8a9e\u5f59\u6570\u3092\u30013\u4e07\u304b\u30892\u4e07\u306b\u6e1b\u3089\u3057\u307e\u3057\u305f\u3002\u306a\u305c\u304b\u65b0\u3057\u3044\u74b0\u5883\u3067\u306f3\u4e07\u3067\u3084\u308b\u3068\u30af\u30e9\u30c3\u30b7\u30e5\u3057\u3066\u52d5\u304b\u306a\u304b\u3063\u305f\u305f\u3081\u3067\u3059\u3002\u306a\u304a\u2026","url":"https://blog.statsbeginner.net/entry/2023/09/18/121340","provider_name":"Hatena Blog","author_url":"https://blog.hatena.ne.jp/midnightseminar/","author_name":"midnightseminar","blog_url":"https://blog.statsbeginner.net/"}