{"height":"190","version":"1.0","blog_title":"Sabrou-mal \u30b5\u30d6\u30ed\u30a6\u4e38","provider_url":"https://hatena.blog","provider_name":"Hatena Blog","author_url":"https://blog.hatena.ne.jp/inarizuuuushi/","published":"2022-06-16 09:00:00","author_name":"inarizuuuushi","title":"Transformer\u306b\u3088\u308b\u7ffb\u8a33\u30b7\u30b9\u30c6\u30e0\u81ea\u4f5c; part2 \u30d7\u30ed\u30c8\u30bf\u30a4\u30d7\u306e\u4f5c\u6210\uff08\u30b7\u30f3\u30d7\u30eb\u306aTransformer\uff09","width":"100%","categories":["Transformer\u81ea\u4f5c"],"description":"\u672c\u7a3f\u3067\u306f\u7ffb\u8a33\u30e2\u30c7\u30eb\u306e\u30d7\u30ed\u30c8\u30bf\u30a4\u30d7\u3068\u3057\u3066\u7c21\u6613\u5316\u3057\u305fTransformer\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002\u82f1\u8a9e\u2192\u65e5\u672c\u8a9e\u306e\u7ffb\u8a33\u30e2\u30c7\u30eb\u3092\u4e0b\u56f3\u306e\u69cb\u6210\u3067\u4f5c\u6210\u3057\u307e\u3059\u3002 \u4e0a\u56f3\u306f\"dog is cute\"\u3092encoder\u3001\"\u72ac\u306f\u304b\u308f\u3044\u3044\u3002\"\u3092decoder\u306b\u5165\u529b\u3057\u3066\"\u72ac\u306f\u304b\u308f\u3044\u3044\u3002\"\u3092\u63a8\u8ad6\u3055\u305b\u308b\u3088\u3046\u306b\u5b66\u7fd2\u3055\u305b\u3066\u3044\u308b\u69d8\u5b50\u3067\u3059\u3002 \u7ffb\u8a33\u5143\u306e\u82f1\u8a9e\u306f\u305d\u306e\u307e\u307e\u5165\u529b\u3057\u3001\u65e5\u672c\u8a9e\u306f\u4e00\u3064\u306etoken\u3092\u30b9\u30e9\u30a4\u30c9\u3055\u305b\u305f\u6587\u7ae0\u3092\u4e88\u6e2c\u3055\u305b\u307e\u3059\u3002\uff08\u3064\u307e\u308a\u6587\u672b\u3092\u9664\u3044\u305f\u6587\u7ae0\u3092\u5165\u529b\u3057\u3066\u3001\u6587\u982d\u3092\u9664\u3044\u305f\u6587\u7ae0\u3092\u4e88\u6e2c\u3055\u305b\u308b\u3002\uff09 \u6b21\u56de\u4ee5\u964d\u3067Attention\u3092Masked Multi-head attention\u306b\u3057\u305f\u308a\u3001positional encoding\u3092\u8ffd\u52a0\u3057\u305f\u308a\u3057\u307e\u2026","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/i/inarizuuuushi/20220530/20220530221209.png","type":"rich","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Finarizuuuushi.hatenablog.com%2Fentry%2F2022%2F06%2F16%2F090000\" title=\"Transformer\u306b\u3088\u308b\u7ffb\u8a33\u30b7\u30b9\u30c6\u30e0\u81ea\u4f5c; part2 \u30d7\u30ed\u30c8\u30bf\u30a4\u30d7\u306e\u4f5c\u6210\uff08\u30b7\u30f3\u30d7\u30eb\u306aTransformer\uff09 - Sabrou-mal \u30b5\u30d6\u30ed\u30a6\u4e38\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","blog_url":"https://inarizuuuushi.hatenablog.com/","url":"https://inarizuuuushi.hatenablog.com/entry/2022/06/16/090000"}