{"description":"Attention \u306e\u90e8\u5206\u306e\u8aac\u660e\u306f 8 \u7ae0\u306e pp.338-340 \u8fba\u308a\u304c\u5c0e\u5165\u90e8\u3068\u601d\u3046\u3002[1409.0473] Neural Machine Translation by Jointly Learning to Align and Translate \u3067\u306f\u5f0f (5) \u3068 (6) \u8fba\u308a\u304c\u8a72\u5f53\u3059\u308b\u3068\u601d\u3046\u3002\u7279\u306b (6) \u5f0f\u306f softmax \u3067\u3042\u308b\u3002(5) \u5f0f\u3067\u306f\u96a0\u308c\u72b6\u614b\u3068\u30a2\u30ce\u30c6\u30fc\u30b7\u30e7\u30f3\u306e\u9593\u306e alignment model \u306b\u3088\u308b\u4fc2\u6570 $e_{ij}$ \u3092 softmax \u306b\u901a\u3057\u3066\u5f97\u308b\u91cd\u307f $\\alpha_{ij}$ \u3092\u30a2\u30ce\u30c6\u30fc\u30b7\u30e7\u30f3\u3092\u639b\u3051\u3053\u3093\u3067\u6587\u8108\u30d9\u30af\u30c8\u30eb\u3092\u4f5c\u3063\u3066\u3044\u308b\u3002\u305d\u306e\u611f\u3058\u306f\u30bc\u30ed\u3064\u304f 2 \u306e\u2026","title":"\u30bc\u30ed\u3064\u304f 2 (13)","published":"2021-11-07 14:41:34","version":"1.0","provider_url":"https://hatena.blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Frandommemory.hatenablog.com%2Fentry%2F2021%2F11%2F07%2F144134\" title=\"\u30bc\u30ed\u3064\u304f 2 (13) - \u3089\u3093\u3060\u3080\u306a\u8a18\u61b6\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","height":"190","provider_name":"Hatena Blog","author_url":"https://blog.hatena.ne.jp/derwind/","width":"100%","blog_url":"https://randommemory.hatenablog.com/","url":"https://randommemory.hatenablog.com/entry/2021/11/07/144134","type":"rich","blog_title":"\u3089\u3093\u3060\u3080\u306a\u8a18\u61b6","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/d/derwind/20211107/20211107221826.png","author_name":"derwind","categories":["machine_learning"]}