{"blog_url":"https://randommemory.hatenablog.com/","url":"https://randommemory.hatenablog.com/entry/2022/03/03/224704","provider_name":"Hatena Blog","version":"1.0","author_name":"derwind","type":"rich","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Frandommemory.hatenablog.com%2Fentry%2F2022%2F03%2F03%2F224704\" title=\"Attention (2) - \u3089\u3093\u3060\u3080\u306a\u8a18\u61b6\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","categories":["machine_learning"],"width":"100%","image_url":null,"provider_url":"https://hatena.blog","blog_title":"\u3089\u3093\u3060\u3080\u306a\u8a18\u61b6","height":"190","description":"\u7d9a\u3044\u3066\u8a00\u8a9e\u30e2\u30c7\u30eb\u306e\u8a71\u3092\u632f\u308a\u8fd4\u308b\u3002\u4f8b\u3048\u3070 LSTM \u3092\u3068\u308b\u3068\u3001$$ \\begin{align*} h_t, c_t = \\mathrm{LSTM}(x_t, h_{t-1}, c_{t-1}) \\end{align*} $$\u3067\u3042\u3063\u305f\u3002['you', 'say', 'goodbye', 'and', 'i', 'say', 'hello', '.'] \u3092 $\\{x_t\\}_{t \\geq 0}$ \u3068\u3057\u3066\u6e21\u3059\u3068\u3059\u308b\u3068\u3001 x_0 = 'you' \u3092\u5165\u529b\u3057\u305f\u6642\u3001\u51fa\u529b h_1 \u306f ['you'] \u306e\u7279\u5fb4\u91cf\u3092\u6301\u3063\u3066\u3044\u308b\u3068\u601d\u308f\u308c\u308b\u3002 \u3053\u308c\u3092\u8a18\u61b6\u3057\u3064\u3064\u3001x_1 = 'say' \u3092\u5165\u529b\u3057\u305f\u6642\u3001\u51fa\u529b h_2 \u306f [\u2026","author_url":"https://blog.hatena.ne.jp/derwind/","title":"Attention (2)","published":"2022-03-03 22:47:04"}