{"width":"100%","provider_url":"https://hatena.blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Frandommemory.hatenablog.com%2Fentry%2F2022%2F03%2F04%2F223253\" title=\"Attention (3) - \u3089\u3093\u3060\u3080\u306a\u8a18\u61b6\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","height":"190","author_name":"derwind","blog_url":"https://randommemory.hatenablog.com/","published":"2022-03-04 22:32:53","image_url":null,"author_url":"https://blog.hatena.ne.jp/derwind/","type":"rich","provider_name":"Hatena Blog","url":"https://randommemory.hatenablog.com/entry/2022/03/04/223253","description":"p.331 \u3067\u306f\u3001\u30c7\u30b3\u30fc\u30c0\u306e\u30ec\u30a4\u30e4\u306b\u3064\u3044\u3066\u3001LSTM('<eos;>', '\u543e\u8f29\u306f\u732b\u3067\u3042\u308b', None) \u304b\u3089\u59cb\u307e\u308b\u3068\u540c\u6642\u306b\u3001\u5404\u6642\u523b\u3067\u306e LSTM \u306e\u51fa\u529b\u306b\u5bfe\u3057\u3066\u3001hs = ['\u543e\u8f29', '\u543e\u8f29\u306f', '\u543e\u8f29\u306f\u732b', '\u543e\u8f29\u306f\u732b\u3067', '\u543e\u8f29\u306f\u732b\u3067\u3042\u308b'] \u3092\u4f7f\u3063\u305f\u4f55\u304b\u3057\u3089\u306e\u8a08\u7b97\u3092\u631f\u3093\u3067\u304b\u3089 Affine \u5c64\uff08\u5206\u985e\u5668\uff09\u306b\u6e21\u3059\u51e6\u7406\u304c\u66f8\u304b\u308c\u3066\u3044\u308b\u3002\u6c17\u6301\u3061\u7684\u306b\u306f\u3001h, c = LSTM('<eos;>', '\u543e\u8f29\u306f\u732b\u3067\u3042\u308b', None)\u3067 h = 'i' \u3067\u3042\u3063\u3066\u6b32\u3057\u304f\u3001\u30a2\u30e9\u30a4\u30e1\u30f3\u30c8\u306e\u89b3\u70b9\u304b\u3089\u306f\u3001hs \u306e\u4e2d\u3067 '\u543e\u8f29' \u306b\u5bfe\u5fdc\u3057\u3066\u6b32\u3057\u3044\u3002 dot(h, hs_0) = dot('i', '\u543e\u8f29'\u2026","blog_title":"\u3089\u3093\u3060\u3080\u306a\u8a18\u61b6","title":"Attention (3)","categories":["machine_learning"],"version":"1.0"}