{"published":"2020-07-02 00:22:36","image_url":null,"type":"rich","provider_name":"Hatena Blog","url":"https://randommemory.hatenablog.com/entry/2020/07/02/002236","provider_url":"https://hatena.blog","description":"Week4 \u6df1\u5c64\u5b66\u7fd2\u306b\u3088\u308b\u81ea\u7136\u8a00\u8a9e\u51e6\u7406\u3068\u305d\u306e\u5fdc\u7528\u4e8b\u4f8b RNN CNN \u304c\u753b\u50cf\u3067\u3088\u304f\u4f7f\u308f\u308c\u308b\u306e\u3068\u597d\u5bfe\u7167 \u5b9f\u969b\u306b\u5fdc\u7528\u3067\u4f7f\u308f\u308c\u308b\u306e\u306f\u6539\u826f\u7248\u306e\u65b9\u3001\u4e3b\u306b LSTM RNN $a_t = W_r h_{t-1} + W_i x_t + b$, $h_t = g(a_t)$ RNN \u306e\u5f37\u307f: \u53ef\u5909\u9577\u306e\u30c7\u30fc\u30bf\u3001\u7cfb\u5217\u60c5\u5831\u306e\u51e6\u7406 RNN \u306e\u8a00\u8a9e\u30e2\u30c7\u30eb\u5168\u4f53\u50cf \u51fa\u529b token \u51fa\u529b\u5c64 RNN \u4e2d\u9593\u5c64 \u5165\u529b\u30d9\u30af\u30c8\u30eb (embedding) token ID \u5358\u8a9e (token) RNN \u767a\u5c55\u5f62 Long Short-Term Memory (LSTM) \u5206\u6563\u8868\u73fe \u6700\u5f8c\u306e\u30bf\u30a4\u30e0\u30b9\u30c6\u30c3\u30d7\u306e RNN \u4e2d\u9593\u5c64\u306e\u5024\u306b\u306f\u3001\u7cfb\u5217\u5168\u2026","width":"100%","blog_title":"\u3089\u3093\u3060\u3080\u306a\u8a18\u61b6","version":"1.0","categories":["machine_learning","MOOC"],"blog_url":"https://randommemory.hatenablog.com/","author_name":"derwind","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Frandommemory.hatenablog.com%2Fentry%2F2020%2F07%2F02%2F002236\" title=\"ga136(\u63a8\u8ad6\u30fb\u77e5\u8b58\u51e6\u7406\u30fb\u81ea\u7136\u8a00\u8a9e\u51e6\u7406)\u307e\u3068\u3081 (4) - \u3089\u3093\u3060\u3080\u306a\u8a18\u61b6\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","title":"ga136(\u63a8\u8ad6\u30fb\u77e5\u8b58\u51e6\u7406\u30fb\u81ea\u7136\u8a00\u8a9e\u51e6\u7406)\u307e\u3068\u3081 (4)","author_url":"https://blog.hatena.ne.jp/derwind/","height":"190"}