{"version":"1.0","categories":["DL"],"image_url":null,"author_name":"HTN20190109","published":"2025-08-17 15:57:15","provider_url":"https://hatena.blog","blog_title":"HTN20190109\u306e\u65e5\u8a18","type":"rich","title":"\u6d3b\u6027\u5316\u95a2\u6570\u5404\u7a2e","description":"https://data-analytics.fun/2020/09/04/understanding-gelu/ \u30b7\u30b0\u30e2\u30a4\u30c9\uff1a ReLU\uff1a Leaky ReLU\uff1a \u203bPReLU\u3067\u306f\u03b1\u3092\u5b66\u7fd2\u3059\u308b\u3002Leaky ReLU\u306e\u5834\u5408\u306f\u03b1\u306f\u56fa\u5b9aELU(Exponential Linear Unit)\uff1a tanh\uff1a GELU\uff1a Transformer\u306e\u3088\u3046\u306a\u5927\u898f\u6a21\u30e2\u30c7\u30eb\u3067\u4f7f\u7528\u3055\u308c\u308b\u3002 GELU\u8fd1\u4f3c\u5f0f\uff1a","width":"100%","provider_name":"Hatena Blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fhtn20190109.hatenablog.com%2Fentry%2F2025%2F08%2F17%2F155715\" title=\"\u6d3b\u6027\u5316\u95a2\u6570\u5404\u7a2e - HTN20190109\u306e\u65e5\u8a18\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","url":"https://htn20190109.hatenablog.com/entry/2025/08/17/155715","blog_url":"https://htn20190109.hatenablog.com/","height":"190","author_url":"https://blog.hatena.ne.jp/HTN20190109/"}