{"author_url":"https://blog.hatena.ne.jp/HTN20190109/","height":"190","provider_url":"https://hatena.blog","version":"1.0","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fhtn20190109.hatenablog.com%2Fentry%2F2025%2F12%2F03%2F003758\" title=\"Vision Transformer(ViT) - HTN20190109\u306e\u65e5\u8a18\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","type":"rich","blog_url":"https://htn20190109.hatenablog.com/","image_url":null,"title":"Vision Transformer(ViT)","description":"https://qiita.com/wakayama_90b/items/32fb39e0d609148478c1 \u25a0Vision Transformer \u30fbTransformer \u306e\u30a8\u30f3\u30b3\u30fc\u30c0\u306b\u76f8\u5f53\u3059\u308b\u90e8\u5206\u3092\u542b\u3080\u30d1\u30c3\u30c1\u5206\u5272 \u30fb\u4f4d\u7f6e\u57cb\u3081\u8fbc\u307f\u306f\u30aa\u30ea\u30b8\u30ca\u30eb\u3068\u7570\u306a\u308a\u3001\u52fe\u914d\u6cd5\u3067\u5b66\u7fd2 \u30fb\u30af\u30e9\u30b9\u30c8\u30fc\u30af\u30f3 \u30fb\u30a8\u30f3\u30b3\u30fc\u30c0\u30d6\u30ed\u30c3\u30af\u306e\u6d3b\u6027\u5316\u95a2\u6570\u306fGELU\u3002(\u30aa\u30ea\u30b8\u30ca\u30eb\u306fReLU) \u30fb\u30ec\u30a4\u30e4\u30fc\u6b63\u898f\u5316\u3092\u3001Attention\u3084\u5168\u7d50\u5408\u5c64\u306e\u524d\u306b\u914d\u7f6e \u30fb\u30d5\u30a1\u30a4\u30f3\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u6642\u306f\u4e8b\u524d\u5b66\u7fd2\u6642\u3068\u30d1\u30c3\u30c1\u30b5\u30a4\u30ba\u3092\u63c3\u3048\u308b\u3002\u305d\u306e\u969b\u306b\u767a\u751f\u3059\u308b\u3001\u30d1\u30c3\u30c1\u679a\u6570\u5909\u5316\u306b\u5bfe\u3057\u3066\u306f\u3001\u4e8b\u524d\u5b66\u7fd2\u3057\u305f\u4f4d\u7f6e\u30a8\u30f3\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\u30922\u6b21\u5143\u88dc\u9593\u3059\u308b\u3002 \u30fbViT\u306e\u5165\u529b\u30d9\u30af\u30c8\u2026","width":"100%","author_name":"HTN20190109","provider_name":"Hatena Blog","blog_title":"HTN20190109\u306e\u65e5\u8a18","categories":["DL"],"published":"2025-12-03 00:37:58","url":"https://htn20190109.hatenablog.com/entry/2025/12/03/003758"}