{"categories":[],"width":"100%","author_name":"TadaoYamaoka","published":"2022-05-11 23:42:41","blog_title":"TadaoYamaoka\u306e\u958b\u767a\u65e5\u8a18","blog_url":"https://tadaoyamaoka.hatenablog.com/","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Ftadaoyamaoka.hatenablog.com%2Fentry%2F2022%2F05%2F11%2F234241\" title=\"gMLP\u3092\u8a66\u3059 - TadaoYamaoka\u306e\u958b\u767a\u65e5\u8a18\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","height":"190","version":"1.0","provider_name":"Hatena Blog","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/T/TadaoYamaoka/20220511/20220511230417.png","title":"gMLP\u3092\u8a66\u3059","url":"https://tadaoyamaoka.hatenablog.com/entry/2022/05/11/234241","description":"\u307b\u307c\u500b\u4eba\u30e1\u30e2\u3067\u3059\u3002\u753b\u50cf\u8a8d\u8b58\u306e\u30e2\u30c7\u30eb\u3067\u3001\u7573\u307f\u8fbc\u307f\u3092\u4f7f\u308f\u305aMLP\u306e\u307f\u540c\u7b49\u306e\u7cbe\u5ea6\u304c\u51fa\u305b\u308b\u3068\u3044\u3046MLP Mixer\u306e\u767a\u5c55\u5f62\u3067\u3042\u308bgMLP\u3092\u8a66\u3057\u3066\u307f\u305f\u3002 gMLP \u30c1\u30e3\u30cd\u30eb\u65b9\u5411\u3068\u3001\u7a7a\u9593\u65b9\u5411\u306b\u5206\u3051\u3066MLP\u3092\u9069\u7528\u3059\u308b\u69cb\u6210\u306f\u3001MLP Mixer\u3068\u540c\u3058\u3060\u304c\u3001Spatial Gating Unit (SGU)\u3068\u3044\u3046\u4ed5\u7d44\u307f\u3092\u4f7f\u3046\u3053\u3068\u3067\u3001\u7a7a\u9593\u7684\u76f8\u4e92\u4f5c\u7528\u3092\u3068\u3089\u3048\u3089\u308c\u308b\u3088\u3046\u306b\u306a\u308a\u3001\u975e\u6b63\u65b9\u5f62\u306e\u7573\u307f\u8fbc\u307f\u3092\u5b66\u7fd2\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u308b\u305d\u3046\u3060\u3002 \u904e\u5b66\u7fd2\u3057\u3084\u3059\u3044\u305f\u3081\u3001\u5f37\u3044\u6b63\u5247\u5316\u304c\u5fc5\u8981\u3089\u3057\u3044\u3002\u305f\u3060\u3057\u3001\u753b\u50cf\u8a8d\u8b58\u306e\u7cbe\u5ea6\u306f\u6700\u9ad8\u7cbe\u5ea6\u306e\u7573\u307f\u8fbc\u307f\u306e\u30e2\u30c7\u30eb\u306b\u306f\u53ca\u3070\u306a\u3044\u3088\u3046\u3060\u3002 \u81ea\u7136\u8a00\u8a9e\u51e6\u7406\u306b\u3082\u4f7f\u3048\u3066\u3001\u30bf\u30b9\u30af\u306b\u3088\u3063\u3066\u306fBERT\u3068\u540c\u7b49\u306e\u7cbe\u5ea6\u306b\u306a\u308b\u3088\u3046\u3060\u3002Re\u2026","type":"rich","author_url":"https://blog.hatena.ne.jp/TadaoYamaoka/","provider_url":"https://hatena.blog"}