{"published":"2021-07-17 10:33:54","author_url":"https://blog.hatena.ne.jp/fanta_orange_grape/","title":"\u3010AI100\u306e\u7591\u554f\u3011No.001: Transformer\u3067cifar10\u304c\u4e0a\u624b\u304f\u5b66\u7fd2\u3067\u304d\u306a\u3044\u7406\u7531","blog_title":"fanta_orange_grape\u306e\uff08\u65e5\u8a18\u3068\u3044\u3046\u3088\u308a\uff09\u8a18\u4e8b\u306e\u3064\u3082\u308a","height":"190","categories":[],"provider_url":"https://hatena.blog","type":"rich","author_name":"fanta_orange_grape","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Ffanta-orange-grape.hatenablog.com%2Fentry%2F2021%2F07%2F17%2F103354\" title=\"\u3010AI100\u306e\u7591\u554f\u3011No.001: Transformer\u3067cifar10\u304c\u4e0a\u624b\u304f\u5b66\u7fd2\u3067\u304d\u306a\u3044\u7406\u7531 - fanta_orange_grape\u306e\uff08\u65e5\u8a18\u3068\u3044\u3046\u3088\u308a\uff09\u8a18\u4e8b\u306e\u3064\u3082\u308a\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","image_url":null,"width":"100%","version":"1.0","blog_url":"https://fanta-orange-grape.hatenablog.com/","url":"https://fanta-orange-grape.hatenablog.com/entry/2021/07/17/103354","description":"AI100\u306e\u7591\u554f\u3002No.001\u3002Transformer\u3067cifar10\u304c\u4e0a\u624b\u304f\u5b66\u7fd2\u3067\u304d\u306a\u3044\u7406\u7531 \u7591\u554f\u306e\u30b9\u30c6\u30fc\u30bf\u30b9 \u672a\u89e3\u6c7a\u3002 \u7591\u554f\u306e\u5185\u5bb9 Attention is all you need\u3067\u6709\u540d\u306aTransformer\u306e\u753b\u50cf\u3078\u306e\u5c55\u958b\u3068\u3057\u3066ViT\u7b49\u304c\u3042\u308b\u304c\u3001\u3053\u308c\u3092\u753b\u50cf\u306e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8cifar10\u306b\u9069\u7528\u3057\u305f\u5834\u5408\u3001\u305f\u3076\u3093\u300190%\u306e\u6b63\u89e3\u304c\u51fa\u305b\u3066\u3044\u306a\u3044\u3068\u601d\u3046\u3002\u3053\u306e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u306f\u3001CNN\u7cfb\u306e\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u3067\u306f\u7c21\u5358\u306b95%\u3068\u304b\u3001\u3082\u3063\u3068\u300198\uff05\u3068\u304b\u51fa\u305b\u308b\uff08\u5f53\u7136\u3001augmentation\u3068\u304b\u306f\u4f7f\u3046\uff09\u3002 \u3055\u3066\u3001\u3053\u308c\u306f\u4f55\u304c\u539f\u56e0\u304b\u3002 \u539f\u56e0\u3068\u3057\u3066\u8003\u3048\u3089\u308c\u308b\u65b9\u5411\u6027\u306f2\u3064\u3002 \u305d\u3082\u305d\u3082\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u304c\u4e0d\u9069\u5207\u3002CNN\u7cfb\u306e\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u2026","provider_name":"Hatena Blog"}