{"url":"https://ninhydrin.hatenablog.com/entry/2022/04/20/101448","title":" [\u8ad6\u6587\u30e1\u30e2] DeiT III: Revenge of the ViT","author_name":"Ninhydrin","published":"2022-04-20 10:14:48","width":"100%","blog_title":"\u306b\u3093\u3072\u3069\u308a\u3093\u306f\u3093\u306e\u3046","type":"rich","height":"190","description":"arxiv.orgMeta AI \u305f\u3060\u306e\u6559\u5e2b\u3042\u308a\u5b66\u7fd2\u3060\u3051(\u81ea\u5df1\u6559\u5e2b\u3042\u308a\u5b66\u7fd2\u306a\u3057)\u3067Vision Transformer\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3092\u5411\u4e0a\u3055\u305b\u305f\u3002 Vision Transformer(ViT)\u306fconvolution\u306e\u3088\u3046\u306a\u5e30\u7d0d\u30d0\u30a4\u30a2\u30b9\u304c\u7121\u3044\u5206\u80fd\u529b\u306f\u9ad8\u3044\u304c\u5b66\u7fd2\u3057\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3092\u51fa\u3059\u306e\u304c\u96e3\u3057\u304f\u3001\u4e8b\u524d\u5b66\u7fd2\u3068\u3057\u3066BerT\u306e\u3088\u3046\u306a\u81ea\u5df1\u6559\u5e2b\u3042\u308a\u5b66\u7fd2\u304c\u91cd\u8981\u3068\u8003\u3048\u3089\u308c\u3066\u304d\u305f\u304c\u672c\u5f53\u306b\u305d\u3046\u306a\u306e\u304b\uff1f\u3068\u3044\u3046\u304a\u6c17\u6301\u3061 \u3042\u304f\u307e\u3067\u3053\u306e\u8b70\u8ad6\u3092\u76db\u308a\u4e0a\u3052\u3088\u3046\u3068\u3044\u3046\u3053\u3068\u3002 \u624b\u6cd5 VIT\u7528\u306b\u6559\u5e2b\u3042\u308a\u5b66\u7fd2\u3092\u5de5\u592b\u3059\u308b\u3002\u5177\u4f53\u7684\u306b\u306f augmentation\u306e\u898b\u76f4\u3057 \u6b63\u5247\u5316\u8ffd\u52a0 loss\u306e\u898b\u76f4\u3057 crop\u65b9\u6cd5\u306e\u898b\u76f4\u3057 \u4f4e\u89e3\u50cf\u5ea6\u3067\u306e\u30ab\u30ea\u2026","author_url":"https://blog.hatena.ne.jp/Ninhydrin/","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fninhydrin.hatenablog.com%2Fentry%2F2022%2F04%2F20%2F101448\" title=\" [\u8ad6\u6587\u30e1\u30e2] DeiT III: Revenge of the ViT - \u306b\u3093\u3072\u3069\u308a\u3093\u306f\u3093\u306e\u3046\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","categories":["\u8ad6\u6587\u30e1\u30e2","ViT","ResNet","augmentation"],"version":"1.0","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/N/Ninhydrin/20220419/20220419091058.png","provider_name":"Hatena Blog","provider_url":"https://hatena.blog","blog_url":"https://ninhydrin.hatenablog.com/"}