{"description":"\u304a\u75b2\u308c\u69d8\u3067\u3059\u3002 \u753b\u50cf\u5206\u985e\u30e2\u30c7\u30eb\u306eDeiT\u306b\u3064\u3044\u3066\u3001\u4f7f\u3046\u6a5f\u4f1a\u304c\u3042\u308a\u5185\u5bb9\u3092\u8abf\u3079\u3066\u307f\u305f\u306e\u3067\u30e1\u30e2\u7684\u306b\u307e\u3068\u3081\u3066\u304a\u304d\u307e\u3059\u3002 \u8ad6\u6587 arxiv.org \u8981\u7d04\uff08from ChatGPT\uff09 \u80cc\u666f Vision Transformer (ViT) \u306f\u81ea\u7136\u8a00\u8a9e\u51e6\u7406\u306eTransformer\u3092\u753b\u50cf\u5206\u985e\u306b\u5fdc\u7528\u3057\u305f\u30e2\u30c7\u30eb\u3060\u304c\u3001\u5f93\u6765\u306f\u6570\u5104\u679a\u898f\u6a21\u306e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\uff08\u4f8b: JFT-300M\uff09\u3068\u5927\u898f\u6a21\u8a08\u7b97\u8cc7\u6e90\u304c\u5fc5\u8981\u3067\u3001\u4e00\u822c\u7684\u306a\u5229\u7528\u306f\u96e3\u3057\u304b\u3063\u305f\u3002 \u63d0\u6848\u624b\u6cd5\uff08DeiT: Data-efficient image Transformers\uff09 ImageNet (1.3M\u679a) \u306e\u307f\u3092\u4f7f\u3044\u3001\u5358\u4e00\u306eGPU\u30ce\u30fc\u30c9\uff088GPU\uff09\u3067 3\u65e5\u4ee5\u5185 \u306b\u9ad8\u7cbe\u5ea6\u306a\u2026","author_name":"fallpoke","version":"1.0","author_url":"https://blog.hatena.ne.jp/fallpoke/","type":"rich","url":"https://fallpoke-tech.hatenadiary.jp/entry/2025/09/18/233529","height":"190","categories":["\u6a5f\u68b0\u5b66\u7fd2","\u753b\u50cf\u51e6\u7406","Python","\u5099\u5fd8\u9332"],"provider_url":"https://hatena.blog","title":"\u753b\u50cf\u5206\u985e\u30e2\u30c7\u30ebDeiT\u306b\u3064\u3044\u3066\u8abf\u3079\u305f\u307e\u3068\u3081","published":"2025-09-18 23:35:29","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/f/fallpoke/20250918/20250918232634.png","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Ffallpoke-tech.hatenadiary.jp%2Fentry%2F2025%2F09%2F18%2F233529\" title=\"\u753b\u50cf\u5206\u985e\u30e2\u30c7\u30ebDeiT\u306b\u3064\u3044\u3066\u8abf\u3079\u305f\u307e\u3068\u3081 - \u8ab0\u304b\u306e\u6280\u8853\u7f6e\u304d\u5834\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","blog_url":"https://fallpoke-tech.hatenadiary.jp/","blog_title":"\u8ab0\u304b\u306e\u6280\u8853\u7f6e\u304d\u5834","provider_name":"Hatena Blog","width":"100%"}