{"image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/l/lib-arts/20191125/20191125191712.png","author_url":"https://blog.hatena.ne.jp/lib-arts/","author_name":"lib-arts","height":"190","blog_title":"Liberal Art\u2019s diary","version":"1.0","provider_url":"https://hatena.blog","type":"rich","url":"https://lib-arts.hatenablog.com/entry/nlp_dl29","title":"T5(Text-toText Transfer Transformer)\u2463\uff08Section3_Experiments\uff09\uff5c\u8a00\u8a9e\u51e6\u7406\u3078\u306eDeepLearning\u306e\u5c0e\u5165\u306e\u7814\u7a76\u30c8\u30ec\u30f3\u30c9\u3092\u4fef\u77b0\u3059\u308b #29","published":"2019-12-28 11:00:00","description":"\u8a00\u8a9e\u51e6\u7406\u3078\u306eDeepLearning\u306e\u5c0e\u5165\u3092\u3054\u7d39\u4ecb\u3059\u308b\u306b\u3042\u305f\u3063\u3066\u3001#3\u301c#8\u306b\u304a\u3044\u3066\u306f\u3001Transformer[2017]\u3084BERT[2018]\u306b\u3064\u3044\u3066\u3001#9~#10\u3067\u306fXLNet[2019]\u306b\u3064\u3044\u3066\u3001#11~#12\u3067\u306fTransformer-XL[2019]\u306b\u3064\u3044\u3066\u3001#13~#17\u3067\u306fRoBERTa[2019]\u306b\u3064\u3044\u3066\u3001#18~#20\u3067\u306fWord2Vec[2013]\u306b\u3064\u3044\u3066\u3001#21~#24\u3067\u306fALBERT[2019]\u306b\u3064\u3044\u3066\u53d6\u308a\u6271\u3063\u3066\u304d\u307e\u3057\u305f\u3002 BERT\u30ea\u30dd\u30b8\u30c8\u30ea\u306e\u30b5\u30f3\u30d7\u30eb\u5b9f\u884c\u306e\u6d41\u308c\uff5c\u8a00\u8a9e\u51e6\u7406\u3078\u306eDeepLearning\u306e\u5c0e\u5165\u306e\u7814\u7a76\u30c8\u30ec\u30f3\u30c9\u3092\u4fef\u77b0\u3059\u308b #6 - lib-arts\u2019s diar\u2026","categories":["DeepLearning","Machine Learning","NLP","paper","trend"],"blog_url":"https://lib-arts.hatenablog.com/","provider_name":"Hatena Blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Flib-arts.hatenablog.com%2Fentry%2Fnlp_dl29\" title=\"T5(Text-toText Transfer Transformer)\u2463\uff08Section3_Experiments\uff09\uff5c\u8a00\u8a9e\u51e6\u7406\u3078\u306eDeepLearning\u306e\u5c0e\u5165\u306e\u7814\u7a76\u30c8\u30ec\u30f3\u30c9\u3092\u4fef\u77b0\u3059\u308b #29 - Liberal Art\u2019s diary\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","width":"100%"}