{"version":"1.0","blog_url":"https://ai-de-seikei.hatenablog.com/","title":"BERT\u306f\u3002\u4f55\u3092\u30c7\u30fc\u30bf\u3068\u3057\u3066\u4e8b\u524d\u5b66\u7fd2\u3057\u3066\u3044\u308b\u306e\u304b\uff1f","published":"2023-07-22 10:23:24","blog_title":"AI\u3046\u3049\uff0d\uff0d\uff01(ai-wo-katsuyo-shitai !)","description":"\u7b54\u3048\u304c0\u79d2\u3067\u6ca2\u5c71\u3048\u3089\u308c\u307e\u3059\u3002\u3002\u3002\u3002\u53cd\u7701\u3002 Wikipedia\u306b\u3088\u308b\u3068 (\u4e21\u30e2\u30c7\u30eb\u3068\u3082\u3001)Toronto BookCorpus[12]\uff088\u5104\u8a9e\uff09\u3068\u3001\u82f1\u8a9e\u7248Wikipedia\uff0825\u5104\u8a9e\uff09\u3067\u4e8b\u524d\u8a13\u7df4\u3055\u308c\u305f\u3002 \u5f15\u7528\u5143\uff1a https://ja.wikipedia.org/wiki/BERT_(%E8%A8%80%E8%AA%9E%E3%83%A2%E3%83%87%E3%83%AB) \u305d\u3082\u305d\u3082\u306eBert\u306e\u8ad6\u6587\u306b\u3088\u308b\u3068 Pre-training data The pre-training procedure largely follows the existing literature on langua\u2026","author_name":"fanta_orange_grape","provider_url":"https://hatena.blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fai-de-seikei.hatenablog.com%2Fentry%2F2023%2F07%2F22%2F102324\" title=\"BERT\u306f\u3002\u4f55\u3092\u30c7\u30fc\u30bf\u3068\u3057\u3066\u4e8b\u524d\u5b66\u7fd2\u3057\u3066\u3044\u308b\u306e\u304b\uff1f - AI\u3046\u3049\uff0d\uff0d\uff01(ai-wo-katsuyo-shitai !)\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","width":"100%","image_url":null,"categories":[],"provider_name":"Hatena Blog","height":"190","author_url":"https://blog.hatena.ne.jp/fanta_orange_grape/","type":"rich","url":"https://ai-de-seikei.hatenablog.com/entry/2023/07/22/102324"}