{"version":"1.0","url":"https://y-nakajo.hatenablog.com/entry/2022/03/13/182459","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fy-nakajo.hatenablog.com%2Fentry%2F2022%2F03%2F13%2F182459\" title=\"BERT\u306epre-training\u3092\u3084\u3063\u3066\u307f\u305f\u3000\u301c\u96d1\u8a18\u301c - \u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u3068\u304b\u30aa\u30fc\u30c0\u30fc\u3068\u304b\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","blog_url":"https://y-nakajo.hatenablog.com/","width":"100%","author_name":"y_nakajo","type":"rich","title":"BERT\u306epre-training\u3092\u3084\u3063\u3066\u307f\u305f\u3000\u301c\u96d1\u8a18\u301c","blog_title":"\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u3068\u304b\u30aa\u30fc\u30c0\u30fc\u3068\u304b","image_url":null,"provider_name":"Hatena Blog","author_url":"https://blog.hatena.ne.jp/y_nakajo/","height":"190","description":"\u4eca\u56de\u306f\u6df1\u5c64\u5b66\u7fd2\u306e\u81ea\u7136\u8a00\u8a9e\u30e2\u30c7\u30eb\u3067\u3042\u308b\u3001BERT\u306b\u3064\u3044\u3066\u8272\u3005\u89e6\u3063\u3066\u3044\u305f\u306e\u3067\u305d\u306e\u8a18\u9332\u3092\u7c21\u5358\u306b\u307e\u3068\u3081\u305f\u3044\u3068\u601d\u3046\u3002 \u3072\u3087\u3093\u306a\u3053\u3068\u304b\u3089\u3001BERT\u306e\u4e8b\u524d\u5b66\u7fd2\u304b\u3089\u3084\u3089\u306a\u3051\u308c\u3070\u306a\u3089\u306a\u304b\u3063\u305f\u306e\u3067\u3001\u5b9f\u969b\u306b\u7528\u3044\u305f\u30e9\u30a4\u30d6\u30e9\u30ea\u3084\u74b0\u5883\u3001\u5b66\u7fd2\u306b\u5fc5\u8981\u306a\u6642\u9593\u306a\u3069\u306b\u3064\u3044\u3066\u66f8\u3044\u3066\u3044\u304f\u3002 BERT\u306e\u30e9\u30a4\u30d6\u30e9\u30ea \u5b66\u7fd2\u74b0\u5883 AMI Instance Type inf1.2xlarge p2\u7cfb p3.2xlarge p3.8xlarge g4dn.8xlarge g4dn.12xlarge \u4eca\u56de\u5b66\u3093\u3060\u3053\u3068 BERT\u306e\u30e9\u30a4\u30d6\u30e9\u30ea BERT\u306e\u30e9\u30a4\u30d6\u30e9\u30ea\u3068\u3057\u3066\u306f\u3001huggingface\u306eTransformers\u3092\u5229\u7528\u3002 huggingface.\u2026","provider_url":"https://hatena.blog","published":"2022-03-13 18:24:59","categories":[]}