{"height":"190","width":"100%","description":"max_seq_length=512\u304c\u8d70\u3063\u3066\u3044\u308b\u306e\u306fA6000\u3068\u3044\u304648GB\u306e\u30e1\u30e2\u30ea\u304c\u8f09\u3063\u305fGPU \u3057\u304b\u3057\u3001\u3053\u308c\u306f\u4e00\u57fa\u3057\u304b\u306a\u304f\u3001\u4ed6\u306f1080Ti\u3082\u3057\u304f\u306f2080Ti\u3068\u3044\u3046GPU\u30e1\u30e2\u30ea\u304c11GB\u3057\u304b\u306a\u3044\u3082\u306e\u3002\u305d\u306e\u305f\u3081\u3001max_seq_length=128\u306e\u4e8b\u524d\u5b66\u7fd2\u7528\u306e\u30c7\u30fc\u30bf\u3092\u4f5c\u6210\u3057\u305f\u3046\u3048\u3067\u3001 python3 ../models-2.7.0/official/nlp/bert/run_pretraining.py --input_files=\"bert/jawiki-20220110/wordpiece_unidic_lite/pretraining_data/pretraining_data_*\u2026","version":"1.0","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fbio-linux-etc.hatenablog.com%2Fentry%2F2022%2F02%2F04%2F194600\" title=\"BERT\u4e8b\u524d\u5b66\u7fd2\u309211GB GPU\u3067 - \u3075\u3055\u3075\u3055\u65e5\u8a18\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","title":"BERT\u4e8b\u524d\u5b66\u7fd2\u309211GB GPU\u3067","url":"https://bio-linux-etc.hatenablog.com/entry/2022/02/04/194600","published":"2022-02-04 19:46:00","blog_url":"https://bio-linux-etc.hatenablog.com/","type":"rich","categories":[],"provider_name":"Hatena Blog","author_url":"https://blog.hatena.ne.jp/kopo3/","blog_title":"\u3075\u3055\u3075\u3055\u65e5\u8a18","image_url":null,"author_name":"kopo3","provider_url":"https://hatena.blog"}