{"provider_name":"Hatena Blog","published":"2020-06-17 06:50:41","description":"\u5148\u65e5\u3001Transformers\u306e\u4e8b\u524d\u5b66\u7fd2\u6e08\u307f\u30e2\u30c7\u30eb\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u3066\u4fdd\u5b58\u3059\u308b\u5fc5\u8981\u304c\u3042\u3063\u305f\u306e\u3067\u305d\u306e\u65b9\u6cd5\u3092\u7d39\u4ecb\u3002 \u7d50\u8ad6\u3068\u3057\u3066\u3001\u30e2\u30c7\u30eb\u306e\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u306f\u304a\u306a\u3058\u307f\u306efrom_pretrained\u3067\u884c\u3044\u3001\u4fdd\u5b58\u306fsave_pretrained\u3067\u884c\u3046\u3002 \u3061\u306a\u307f\u306b\u3001\u3053\u308c\u3092\u3057\u305f\u304b\u3063\u305f\u7406\u7531\u306f\u3001\u30e2\u30c7\u30eb\u3092S3\u306b\u30a2\u30c3\u30d7\u30ed\u30fc\u30c9\u3057\u3066SageMaker\u306e\u30a8\u30f3\u30c9\u30dd\u30a4\u30f3\u30c8\u306b\u30c7\u30d7\u30ed\u30a4\u3057\u305f\u304b\u3063\u305f\u305f\u3081\u3002 from transformers import AutoTokenizer, AutoModelForQuestionAnswering # Download a model and a tokenizer. tokenizer = \u2026","author_url":"https://blog.hatena.ne.jp/Hironsan/","title":"Transformers\u306e\u4e8b\u524d\u5b66\u7fd2\u6e08\u307f\u30e2\u30c7\u30eb\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u3066\u4fdd\u5b58\u3059\u308b","url":"https://hironsan.hatenablog.com/entry/how-to-download-transformers-pretrained-models","categories":["transformers"],"html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fhironsan.hatenablog.com%2Fentry%2Fhow-to-download-transformers-pretrained-models\" title=\"Transformers\u306e\u4e8b\u524d\u5b66\u7fd2\u6e08\u307f\u30e2\u30c7\u30eb\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u3066\u4fdd\u5b58\u3059\u308b - Ahogrammer\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","type":"rich","height":"190","author_name":"Hironsan","width":"100%","image_url":null,"provider_url":"https://hatena.blog","blog_url":"https://hironsan.hatenablog.com/","version":"1.0","blog_title":"Ahogrammer"}