{"categories":[],"provider_name":"Hatena Blog","image_url":null,"width":"100%","type":"rich","url":"https://ai-de-seikei.hatenablog.com/entry/2023/08/11/201015","height":"190","author_url":"https://blog.hatena.ne.jp/fanta_orange_grape/","blog_url":"https://ai-de-seikei.hatenablog.com/","version":"1.0","description":"\u5358\u306b\u3001setup.py\u3067\u78ba\u8a8d transformers\u306e\u30d0\u30fc\u30b8\u30e7\u30f3 transformers\u30ea\u30ea\u30fc\u30b9\u65e5 tokenizers\u306e\u30d0\u30fc\u30b8\u30e7\u30f3 \u305d\u306e\u4ed6\u306e\u30d0\u30fc\u30b8\u30e7\u30f3 v2.11.0 Jun 2, 2020 tokenizers == 0.7.0 v3.0.0 Jun 30, 2020 tokenizers == 0.8.0-rc4 v4.0.0 Dec 1, 2020 tokenizers == 0.9.4 v4.10.0 Aug 31, 2021 tokenizers>=0.10.1,<0.11 \"torch>=1.0\",\"tensorflow-cpu>=2.3\",\"tensorflow>=2.3\"\u2026","blog_title":"AI\u3046\u3049\uff0d\uff0d\uff01(ai-wo-katsuyo-shitai !)","provider_url":"https://hatena.blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fai-de-seikei.hatenablog.com%2Fentry%2F2023%2F08%2F11%2F201015\" title=\"transformers\u304b\u3089\u307f\u305f(\u306erequest\u3059\u308b\uff09tokenizers\u3068\u304b\u306e\u30d0\u30fc\u30b8\u30e7\u30f3 - AI\u3046\u3049\uff0d\uff0d\uff01(ai-wo-katsuyo-shitai !)\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","author_name":"fanta_orange_grape","published":"2023-08-11 20:10:15","title":"transformers\u304b\u3089\u307f\u305f(\u306erequest\u3059\u308b\uff09tokenizers\u3068\u304b\u306e\u30d0\u30fc\u30b8\u30e7\u30f3"}