{"author_url":"https://blog.hatena.ne.jp/round-rand/","categories":["Pytorch","torchtext","\u30a8\u30e9\u30fc\u89e3\u6c7a"],"version":"1.0","description":"\u6982\u8981 \u89e3\u6c7a\u65b9\u6cd5 \u6982\u8981 Pytorch\u306e\u516c\u5f0f\u30b5\u30a4\u30c8\u306e\u4ee5\u4e0b\u306e\u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb(https://pytorch.org/text/stable/data_utils.html)\u3092\u5b9f\u884c\u3057\u3088\u3046\u3068\u3057\u305f\u3089\u30a8\u30e9\u30fc\u304c\u30bf\u30a4\u30c8\u30eb\u306b\u793a\u3057\u305f\u30a8\u30e9\u30fc\u304c\u51fa\u307e\u3057\u305f\u3002\u30bd\u30fc\u30b9\u30b3\u30fc\u30c9 import torchtext from torchtext.data import get_tokenizer tokenizer = get_tokenizer(\"basic_english\") tokens = tokenizer(\"You can now install TorchText using pip!\") print(tokens) \u2026","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fml-rand-note.hatenablog.com%2Fentry%2Ftorch-winerror_127\" title=\"\u300cOSError: [WinError 127] \u6307\u5b9a\u3055\u308c\u305f\u30d7\u30ed\u30b7\u30fc\u30b8\u30e3\u304c\u898b\u3064\u304b\u308a\u307e\u305b\u3093\u3002\u300d\u3092\u89e3\u6c7a\u3057\u305f\u8a71 - \u30e9\u30f3\u30c9ML\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","url":"https://ml-rand-note.hatenablog.com/entry/torch-winerror_127","blog_url":"https://ml-rand-note.hatenablog.com/","type":"rich","blog_title":"\u30e9\u30f3\u30c9ML","title":"\u300cOSError: [WinError 127] \u6307\u5b9a\u3055\u308c\u305f\u30d7\u30ed\u30b7\u30fc\u30b8\u30e3\u304c\u898b\u3064\u304b\u308a\u307e\u305b\u3093\u3002\u300d\u3092\u89e3\u6c7a\u3057\u305f\u8a71","published":"2024-10-09 07:30:00","height":"190","author_name":"round-rand","provider_name":"Hatena Blog","image_url":null,"provider_url":"https://hatena.blog","width":"100%"}