{"categories":["nlp","ngram language model"],"author_name":"sh111h","published":"2022-06-14 09:30:00","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Feieito.hatenablog.com%2Fentry%2F2022%2F06%2F14%2F093000\" title=\"NLTK\u306engram\u8a00\u8a9e\u30e2\u30c7\u30eb\u3092\u65e5\u672c\u8a9e\u30c7\u30fc\u30bf\u3067\u4f7f\u3046 - \u30a8\u30a4\u30a8\u30a4\u30ec\u30c8\u30ea\u30c3\u30af\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","provider_url":"https://hatena.blog","blog_url":"https://eieito.hatenablog.com/","image_url":null,"height":"190","width":"100%","type":"rich","title":"NLTK\u306engram\u8a00\u8a9e\u30e2\u30c7\u30eb\u3092\u65e5\u672c\u8a9e\u30c7\u30fc\u30bf\u3067\u4f7f\u3046","blog_title":"\u30a8\u30a4\u30a8\u30a4\u30ec\u30c8\u30ea\u30c3\u30af","description":"\u4ee5\u524d\u306e\u8a18\u4e8b\u3067\u3001\u53e4\u5178\u7684ngram\u8a00\u8a9e\u30e2\u30c7\u30eb\u306b\u3064\u3044\u3066\u3001NLTK\u3092\u5229\u7528\u3057\u3001\u82f1\u8a9e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u306e\u7d50\u679c\u3092\u307e\u3068\u3081\u307e\u3057\u305f\u3002 eieito.hatenablog.com \u5358\u8a9e\u3092\u5206\u304b\u3061\u66f8\u304d\u3055\u3048\u3059\u308c\u3070\u65e5\u672c\u8a9e\u3067\u3082\u5b9f\u884c\u53ef\u80fd\u306a\u306e\u3067\u3001\u65e5\u672c\u8a9e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3067\u30d1\u30fc\u30d7\u30ec\u30ad\u30b7\u30c6\u30a3\u3092\u7b97\u51fa\u3057\u3066\u3044\u304d\u307e\u3059\u3002 \u30c7\u30fc\u30bf \u5b66\u7fd2\u30c7\u30fc\u30bf\u3068\u30c6\u30b9\u30c8\u30c7\u30fc\u30bf\u306e\u6e96\u5099\u3002 ngram\u30c7\u30fc\u30bf\u3055\u3048\u3042\u308c\u3070plain text\u304c\u306a\u304f\u3068\u3082\u5b9f\u88c5\u3067\u304d\u307e\u3059\u304c\u3001\u8a55\u4fa1\u306e\u305f\u3081\u306b\u306f\u5b66\u7fd2\u30c7\u30fc\u30bf\u3068\u540c\u3058\u6027\u8cea\u306e\u30c6\u30b9\u30c8\u30c7\u30fc\u30bf\uff08plain text\uff09\u304c\u5fc5\u8981\u3067\u3059\u3002 Wikitext-JA \u306f Wikipedia\u30c7\u30fc\u30bf\u304ctrain/test\u306b\u5206\u5272\u3055\u308c\u3066\u3044\u308b\u306e\u3067\u4eca\u56de\u5229\u7528\u3057\u307e\u3059\u3002 \u30c7\u30fc\u30bf\u3082\u300c\u79c0\u9038\u306a\u8a18\u4e8b\u300d\u3068\u300c\u2026","author_url":"https://blog.hatena.ne.jp/sh111h/","url":"https://eieito.hatenablog.com/entry/2022/06/14/093000","version":"1.0","provider_name":"Hatena Blog"}