{"height":"190","author_url":"https://blog.hatena.ne.jp/sinchir0/","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fbuildersbox.corp-sansan.com%2Fentry%2F2021%2F06%2F21%2F110000\" title=\"\u81ea\u5206\u306eTweet\u3092\u4f7f\u3063\u3066Sentencepiece\u3068MeCab\u306e\u5206\u304b\u3061\u66f8\u304d\u306e\u6bd4\u8f03\u3092\u884c\u3046 - Sansan Tech Blog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","provider_name":"Hatena Blog","type":"rich","author_name":"sinchir0","provider_url":"https://hatena.blog","url":"https://buildersbox.corp-sansan.com/entry/2021/06/21/110000","categories":["\u30c7\u30fc\u30bf\u5206\u6790","\u6a5f\u68b0\u5b66\u7fd2","\u81ea\u7136\u8a00\u8a9e\u51e6\u7406","Python","\u30c7\u30a3\u30fc\u30d7\u30e9\u30fc\u30cb\u30f3\u30b0"],"description":"3\u884c\u3067 \u306f\u3058\u3081\u306b Sentencepiece\u3068\u306f subword\u3068\u306f Sentencepiece\u3067\u306e\u53d6\u308a\u7d44\u307f Sentencepiece\u3068MeCab\u306e\u6bd4\u8f03 \u5229\u7528\u3059\u308b\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8 \u5229\u7528\u3057\u305f\u30b3\u30fc\u30c9 \u9069\u5f53\u306aTweet\u3092\u5206\u304b\u3061\u66f8\u304d\u3057\u3066\u307f\u308b Tweet\u5168\u90e8\u3092\u5206\u304b\u3061\u66f8\u304d\u3057\u3001\u983b\u5ea6\u9806\u306b\u4e26\u3079\u3066\u307f\u308b \u307e\u3068\u3081 \u6ce8\u91c8 3\u884c\u3067 Sentencepiece\u306e\u8ad6\u6587\u6982\u8981\u3092\u8aac\u660e\u3057\u305f\u3002 \u81ea\u8eab\u306eTweet\u3092\u7528\u3044\u3066\u3001Sentencepiece\u3068MeCab\u306e\u5206\u5272\u70b9\u306e\u9055\u3044\u3092\u8abf\u3079\u305f\u3002 Sentencepiece\u3067\u306f\u751f\u6587\u304b\u3089\u751f\u6210\u3055\u308c\u305f\u7279\u5fb4\u7684\u306a\u5206\u5272\u304c\u898b\u3089\u308c\u305f\u3002\u4e00\u65b9\u3001\u4eca\u56de\u306e\u3088\u3046\u306a\u5c11\u306a\u3044\u5b66\u7fd2\u30c7\u30fc\u30bf\u3067\u306f\u4e0a\u624b\u304f\u5206\u5272\u3067\u304d\u306a\u3044\u3002","blog_url":"https://buildersbox.corp-sansan.com/","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/s/sansantech/20260224/20260224170710.png","width":"100%","blog_title":"Sansan Tech Blog","title":"\u81ea\u5206\u306eTweet\u3092\u4f7f\u3063\u3066Sentencepiece\u3068MeCab\u306e\u5206\u304b\u3061\u66f8\u304d\u306e\u6bd4\u8f03\u3092\u884c\u3046","version":"1.0","published":"2021-06-21 11:00:00"}