{"published":"2024-03-26 01:27:52","type":"rich","author_name":"ayousanz","provider_name":"Hatena Blog","categories":["AI"],"url":"https://ayousanz.hatenadiary.jp/entry/2024/03/26/012752","blog_title":"yousan\u306e\u30e1\u30e2","provider_url":"https://hatena.blog","author_url":"https://blog.hatena.ne.jp/ayousanz/","width":"100%","description":"\u521d\u3081\u306b \u958b\u767a\u74b0\u5883 \u74b0\u5883\u69cb\u7bc9 \u8a55\u4fa1\u30b3\u30fc\u30c9 \u7d50\u679c sentencepiece\u3092\u4f7f\u3063\u305f\u5834\u5408 \u53c2\u8003\u30b5\u30a4\u30c8 \u521d\u3081\u306b \u4ee5\u4e0b\u3067LLM\u3092\u4f7f\u3063\u3066\u6587\u7ae0\u306e\u8a55\u4fa1\u3092\u3057\u3066\u3044\u307e\u3059\u304c\u3001\u901f\u5ea6\u304c\u901f\u3044\u3068\u8a00\u308f\u308c\u308bKenLM\u3067\u3082\u8a55\u4fa1\u3057\u3066\u307f\u307e\u3059 ayousanz.hatenadiary.jp \u958b\u767a\u74b0\u5883 Ubuntu22.02 \u74b0\u5883\u69cb\u7bc9 sudo apt install build-essential cmake libboost-system-dev libboost-thread-dev libboost-program-options-dev libboost-test-dev libeigen3-dev zlib1g-dev li\u2026","blog_url":"https://ayousanz.hatenadiary.jp/","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fayousanz.hatenadiary.jp%2Fentry%2F2024%2F03%2F26%2F012752\" title=\"KenLM\u3067\u65e5\u672c\u8a9e\u6587\u7ae0\u306e\u54c1\u8cea\u306e\u8a55\u4fa1 - yousan\u306e\u30e1\u30e2\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","version":"1.0","title":"KenLM\u3067\u65e5\u672c\u8a9e\u6587\u7ae0\u306e\u54c1\u8cea\u306e\u8a55\u4fa1","height":"190","image_url":null}