{"image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/K/Kazuhira/20231204/20231204172402.png","published":"2023-12-04 23:03:04","type":"rich","provider_name":"Hatena Blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fkazuhira-r.hatenablog.com%2Fentry%2F2023%2F12%2F04%2F230304\" title=\"tiktoken\u3092\u4f7f\u3063\u3066\u30c6\u30ad\u30b9\u30c8\u3092\u30c8\u30fc\u30af\u30f3\u306b\u5909\u63db\u3057\u3066\u307f\u308b - CLOVER\ud83c\udf40\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","url":"https://kazuhira-r.hatenablog.com/entry/2023/12/04/230304","provider_url":"https://hatena.blog","description":"\u3053\u308c\u306f\u3001\u306a\u306b\u3092\u3057\u305f\u304f\u3066\u66f8\u3044\u305f\u3082\u306e\uff1f \u3053\u3061\u3089\u306e\u30a8\u30f3\u30c8\u30ea\u30fc\u3092\u66f8\u3044\u305f\u6642\u306b\u3001OpenAI API\u306b\u304a\u3051\u308b\u4e3b\u8981\u306a\u6982\u5ff5\u3092\u307e\u3068\u3081\u3066\u307f\u307e\u3057\u305f\u3002 OpenAI Python API\u30e9\u30a4\u30d6\u30e9\u30ea\u30fc\u304b\u3089llama-cpp-python\u3067\u7acb\u3066\u305fOpenAI API\u4e92\u63db\u306e\u30b5\u30fc\u30d0\u30fc\u3078\u30a2\u30af\u30bb\u30b9\u3057\u3066\u307f\u308b - CLOVER\ud83c\udf40 \u3053\u306e\u3046\u3061\u3001\u30c8\u30fc\u30af\u30f3\u306e\u6570\u3048\u65b9\u304c\u6c17\u306b\u306a\u308b\u3068\u3044\u3046\u304b\u3001tiktoken\u3092\u4f7f\u3046\u3068\u81ea\u5206\u3067\u3082\u6587\u5b57\u5217\u3092\u30c8\u30fc\u30af\u30f3\u3068\u3057\u3066\u6570\u3048\u3089\u308c\u308b\u3088\u3046\u306a\u306e\u3067\u8a66\u3057\u3066\u304a\u3053\u3046\u304b\u306a\u3068 \u601d\u3044\u307e\u3057\u3066\u3002 \u30c8\u30fc\u30af\u30f3 \u3042\u3089\u305f\u3081\u3066\u3001\u3053\u3061\u3089\u3092\u78ba\u8a8d\u3057\u307e\u3059\u3002 Introduction \u30c8\u30fc\u30af\u30f3\u3068\u306f\u3001\u4ee5\u4e0b\u306e\u6982\u5ff5\u3067\u3059\u3002 \u30c6\u30ad\u30b9\u30c8\u751f\u6210\u30e2\u30c7\u30eb\u304a\u3088\u3073\u57cb\u3081\u8fbc\u307f\u306b\u304a\u3051\u308b\u51e6\u7406\u5358\u4f4d\u3067\u3001\u2026","version":"1.0","title":"tiktoken\u3092\u4f7f\u3063\u3066\u30c6\u30ad\u30b9\u30c8\u3092\u30c8\u30fc\u30af\u30f3\u306b\u5909\u63db\u3057\u3066\u307f\u308b","blog_title":"CLOVER\ud83c\udf40","height":"190","author_url":"https://blog.hatena.ne.jp/Kazuhira/","blog_url":"https://kazuhira-r.hatenablog.com/","author_name":"Kazuhira","width":"100%","categories":["OpenAI"]}