{"title":"C# \u3060\u3051\u3067 Azure OpenAI \u306e RAG \u3092\u8a66\u3057\u3066\u307f\u305f\u3044 \uff083\uff09TokenCounter \u306e\u5b9f\u88c5","categories":["C#","Azure OpenAI"],"url":"https://hiro128.hatenablog.jp/entry/2024/02/26/000000","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fhiro128.hatenablog.jp%2Fentry%2F2024%2F02%2F26%2F000000\" title=\"C# \u3060\u3051\u3067 Azure OpenAI \u306e RAG \u3092\u8a66\u3057\u3066\u307f\u305f\u3044 \uff083\uff09TokenCounter \u306e\u5b9f\u88c5 - \u500b\u4eba\u7684\u306a\u30e1\u30e2\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","provider_name":"Hatena Blog","provider_url":"https://hatena.blog","author_name":"hiro128","width":"100%","type":"rich","height":"190","version":"1.0","description":"TokenCounter \u306e\u5b9f\u88c5 Tokenizer \u306e\u30e9\u30a4\u30d6\u30e9\u30ea \u4f5c\u6210\u3057\u305f C# \u306e\u30bd\u30fc\u30b9\u30b3\u30fc\u30c9 \u524d\u306e\u8a18\u4e8b hiro128.hatenablog.jp TokenCounter \u306e\u5b9f\u88c5 SplitPlainTextParagraphs \u30e1\u30bd\u30c3\u30c9\u3067\u6b63\u3057\u304f\u30c8\u30fc\u30af\u30f3\u3092\u30ab\u30a6\u30f3\u30c8\u3059\u308b\u305f\u3081\u306b\u5fc5\u8981\u306a tokenCounter \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306f\u30bd\u30fc\u30b9\u30b3\u30fc\u30c9\u3092\u78ba\u8a8d\u3059\u308b\u3068\u3001string \u3092\u53d7\u3051\u53d6\u308a\u3001int \u3092\u8fd4\u3059\u30c7\u30ea\u30b2\u30fc\u30c8\u306b\u306a\u3063\u3066\u304a\u308a\u3001\u6587\u5b57\u5217\u5185\u306e\u30c8\u30fc\u30af\u30f3\u3092\u30ab\u30a6\u30f3\u30c8\u3059\u308b\u95a2\u6570\u3092\u4e0e\u3048\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u6307\u5b9a\u3057\u306a\u3044\u5834\u5408\u306f\u3001\u30c7\u30d5\u30a9\u30eb\u30c8\u306e\u30ab\u30a6\u30f3\u30bf\u30fc\u304c\u4f7f\u7528\u3055\u308c\u307e\u3059\u304c\u3001\u610f\u56f3\u3057\u306a\u3044\u30ab\u30a6\u30f3\u30c8\u3092\u3055\u308c\u3066\u3057\u307e\u3046\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002\u3088\u3063\u3066\u3001\u81ea\u5206\u2026","blog_url":"https://hiro128.hatenablog.jp/","blog_title":"\u500b\u4eba\u7684\u306a\u30e1\u30e2","author_url":"https://blog.hatena.ne.jp/hiro128/","image_url":null,"published":"2024-02-26 00:00:00"}