{"description":"\u3053\u3093\u306b\u3061\u306f\u3002SB Intuitions \u3067 LLM \u306e\u8a55\u4fa1\u3092\u62c5\u5f53\u3057\u3066\u3044\u308b \u5ca1 \u7167\u6643\u3001\u67f4\u7530 \u77e5\u79c0 \u3067\u3059\u3002 \u672c\u8a18\u4e8b\u3067\u306f\u6211\u3005\u304c\u69cb\u7bc9\u30fb\u516c\u958b\u3057\u305f\u65e5\u672c\u8a9e\u306e\u30d9\u30f3\u30c1\u30de\u30fc\u30af\u300eJamC-QA\uff08Japanese Multiple Choice QA, \u30b8\u30e3\u30e0\u30b7\u30fc\u30ad\u30e5\u30fc\u30a8\u30fc\uff09\u300f[\u5ca1+, 25]\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002 JamC-QA \u306f\u65e5\u672c\u56fa\u6709\u306e\u77e5\u8b58\uff08e.g., \u65e5\u672c\u306e\u6587\u5316\u3001\u98a8\u7fd2\u3001...\uff09\u3092\u554f\u3046\u8cea\u554f\u5fdc\u7b54\u30d9\u30f3\u30c1\u30de\u30fc\u30af\u3067\u3059\u3002 \u554f\u984c\u5f62\u5f0f\u306f JCommonsenseQA [\u6817\u539f+, 23] \u3084 JMMLU \u3068\u3044\u3063\u305f\u65e2\u5b58\u306e\u30d9\u30f3\u30c1\u30de\u30fc\u30af\u3068\u540c\u3058\u591a\u80a2\u9078\u629e\u5f0f\u3067\u3059\u304c\u3001 \u96e3\u5ea6\u306f\u305d\u308c\u3089\u3088\u308a\u9ad8\u304f\u3001 \u4e0b\u8a18\u306e\u8a55\u4fa1\u7d50\u679c\u3092\u898b\u3066\u3082\u3001JamC-QA \u3067\u306f\u30b9\u30b3\u30a2\u304c\u4e00\u2026","provider_name":"Hatena Blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fwww.sbintuitions.co.jp%2Fblog%2Fentry%2F2025%2F09%2F09%2F113113\" title=\"\u300eJamC-QA\u300f: \u65e5\u672c\u306e\u6587\u5316\u3084\u98a8\u7fd2\u306b\u7279\u5316\u3057\u305f\u8cea\u554f\u5fdc\u7b54\u30d9\u30f3\u30c1\u30de\u30fc\u30af\u306e\u69cb\u7bc9\u30fb\u516c\u958b\uff08\u524d\u7de8\uff09 - SB Intuitions TECH BLOG\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","author_url":"https://blog.hatena.ne.jp/yama_flush_winter/","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/y/yama_flush_winter/20250808/20250808113343.png","blog_title":"SB Intuitions TECH BLOG","blog_url":"https://www.sbintuitions.co.jp/blog/","url":"https://www.sbintuitions.co.jp/blog/entry/2025/09/09/113113","type":"rich","author_name":"yama_flush_winter","version":"1.0","title":"\u300eJamC-QA\u300f: \u65e5\u672c\u306e\u6587\u5316\u3084\u98a8\u7fd2\u306b\u7279\u5316\u3057\u305f\u8cea\u554f\u5fdc\u7b54\u30d9\u30f3\u30c1\u30de\u30fc\u30af\u306e\u69cb\u7bc9\u30fb\u516c\u958b\uff08\u524d\u7de8\uff09","height":"190","width":"100%","categories":["Evaluation","LLM"],"published":"2025-09-09 11:31:13","provider_url":"https://hatena.blog"}