{"type":"rich","categories":[],"url":"https://www.sbintuitions.co.jp/blog/entry/2024/11/25/175000","author_url":"https://blog.hatena.ne.jp/shot4410/","blog_url":"https://www.sbintuitions.co.jp/blog/","height":"190","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/s/shot4410/20241124/20241124201523.png","blog_title":"SB Intuitions TECH BLOG","description":"\u6982\u8981 SB Intuitions\u306eSeng Pei Liew\u3001\u674e\u51cc\u5bd2\u3001\u9ad8\u702c\u7fd4\u3067\u3059\u3002 \u5f0a\u793e\u3067\u306f\u65e5\u672c\u8a9e\u80fd\u529b\u306b\u4e3b\u773c\u3092\u7f6e\u3044\u305f\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb\u306e\u69cb\u7bc9\u306b\u53d6\u308a\u7d44\u3093\u3067\u304a\u308a\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u5927\u898f\u6a21\u5316\u306e\u305f\u3081\u306e\u65bd\u7b56\u3068\u3057\u3066\u3001\u5b66\u7fd2\u6e08\u307f\u306e70B\u30d1\u30e9\u30e1\u30fc\u30bf*1\u3092Mixture-of-Experts\uff08MoE\uff09\u30e2\u30c7\u30eb\u306b\u62e1\u5f35\u3057\u3001\u4e8b\u524d\u5b66\u7fd2\u3092\u884c\u3063\u305f\u30e2\u30c7\u30eb\u3092Sarashina2-8x70B\u3068\u3057\u3066\u516c\u958b\u3057\u307e\u3057\u305f\u3002 \u8a00\u8a9e\u30e2\u30c7\u30eb\u306e100B\u30d1\u30e9\u30e1\u30fc\u30bf\u4ee5\u4e0a\u307e\u3067\u306e\u5927\u898f\u6a21\u5316\u306f\u307e\u3060\u5f0a\u793e\u3067\u3082\u8a66\u884c\u932f\u8aa4\u306e\u6bb5\u968e\u306b\u3042\u308a\u3001\u5f15\u304d\u7d9a\u304d\u5927\u898f\u6a21\u306a\u30e2\u30c7\u30eb\u306e\u5b66\u7fd2\u3092\u884c\u3063\u3066\u3044\u307e\u3059\u304c\u3001 \u672c\u8a18\u4e8b\u3067\u306f\u5148\u65e5\u516c\u958b\u3057\u305fSarashina2-8x70B\u306e\u6027\u80fd\u3084MoE\u3001\u5b66\u7fd2\u6e08\u30e2\u30c7\u30eb\u306eMoE\u30e2\u30c7\u30eb\u3078\u306e\u2026","width":"100%","provider_name":"Hatena Blog","version":"1.0","provider_url":"https://hatena.blog","author_name":"shot4410","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fwww.sbintuitions.co.jp%2Fblog%2Fentry%2F2024%2F11%2F25%2F175000\" title=\"Sarashina2-8x70B\u306e\u516c\u958b - SB Intuitions TECH BLOG\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","title":"Sarashina2-8x70B\u306e\u516c\u958b","published":"2024-11-25 17:50:00"}