{"author_name":"shot4410","blog_url":"https://www.sbintuitions.co.jp/blog/","categories":[],"width":"100%","provider_url":"https://hatena.blog","title":"Sarashina2.2\uff1a\u6570\u5b66\u30fb\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\u30bf\u30b9\u30af\u306e\u6027\u80fd\u3092\u5411\u4e0a\u3055\u305b\u305f\u65e5\u672c\u8a9e\u8a00\u8a9e\u30e2\u30c7\u30eb","blog_title":"SB Intuitions TECH BLOG","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fwww.sbintuitions.co.jp%2Fblog%2Fentry%2F2025%2F03%2F06%2F112144\" title=\"Sarashina2.2\uff1a\u6570\u5b66\u30fb\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\u30bf\u30b9\u30af\u306e\u6027\u80fd\u3092\u5411\u4e0a\u3055\u305b\u305f\u65e5\u672c\u8a9e\u8a00\u8a9e\u30e2\u30c7\u30eb - SB Intuitions TECH BLOG\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","published":"2025-03-06 11:21:44","height":"190","version":"1.0","description":"\u6982\u8981 Pretraining\u30c1\u30fc\u30e0\u306e\u9ad8\u702c\u7fd4\u3068\u674e\u51cc\u5bd2\u3067\u3059\u3002 \u5f0a\u30c1\u30fc\u30e0\u3067\u306f\u65e5\u672c\u8a9e\u80fd\u529b\u306b\u4e3b\u773c\u3092\u7f6e\u3044\u305f\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb\u306e\u69cb\u7bc9\u306b\u53d6\u308a\u7d44\u3093\u3067\u304a\u308a\u3001Sarashina2-70B\u3084Sarashina2.1-1B\u306e\u3088\u3046\u306b\u3001\u3044\u304f\u3064\u304b\u4e8b\u524d\u5b66\u7fd2\u30e2\u30c7\u30eb\u3082\u516c\u958b\u3057\u3066\u304d\u307e\u3057\u305f\u3002 \u3053\u308c\u307e\u3067\u516c\u958b\u3057\u305f\u30e2\u30c7\u30eb\u306f\u65e5\u672c\u306e\u77e5\u8b58\u3092\u554f\u3046\u8cea\u554f\u5fdc\u7b54\u30bf\u30b9\u30af\u3067\u306f\u9ad8\u3044\u6027\u80fd\u3092\u9054\u6210\u3057\u3066\u3044\u308b\u4e00\u65b9\u3067\u3001\u6570\u5b66\u30bf\u30b9\u30af\u3084\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\u30bf\u30b9\u30af\u3001\u3059\u306a\u308f\u3061\u3001\u6587\u7ae0\u984c\u306e\u3088\u3046\u306a\u81ea\u7136\u8a00\u8a9e\u3067\u63d0\u793a\u3055\u308c\u305f\u8a08\u7b97\u554f\u984c\u3084\u3001\u4e0e\u3048\u3089\u308c\u305f\u6307\u793a\u3092\u6e80\u305f\u3059\u30b3\u30fc\u30c9\u3092\u751f\u6210\u3059\u308b\u30bf\u30b9\u30af\u306e\u6027\u80fd\u306f\u82b3\u3057\u304f\u3042\u308a\u307e\u305b\u3093\u3067\u3057\u305f\u3002 \u3053\u308c\u306f\u3001CommonCrawl\u306e\u3088\u3046\u306a\u30a6\u30a7\u30d6\u6587\u66f8\u306e\u4e2d\u306b\u3001\u6570\u5b66\u30fb\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\u30bf\u30b9\u30af\u306e\u6027\u80fd\u5411\u4e0a\u306b\u5bc4\u4e0e\u3059\u2026","type":"rich","provider_name":"Hatena Blog","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/s/shot4410/20250303/20250303121134.png","author_url":"https://blog.hatena.ne.jp/shot4410/","url":"https://www.sbintuitions.co.jp/blog/entry/2025/03/06/112144"}