{"author_url":"https://blog.hatena.ne.jp/fanta_orange_grape/","type":"rich","description":"arxiv.org \u6982\u8981 ChatGPT\u8a33\uff1a \u884c\u5217\u7a4d (MatMul) \u306f\u901a\u5e38\u3001\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb (LLM) \u306e\u5168\u4f53\u7684\u306a\u8a08\u7b97\u30b3\u30b9\u30c8\u306e\u5927\u90e8\u5206\u3092\u5360\u3081\u307e\u3059\u3002\u3053\u306e\u30b3\u30b9\u30c8\u306f\u3001LLM \u304c\u3088\u308a\u5927\u304d\u306a\u57cb\u3081\u8fbc\u307f\u6b21\u5143\u3084\u6587\u8108\u9577\u306b\u30b9\u30b1\u30fc\u30eb\u3059\u308b\u306b\u3064\u308c\u3066\u5897\u52a0\u3059\u308b\u4e00\u65b9\u3067\u3059\u3002\u672c\u7814\u7a76\u3067\u306f\u3001\u884c\u5217\u7a4d\u64cd\u4f5c\u3092\u5b8c\u5168\u306b\u6392\u9664\u3057\u3064\u3064\u3001\u6570\u5341\u5104\u30d1\u30e9\u30e1\u30fc\u30bf\u898f\u6a21\u3067\u5f37\u529b\u306a\u6027\u80fd\u3092\u7dad\u6301\u3067\u304d\u308b\u3053\u3068\u3092\u793a\u3057\u307e\u3059\u3002\u5b9f\u9a13\u7d50\u679c\u306f\u3001\u6211\u3005\u306e\u63d0\u6848\u3059\u308bMatMul\u4e0d\u8981\u306e\u30e2\u30c7\u30eb\u304c\u3001\u63a8\u8ad6\u6642\u306b\u5927\u5e45\u306b\u591a\u304f\u306e\u30e1\u30e2\u30ea\u3092\u5fc5\u8981\u3068\u3059\u308b\u6700\u5148\u7aef\u306eTransformer\u3068\u540c\u7b49\u306e\u6027\u80fd\u3092\u9054\u6210\u3059\u308b\u3053\u3068\u3092\u793a\u3057\u3066\u3044\u307e\u3059\u3002\u3053\u306e\u30e2\u30c7\u30eb\u306f\u30b9\u30b1\u30fc\u30ea\u30f3\u30b0\u6cd5\u5247\u3092\u8abf\u67fb\u3057\u3001\u30e2\u30c7\u30eb\u30b5\u30a4\u30ba\u304c\u5897\u52a0\u3059\u308b\u306b\u3064\u308c\u3066\u3001\u6211\u3005\u306eMatMul\u4e0d\u2026","author_name":"fanta_orange_grape","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fai-de-seikei.hatenablog.com%2Fentry%2F2024%2F06%2F23%2F105434\" title=\"\u8ad6\u6587\u300eScalable MatMul-free Language Modeling\u300f\u3092\u8aad\u3080 - AI\u3046\u3049\uff0d\uff0d\uff01(ai-wo-katsuyo-shitai !)\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","provider_name":"Hatena Blog","title":"\u8ad6\u6587\u300eScalable MatMul-free Language Modeling\u300f\u3092\u8aad\u3080","blog_url":"https://ai-de-seikei.hatenablog.com/","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/f/fanta_orange_grape/20240623/20240623105227.png","version":"1.0","width":"100%","provider_url":"https://hatena.blog","published":"2024-06-23 10:54:34","blog_title":"AI\u3046\u3049\uff0d\uff0d\uff01(ai-wo-katsuyo-shitai !)","height":"190","url":"https://ai-de-seikei.hatenablog.com/entry/2024/06/23/105434","categories":[]}