{"title":"GPU\u3067\u9ad8\u901f\u306a\u30e2\u30c7\u30eb\u63a8\u8ad6\u3092\u5b9f\u73fe\u3059\u308b\u305f\u3081\u306b\u8003\u3048\u308b\u3053\u3068 -FlashAttention\u306f\u306a\u305c\u9ad8\u901f\u304b-","blog_url":"https://www.m3tech.blog/","categories":[],"type":"rich","width":"100%","provider_name":"Hatena Blog","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/m/m3tech/20241220/20241220172340.png","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fwww.m3tech.blog%2Fentry%2F20241217_flash_attention\" title=\"GPU\u3067\u9ad8\u901f\u306a\u30e2\u30c7\u30eb\u63a8\u8ad6\u3092\u5b9f\u73fe\u3059\u308b\u305f\u3081\u306b\u8003\u3048\u308b\u3053\u3068 -FlashAttention\u306f\u306a\u305c\u9ad8\u901f\u304b- - \u30a8\u30e0\u30b9\u30ea\u30fc\u30c6\u30c3\u30af\u30d6\u30ed\u30b0\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","url":"https://www.m3tech.blog/entry/20241217_flash_attention","author_name":"eufo","author_url":"https://blog.hatena.ne.jp/eufo/","published":"2024-12-17 18:00:00","version":"1.0","description":"\u3053\u3061\u3089\u306f\u30a8\u30e0\u30b9\u30ea\u30fc Advent Calendar 2024 17\u65e5\u76ee\u306e\u8a18\u4e8b\u3067\u3059\u3002 AI\u30fb\u6a5f\u68b0\u5b66\u7fd2\u30c1\u30fc\u30e0\u306e\u9ad9\u6a4b\u3067\u3059\u3002\u30c1\u30fc\u30e0\u3067\u306f\u5148\u9031\u304b\u3089NeurIPS\u8aad\u307f\u4f1a\u304c\u958b\u50ac\u3055\u308c\u3066\u304a\u308a\u3001\"Deep Learning Architecture, Infrastructure\"\u3068\u3044\u3046\u6df1\u5c64\u5b66\u7fd2\u306e\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u306b\u95a2\u3059\u308b\u30bb\u30c3\u30b7\u30e7\u30f3\u3092\u62c5\u5f53\u3057\u307e\u3057\u305f\u3002\u305d\u306e\u4e2d\u3067\u3082\u8208\u5473\u6df1\u3044\u4e00\u672c\u3068\u3057\u3066\"You Only Cache Once: Decoder-Decoder Architectures for Language Models\"\u3068\u3044\u3046\u8ad6\u6587\u3092\u52c9\u5f37\u4f1a\u307e\u3068\u3081\u30d6\u30ed\u30b0\u3067\u7d39\u4ecb\u3057\u3066\u307e\u3059\u3002 www.m3tech.blog \u3053\u306e\u8ad6\u6587\u3067\u306fLLM\u306e\u63a8\u8ad6\u2026","blog_title":"\u30a8\u30e0\u30b9\u30ea\u30fc\u30c6\u30c3\u30af\u30d6\u30ed\u30b0","provider_url":"https://hatena.blog","height":"190"}