{"version":"1.0","author_name":"xwkns157","published":"2022-08-03 10:00:00","title":"GPT-neox\u306e\u5b66\u7fd2\u7528\u306b\u30de\u30eb\u30c1\u30ce\u30fc\u30c9\u4e26\u5217\u5b66\u7fd2\u74b0\u5883\u3092\u6574\u3048\u305f with DeepSpeed","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Ftech-blog.abeja.asia%2Fentry%2Fabeja-gpt-neox-infra-202208\" title=\"GPT-neox\u306e\u5b66\u7fd2\u7528\u306b\u30de\u30eb\u30c1\u30ce\u30fc\u30c9\u4e26\u5217\u5b66\u7fd2\u74b0\u5883\u3092\u6574\u3048\u305f with DeepSpeed - ABEJA Tech Blog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/h/hiroyuki_abeja/20220802/20220802095418.png","url":"https://tech-blog.abeja.asia/entry/abeja-gpt-neox-infra-202208","width":"100%","provider_url":"https://hatena.blog","author_url":"https://blog.hatena.ne.jp/xwkns157/","description":"1. \u306f\u3058\u3081\u306b 2. \u4e26\u5217\u5b66\u7fd2\u74b0\u5883\u3092\u8abf\u3079\u308b \u4e26\u5217\u5b66\u7fd2\u65b9\u6cd5\u3092\u8abf\u3079\u308b \u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u3001\u30b3\u30f3\u30d4\u30e5\u30fc\u30c6\u30a3\u30f3\u30b0\u5468\u308a\u3092\u8abf\u3079\u308b 3. \u30a4\u30f3\u30d5\u30e9\u74b0\u5883\u3092\u69cb\u7bc9\u3059\u308b \u30b3\u30f3\u30d1\u30af\u30c8\u30d7\u30ec\u30fc\u30b9\u30e1\u30f3\u30c8\u30dd\u30ea\u30b7\u30fc\u306e\u4f5c\u6210 Compute Engine \u3092\u8d77\u52d5\u3059\u308b (Fast Socket \u3068 gVNIC \u3092\u5229\u7528\u3059\u308b) 4. \u307e\u305a\u306f\u30b7\u30f3\u30b0\u30eb\u30ce\u30fc\u30c9\u3067\u52d5\u304b\u3059 5. \u6b21\u306f\u30de\u30eb\u30c1\u74b0\u5883\u3067\u52d5\u304b\u3059 w/ Docker \u30ea\u30dd\u30b8\u30c8\u30ea\u3092\u30af\u30ed\u30fc\u30f3 ssh/config \u3092\u4f5c\u6210 authorized_keys \u3092\u4f5c\u6210 hostfile \u3092\u4f5c\u6210 Docker \u3092 build 6. \u3064\u307e\u305a\u3044\u305f\u30dd\u30a4\u30f3\u30c8 \u5b66\u7fd2\u9014\u4e2d\u306b\u51fa\u529b\u3057\u305f\u30d5\u30a1\u30a4\u30eb\u3092\u518d\u5229\u7528\u3059\u308b\u306e\u3067NFS\u304c\u5fc5\u8981\u306b N\u2026","provider_name":"Hatena Blog","categories":[],"height":"190","blog_title":"ABEJA Tech Blog","type":"rich","blog_url":"https://tech-blog.abeja.asia/"}