{"url":"https://inarizuuuushi.hatenablog.com/entry/2022/05/26/090000","author_url":"https://blog.hatena.ne.jp/inarizuuuushi/","type":"rich","blog_title":"Sabrou-mal \u30b5\u30d6\u30ed\u30a6\u4e38","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/i/inarizuuuushi/20220520/20220520164322.png","provider_name":"Hatena Blog","title":"\u30b5\u30fc\u30d9\u30a4: ZeRO-Offload: Democratizing Billion-Scale Model Training","categories":["\u8ad6\u6587\u30b5\u30fc\u30d9\u30a4","\u7701\u30e1\u30e2\u30ea","\u6df1\u5c64\u5b66\u7fd2"],"description":"@inproceedings{ren2021zero, title={$\\{$ZeRO-Offload$\\}$: Democratizing $\\{$Billion-Scale$\\}$ Model Training}, author={Ren, Jie and Rajbhandari, Samyam and Aminabadi, Reza Yazdani and Ruwase, Olatunji and Yang, Shuangyan and Zhang, Minjia and Li, Dong and He, Yuxiong}, booktitle={2021 USENIX Annual T\u2026","published":"2022-05-26 09:00:00","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Finarizuuuushi.hatenablog.com%2Fentry%2F2022%2F05%2F26%2F090000\" title=\"\u30b5\u30fc\u30d9\u30a4: ZeRO-Offload: Democratizing Billion-Scale Model Training - Sabrou-mal \u30b5\u30d6\u30ed\u30a6\u4e38\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","width":"100%","blog_url":"https://inarizuuuushi.hatenablog.com/","author_name":"inarizuuuushi","version":"1.0","height":"190","provider_url":"https://hatena.blog"}