{"blog_url":"https://tadaoyamaoka.hatenablog.com/","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Ftadaoyamaoka.hatenablog.com%2Fentry%2F2023%2F07%2F22%2F133714\" title=\"Llama2\u306e70B\u30e2\u30c7\u30eb\u30924bit\u91cf\u5b50\u5316\u3057\u30661GPU\u3067\u5b9f\u884c\u3059\u308b\u65b9\u6cd5 - TadaoYamaoka\u306e\u958b\u767a\u65e5\u8a18\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","blog_title":"TadaoYamaoka\u306e\u958b\u767a\u65e5\u8a18","author_name":"TadaoYamaoka","width":"100%","type":"rich","version":"1.0","provider_name":"Hatena Blog","image_url":null,"published":"2023-07-22 13:37:14","author_url":"https://blog.hatena.ne.jp/TadaoYamaoka/","url":"https://tadaoyamaoka.hatenablog.com/entry/2023/07/22/133714","height":"190","title":"Llama2\u306e70B\u30e2\u30c7\u30eb\u30924bit\u91cf\u5b50\u5316\u3057\u30661GPU\u3067\u5b9f\u884c\u3059\u308b\u65b9\u6cd5","provider_url":"https://hatena.blog","description":"\u500b\u4eba\u30e1\u30e2Hugging Face\u3067\u516c\u958b\u3055\u308c\u3066\u3044\u308bLlama2\u306e\u30e2\u30c7\u30eb\u3092\u4f7f\u7528\u3057\u3066\u30014bit\u91cf\u5b50\u5316\u3092\u6709\u52b9\u306b\u3057\u3066\u300170B\u306e\u30e2\u30c7\u30eb\u30921GPU(A100)\u3067\u63a8\u8ad6\u3059\u308b\u65b9\u6cd5\u306b\u3064\u3044\u3066\u8a18\u8ff0\u3059\u308b\u3002 docker\u30b3\u30f3\u30c6\u30ca\u4f5c\u6210 NVIDIA\u306ePyTorch\u30a4\u30e1\u30fc\u30b8\u3092\u4f7f\u7528\u3057\u3066Docker\u30b3\u30f3\u30c6\u30ca\u3092\u4f5c\u6210\u3059\u308b\u3002 \u203b\u30db\u30b9\u30c8\u306e\u30c9\u30e9\u30a4\u30d0\u30d0\u30fc\u30b8\u30e7\u30f3\u304c\u53e4\u3044\u305f\u3081\u3001\u5c11\u3057\u524d\u306e\u30a4\u30e1\u30fc\u30b8\u3092\u4f7f\u7528\u3057\u3066\u3044\u308b\u3002\u30b3\u30de\u30f3\u30c9\u4f8b docker run --gpus all --network host -v /work:/work -w /work -it nvcr.io/nvidia/pytorch:22.12-py3 PyTorch\u30d0\u30fc\u30b8\u30e7\u30f3\u30a2\u30c3\u30d7 xf\u2026","categories":[]}