{"html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fnikkie-ftnext.hatenablog.com%2Fentry%2Fpython-m-bitsandbytes-diagnostics-gpu-environment\" title=\"python -m bitsandbytes \u3067GPU\u74b0\u5883\u3092\u8a3a\u65ad - nikkie-ftnext\u306e\u65e5\u8a18\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","description":"Today(\u203b\u6700\u8fd1) I Learned \u3067\u3059 \u76ee\u6b21 \u76ee\u6b21 LLM\u306e\u91cf\u5b50\u5316\u3067\u77e5\u3063\u3066\u3044\u305fbitsandbytes python -m bitsandbytes Colab\u3067\u306e\u5b9f\u884c\u4f8b \u5b9f\u88c5 \u901a\u3089\u306a\u3044\u5834\u5408 \u7d42\u308f\u308a\u306b LLM\u306e\u91cf\u5b50\u5316\u3067\u77e5\u3063\u3066\u3044\u305fbitsandbytes \u904e\u53bb\u306e\u7d20\u632f\u308a\u304b\u3089\u3001bitsandbytes\u306ftransformers.BitsAndBytesConfig\u3067\u77e5\u3063\u3066\u3044\u307e\u3057\u305f\u3002 LLM\u3092\u30ed\u30fc\u30c9\u3059\u308b\u969b\u306equantization_config\u306b\u6307\u5b9a\u3057\u307e\u3059\u3002 bnb_config = BitsAndBytesConfig( load_in_4bit=True, bnb_4bit_quant_t\u2026","version":"1.0","image_url":null,"categories":["LLM"],"type":"rich","blog_title":"nikkie-ftnext\u306e\u65e5\u8a18","url":"https://nikkie-ftnext.hatenablog.com/entry/python-m-bitsandbytes-diagnostics-gpu-environment","published":"2024-09-05 23:45:31","provider_name":"Hatena Blog","provider_url":"https://hatena.blog","title":"python -m bitsandbytes \u3067GPU\u74b0\u5883\u3092\u8a3a\u65ad","author_url":"https://blog.hatena.ne.jp/nikkie-ftnext/","height":"190","author_name":"nikkie-ftnext","blog_url":"https://nikkie-ftnext.hatenablog.com/","width":"100%"}