{"type":"rich","width":"100%","description":"QLoRA\u306b\u3064\u3044\u3066\u5c11\u3057\u66f8\u304f\u6a5f\u4f1a\u304c\u3042\u3063\u305f\u306e\u3067\u3001\u305d\u306e\u8981\u7d20\u6280\u8853\u3067\u3042\u308b\u30d6\u30ed\u30c3\u30af\u3054\u3068\u306e\u91cf\u5b50\u5316\uff08block-wise quantization\uff09\u306e\u89e3\u8aac\u3068\u305d\u306e\u5b9f\u88c5\u3092\u3057\u3066\u307f\u307e\u3057\u305f\u3002\u5b9f\u969b\u306e\u3068\u3053\u308d\u3001bitsandbytes\u306a\u3069\u306e\u30e9\u30a4\u30d6\u30e9\u30ea\u306b\u5b9f\u88c5\u3055\u308c\u3066\u3044\u308b\u306e\u3067\u3001\u81ea\u524d\u3067\u5b9f\u88c5\u3059\u308b\u5fc5\u8981\u306f\u307e\u3063\u305f\u304f\u306a\u3044\u306e\u3067\u3059\u304c\u3001\u5b66\u7fd2\u7528\u517c\u30b5\u30dc\u3063\u3066\u305f\u30d6\u30ed\u30b0\u306e\u30ea\u30cf\u30d3\u30ea\u7528\u3067\u3059\u3002 \u91cf\u5b50\u5316 \u91cf\u5b50\u5316\u3068\u306f\u3001\u6d6e\u52d5\u5c0f\u6570\u70b9\u6570\u3092\u6574\u6570\u306b\u3088\u308b\u8868\u73fe\u306b\u5909\u63db\u3059\u308b\u6280\u8853\u3067\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u30e2\u30c7\u30eb\u306e\u91cd\u307f\u304c32\u30d3\u30c3\u30c8\u306e\u6d6e\u52d5\u5c0f\u6570\u70b9\u6570\u3068\u3057\u3066\u683c\u7d0d\u3055\u308c\u3066\u3044\u308b\u3068\u3057\u307e\u3059\u3002\u91cf\u5b50\u5316\u306b\u3088\u3063\u3066\u3001\u3053\u308c\u3089\u306e\u91cd\u307f\u306f32\u30d3\u30c3\u30c8\u304b\u3089\u305f\u3068\u3048\u30708\u30d3\u30c3\u30c8\u306e\u6574\u6570\u306b\u5909\u63db\u3067\u304d\u307e\u3059\u3002\u91cf\u5b50\u5316\u306f\u8a08\u7b97\u6642\u9593\u3084\u30e1\u30e2\u30ea\u4f7f\u7528\u91cf\u3092\u524a\u6e1b\u3067\u304d\u308b\u4e00\u65b9\u2026","blog_url":"https://hironsan.hatenablog.com/","height":"190","version":"1.0","blog_title":"Ahogrammer","published":"2025-01-07 20:48:47","author_url":"https://blog.hatena.ne.jp/Hironsan/","title":"\u30d6\u30ed\u30c3\u30af\u3054\u3068\u306e\u91cf\u5b50\u5316\u3092\u5b9f\u88c5\u3059\u308b","provider_url":"https://hatena.blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fhironsan.hatenablog.com%2Fentry%2Fblock-wise-quantization\" title=\"\u30d6\u30ed\u30c3\u30af\u3054\u3068\u306e\u91cf\u5b50\u5316\u3092\u5b9f\u88c5\u3059\u308b - Ahogrammer\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","categories":["\u6a5f\u68b0\u5b66\u7fd2","PyTorch"],"image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/H/Hironsan/20250107/20250107202125.jpg","author_name":"Hironsan","provider_name":"Hatena Blog","url":"https://hironsan.hatenablog.com/entry/block-wise-quantization"}