{"categories":["LLM","Colaboratory","Python","\u81ea\u7136\u8a00\u8a9e\u51e6\u7406"],"published":"2025-02-07 19:23:24","version":"1.0","image_url":null,"provider_url":"https://hatena.blog","description":"LLM\u306bGroup Relative Policy Optimization (GRPO)\u3092LoRA\u3068\u7d44\u307f\u5408\u308f\u305b\u3066\u3001GPU\u30ea\u30bd\u30fc\u30b9\u304c\u5c11\u306a\u304f\u3066\u3082\u5b66\u7fd2\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u308b\u624b\u6cd5\u3092Unsloth\u3055\u3093\u304c\u63d0\u6848\u3055\u308c\u3066\u3044\u305f\u306e\u3067\u3001\u305f\u3081\u3057\u3066\u307f\u307e\u3059\u3002\u30b5\u30f3\u30d7\u30eb\u306eColab\u30e2\u30c7\u30eb\u3067\u30d9\u30fc\u30b9\u30e2\u30c7\u30eb\u3092SakanaAI/TinySwallow-1.5B-Instruct\u306b\u3057\u3001\u3042\u3068\u306f\u30c7\u30d5\u30a9\u30eb\u30c8\u307e\u307e\u3067\u3059\u3002\u5c0f\u578b\u3067\u3042\u308a\u306a\u304c\u3089\u65e5\u672c\u8a9e\u80fd\u529b\u304c\u9ad8\u3044\u30e2\u30c7\u30eb\u3067\u3059\u30028B\u30e2\u30c7\u30eb\u3060\u3068Colab L4\u74b0\u5883\u3067\uff08\u304a\u305d\u3089\u304f\u30e1\u30e2\u30ea\u30fc\u306e\u95a2\u4fc2\u3067\uff09\u5b66\u7fd2\u304c\u3067\u304d\u306a\u304b\u3063\u305f\u306e\u3067\u30011.5B\u3067\u30c8\u30e9\u30a4\u3057\u307e\u3057\u305f\u3002 \u751f\u6210\u7d50\u679c\u306f\u4e0b\u8a18\u3068\u306a\u308a\u307e\u3057\u305f\u3002\u65e5\u672c\u8a9e\u304c\u7834\u7dbb\u3059\u308b\u304b\u306a\u3082\u3068\u601d\u3063\u305f\u306e\u3067\u3059\u304c\u3001\u554f\u984c\u2026","type":"rich","height":"190","title":"Unsloth\u306eGRPO notebook\uff08Colab\uff09\u3067TinySwallow-1.5B-Instruct\u3092\u5b66\u7fd2\u3055\u305b\u3066\u307f\u308b\u3002","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fbwgift.hatenadiary.jp%2Fentry%2F2025%2F02%2F07%2F192324\" title=\"Unsloth\u306eGRPO notebook\uff08Colab\uff09\u3067TinySwallow-1.5B-Instruct\u3092\u5b66\u7fd2\u3055\u305b\u3066\u307f\u308b\u3002 - \u5730\u5e73\u7dda\u307e\u3067\u884c\u3063\u3066\u304f\u308b\u3002\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","blog_url":"https://bwgift.hatenadiary.jp/","author_name":"bwgift","author_url":"https://blog.hatena.ne.jp/bwgift/","width":"100%","url":"https://bwgift.hatenadiary.jp/entry/2025/02/07/192324","blog_title":"\u5730\u5e73\u7dda\u307e\u3067\u884c\u3063\u3066\u304f\u308b\u3002","provider_name":"Hatena Blog"}