{"blog_url":"https://bwgift.hatenadiary.jp/","version":"1.0","type":"rich","url":"https://bwgift.hatenadiary.jp/entry/2024/08/02/200735","width":"100%","image_url":null,"height":"190","author_url":"https://blog.hatena.ne.jp/bwgift/","provider_url":"https://hatena.blog","categories":["Colaboratory","LLM","Python","\u81ea\u7136\u8a00\u8a9e\u51e6\u7406"],"published":"2024-08-02 20:07:35","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fbwgift.hatenadiary.jp%2Fentry%2F2024%2F08%2F02%2F200735\" title=\"\u30e1\u30e2\uff1aphi3\u3092LoRa\u3067Colab\u4e0a\u3067\u30d5\u30a1\u30a4\u30f3\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3057\u3066\u307f\u308b\u3002 - \u5730\u5e73\u7dda\u307e\u3067\u884c\u3063\u3066\u304f\u308b\u3002\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","author_name":"bwgift","provider_name":"Hatena Blog","title":"\u30e1\u30e2\uff1aphi3\u3092LoRa\u3067Colab\u4e0a\u3067\u30d5\u30a1\u30a4\u30f3\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3057\u3066\u307f\u308b\u3002","description":"\u4eca\u66f4\u611f\u306f\u3042\u308b\u306e\u3060\u304c\u3001LLM\u306e\u30d5\u30a1\u30a4\u30f3\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u306b\u30c1\u30e3\u30ec\u30f3\u30b8\u3002\u30d9\u30fc\u30b9\u306e\u30e2\u30c7\u30eb\u306fphi3\u3002\u306a\u3093\u3068\u306a\u304f\u3067\u3059\u3002\u52d5\u4f5c\u78ba\u8a8d\u304c\u76ee\u7684\u3067\u3059\u3002\u304d\u3063\u3068\u3069\u3053\u304b\u306b\u516c\u958b\u3055\u308c\u3066\u3044\u308b\u3060\u308d\u3046\u3068\u601d\u3044\u307e\u3059\u3002\u3057\u304b\u3057\u3001\u63a2\u305b\u306a\u304b\u3063\u305f\u306e\u3067\u6311\u6226\u3057\u307e\u3057\u305f\u3002 Train\u30c7\u30fc\u30bf\u306f\u3001\u624b\u3054\u308d\u306e\u3082\u306e\u304c\u306a\u304b\u3063\u305f\u306e\u3067\u3001NER\u30bf\u30b9\u30af\u306eJSON\u51fa\u529b\u3067\u4ee3\u7528\u3002spaCy\u3092\u4f7f\u3063\u3066\u4f5c\u6210\u3057\u307e\u3059\u3002Flash-Attention-2\u304c\u6709\u52b9\u306b\u306a\u3089\u306a\u3044\u554f\u984c\u304c\u672a\u89e3\u6c7a\u3002\u304c\u3001\u5b66\u7fd2\u306f\u8d70\u3063\u305f\u3002\u307e\u305f\u3001\u56de\u7b54\u3082JSON\u5f62\u5f0f\u3067\u305d\u308c\u3089\u3057\u3044\u51fa\u529b\u304c\u5f97\u3089\u308c\u307e\u3057\u305f\u3002 \u30e2\u30c7\u30eb\u306e\u69cb\u9020\u306a\u3069\u4e00\u3064\u4e00\u3064\u5206\u304b\u3089\u306a\u3044\u3053\u3068\u3092\u5165\u308c\u8fbc\u307f\u306a\u304c\u3089\u5b8c\u6210\u3002\u3053\u308c\u306a\u3089\u306a\u3093\u3068\u304b\u304a\u5bb6(or Colab\uff09\u3067\u30d5\u30a1\u30a4\u30f3\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u304c\u3067\u304d\u308b\u304b\u3082\u3002\u30c7\u2026","blog_title":"\u5730\u5e73\u7dda\u307e\u3067\u884c\u3063\u3066\u304f\u308b\u3002"}