{"author_url":"https://blog.hatena.ne.jp/bwgift/","url":"https://bwgift.hatenadiary.jp/entry/2025/02/19/221704","published":"2025-02-19 22:17:04","type":"rich","provider_url":"https://hatena.blog","version":"1.0","blog_url":"https://bwgift.hatenadiary.jp/","provider_name":"Hatena Blog","height":"190","width":"100%","image_url":null,"categories":["LLM","BERT","Colaboratory","\u81ea\u7136\u8a00\u8a9e\u51e6\u7406"],"blog_title":"\u5730\u5e73\u7dda\u307e\u3067\u884c\u3063\u3066\u304f\u308b\u3002","author_name":"bwgift","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fbwgift.hatenadiary.jp%2Fentry%2F2025%2F02%2F19%2F221704\" title=\"\u6700\u5f8c\u306b\u65e5\u672c\u8a9eModernBERT\u3067Colab\u3067NER\u3057\u3066huggingface\u306bupload\u3057\u3066\u307f\u308b\u3002 - \u5730\u5e73\u7dda\u307e\u3067\u884c\u3063\u3066\u304f\u308b\u3002\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","title":"\u6700\u5f8c\u306b\u65e5\u672c\u8a9eModernBERT\u3067Colab\u3067NER\u3057\u3066huggingface\u306bupload\u3057\u3066\u307f\u308b\u3002","description":"\u65e5\u672c\u8a9eModernBERT\u306710epochs\u304f\u3089\u3044\u5b66\u7fd2\u3055\u305b\u3066\u6b62\u307e\u3063\u3066\u305f\u306e\u3067\u300150epochs\u307e\u3067\u5b66\u7fd2\u3055\u305b\u305f\u30e2\u30c7\u30eb\u3092\u4f5c\u6210\u3057\u307e\u3057\u305f\u3002Huggingface\u306b\u30e2\u30c7\u30eb\u3092\u30a2\u30c3\u30d7\u30ed\u30fc\u30c9\u306b\u3082\u30c1\u30e3\u30ec\u30f3\u30b8\u3057\u3066\u307f\u307e\u3057\u305f\u3002Colab T4\u74b0\u5883\u3067\u3059\u3002\u56de\u3057\u3063\u3071\u306a\u3057\u3067\u3001\u304a\u4ed5\u4e8b\u7d42\u308f\u3063\u3066\u3075\u3068\u307f\u308b\u3068\u65e9\u3005\u306bloss\u304c\u4e0b\u304c\u3063\u3066\u3044\u307e\u3057\u305f\u3002Learing rate\u3092\u843d\u3068\u3057\u3066\u3082\u3088\u304b\u3063\u305f\u304b\u3082\u3002 NER\u7528\u306e\u30e2\u30c7\u30eb\u306f\u5909\u308f\u3089\u305astockmarks\u3055\u3093\u306ewikipedia\u306b\u3088\u308b\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u7528\u3044\u307e\u3059\u3002\u8a73\u3057\u304f\u306f\u3001\u904e\u53bb\u8a18\u4e8b\u3092\u898b\u3066\u304f\u3060\u3055\u3044\u3002 F1 Score\u3067\u306fEpoch16\u6642\u306e0.870399\u304c\u6700\u9ad8\u3067\u3059\u304c\u3001Loss\u304c\u4e0b\u304c\u3063\u305f\u3068\u3053\u308d\u304b\u3089\u8003\u3048\u308c\u3070\u30010.8\u2026"}