{"published":"2026-01-30 15:10:48","height":"190","type":"rich","title":"Differential Transformer V2\u304c\u767a\u8868\u3055\u308c\u305f\u306e\u3067\u3001\u4eca\u66f4\u3067\u306f\u3042\u308b\u304cV1\u8ad6\u6587\u3092\u8aad\u3093\u3060\u3046\u3048\u3067\u5dee\u5206\u3092\u78ba\u8a8d\u3057\u3066\u307f\u305f","author_url":"https://blog.hatena.ne.jp/takezota/","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/t/takezota/20260130/20260130130740.png","provider_url":"https://hatena.blog","description":"\u3053\u3093\u306b\u3061\u306f\uff01ABEJA\u3067\u30c7\u30fc\u30bf\u30b5\u30a4\u30a8\u30f3\u30c6\u30a3\u30b9\u30c8\u3092\u3057\u3066\u3044\u308b\u5927\u7530\u3067\u3059\u3002 \u5148\u65e5Hugging Face\u3067Differential Transformer V2\u306e\u767a\u8868\u304c\u3042\u308a\u3001\u305d\u3053\u3067\u306f\u6628\u5e74\u767a\u8868\u3055\u308c\u305fDifferential Transformer (V1)\u3068\u6bd4\u3079\u3066\u3082\u3055\u3089\u306b\u5b9f\u7528\u7684\u306a\u6539\u5909\u304c\u3042\u3063\u305f\u3068\u306e\u3053\u3068\u3067\u3059\u3002\u53bb\u5e74\u306bV1\u306e\u8ad6\u6587\u304c\u51fa\u305f\u3068\u304d\u306f\u65e5\u672c\u8a9e\u306e\u307e\u3068\u3081\u8a18\u4e8b\u3092\u3056\u3063\u3068\u8aad\u3093\u3060\u304f\u3089\u3044\u3067\u3057\u305f\u304c\u30012\u3064\u306e\u30a2\u30c6\u30f3\u30b7\u30e7\u30f3\u306e\u5dee\u5206\u3092\u53d6\u3063\u3066\u30ce\u30a4\u30ba\u3092\u6d88\u3059\u3068\u3044\u3046\u30b7\u30f3\u30d7\u30eb\u306a\u30a2\u30a4\u30c7\u30a2\u3067\u3042\u308b\u306b\u3082\u304b\u304b\u308f\u3089\u305a\u3001\u5b9f\u9a13\u7d50\u679c\u3067\u306f\u30a2\u30c6\u30f3\u30b7\u30e7\u30f3\u30ce\u30a4\u30ba\u306e\u6291\u5236\u3001\u30b9\u30b1\u30fc\u30ea\u30f3\u30b0\u52b9\u7387\u3001\u30cf\u30eb\u30b7\u30cd\u30fc\u30b7\u30e7\u30f3\u306e\u4f4e\u6e1b\u306a\u3069\u3001\u3044\u308d\u3044\u308d\u306a\u9762\u3067\u304d\u308c\u3044\u306b\u6539\u5584\u3057\u3066\u3044\u3066\u9a5a\u3044\u305f\u8a18\u61b6\u304c\u3042\u308a\u307e\u3059\u3002 \u8ad6\u6587\u3067\u3082\u89e6\u308c\u3089\u308c\u3066\u3044\u305f\u691c\u7d22\u306a\u3069\u7279\u5b9a\u306e\u30bf\u30b9\u30af\u3067\u306e\u6027\u80fd\u5411\u4e0a\u3084\u30ed\u30d0\u30b9\u30c8\u6027\u306e\u6539\u5584\u3001V2\u3067\u5b9f\u73fe\u3055\u308c\u305fKV\u30ad\u30e3\u30c3\u30b7\u30e5\u306e\u52b9\u7387\u5316\u306a\u3069\u3001\u5b66\u7fd2\u306e\u5b89\u5b9a\u6027\u3068\u9ad8\u901f\u306a\u63a8\u8ad6\u306e\u4e21\u7acb\u306b\u8ca2\u732e\u3057\u305f\u3068\u3044\u3046\u5185\u5bb9\u306f\u3001\u7279\u5b9a\u30c9\u30e1\u30a4\u30f3\u306e\u7279\u5316\u578b\u30ed\u30fc\u30ab\u30ebLLM\u3092\u624b\u5143\u3067\u69cb\u7bc9\u30fb\u904b\u7528\u3057\u3066\u3044\u304f\u969b\u306b\u3082\u3001\u8a08\u7b97\u30ea\u30bd\u30fc\u30b9\u306e\u7bc0\u7d04\u3068\u7cbe\u5ea6\u306e\u5411\u4e0a\u3068\u3044\u3046\u4e21\u9762\u3067\u91cd\u8981\u306a\u5f79\u5272\u3092\u679c\u305f\u3057\u305d\u3046\u3067\u3059\u3002 \u30ed\u30fc\u30ab\u30ebLLM\u958b\u767a\u3084\u904b\u7528\u306b\u643a\u308f\u3063\u3066\u3044\u304f\u7acb\u5834\u3068\u3057\u3066\u3001LLM\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u306b\u6a19\u6e96\u7684\u306b\u63a1\u7528\u3055\u308c\u308b\u6a5f\u69cb\u306f\u8ffd\u3063\u3066\u3044\u304d\u305f\u3044\u3068\u3044\u3046\u89b3\u70b9\u304b\u3089\u3001Differential Transformer\u306f\u8208\u5473\u304c\u3042\u308a\u307e\u3059\u3002V1\u6210\u679c\u53ca\u3073V2\u3067\u306e\u6539\u5584\u70b9\u3092\u3061\u3083\u3093\u3068\u628a\u63e1\u3057\u3066\u304a\u304d\u305f\u304f\u3001\u4eca\u66f4\u306a\u304c\u3089\u8ad6\u6587\u3084\u6700\u65b0\u306e\u767a\u8868\u5185\u5bb9\u306b\u76ee\u3092\u901a\u3057\u3066\u307f\u307e\u3057\u305f\u3002","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Ftech-blog.abeja.asia%2Fentry%2Fdifferential-transformer-v1-v2-diff-202601\" title=\"Differential Transformer V2\u304c\u767a\u8868\u3055\u308c\u305f\u306e\u3067\u3001\u4eca\u66f4\u3067\u306f\u3042\u308b\u304cV1\u8ad6\u6587\u3092\u8aad\u3093\u3060\u3046\u3048\u3067\u5dee\u5206\u3092\u78ba\u8a8d\u3057\u3066\u307f\u305f - ABEJA Tech Blog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","provider_name":"Hatena Blog","url":"https://tech-blog.abeja.asia/entry/differential-transformer-v1-v2-diff-202601","blog_url":"https://tech-blog.abeja.asia/","author_name":"takezota","width":"100%","version":"1.0","categories":["LLM","\u30ed\u30fc\u30ab\u30ebLLM"],"blog_title":"ABEJA Tech Blog"}