{"html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fchakoku.hatenablog.com%2Fentry%2F2026%2F01%2F01%2F222236\" title=\"LLM\u81ea\u4f5c\u5165\u9580\u3067\u30df\u30cb\u30de\u30e0\u306aLLM\u3092\u4f5c\u308b(\u305d\u306e\uff12) - chakoku\u306e\u30d6\u30ed\u30b0(rev4)\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","title":"LLM\u81ea\u4f5c\u5165\u9580\u3067\u30df\u30cb\u30de\u30e0\u306aLLM\u3092\u4f5c\u308b(\u305d\u306e\uff12)","categories":[],"url":"https://chakoku.hatenablog.com/entry/2026/01/01/222236","blog_title":"chakoku\u306e\u30d6\u30ed\u30b0(rev4)","description":"\u80cc\u666f\uff1a\u300cLLM\u81ea\u4f5c\u5165\u9580\u300d(LLM from Scratch(ChatGPT\u3067\u306f\u3001Raschka\u672c\u3068\u8a00\u3063\u3066\u304d\u305f))\u3092\u8aad\u3093\u3067\u30df\u30cb\u30de\u30e0LLM\u3092\u4f5c\u308b(\u305d\u306e2) \u8ab2\u984c\uff1a\u300c2.8\u7ae0 \u5358\u8a9e\u306e\u4f4d\u7f6e\u3092\u30a8\u30f3\u30b3\u30fc\u30c9\u3059\u308b\u300d\u307e\u3067\u8aad\u3093\u3067\u6765\u305f\u3002\u30c8\u30fc\u30af\u30f3\u306e\u4f4d\u7f6e\u306f\u7d76\u5bfe\u4f4d\u7f6e\u60c5\u5831\u3092\u4f7f\u3044\u3001\u4e71\u6570\u3067\u751f\u6210\u3057\u305f\u4f4d\u7f6e\u7d44\u307f\u8fbc\u307f(pos_embeddings)\u3092\u30c8\u30fc\u30af\u30f3\u306e\u30c6\u30f3\u30bd\u30eb\u306b\u52a0\u7b97\u3059\u308b\u3068\u66f8\u304b\u308c\u3066\u3044\u308b\u3002\u304c\u30fb\u30fb\u30fb\u30c8\u30fc\u30af\u30f3\u306e\u30c6\u30f3\u30bd\u30eb\u306b\u8db3\u3057\u3066\u3057\u307e\u3063\u305f\u3089\u4f4d\u7f6e\u306a\u3093\u3066\u5206\u304b\u3089\u306a\u3044\u306e\u3067\u306f\uff1f\uff1f\u3068\u3044\u3046\u7591\u554f\u3068\u3001\u300c3.3\u7ae0 Self-Attention\u3092\u4f7f\u3063\u3066\u5165\u529b\u306e\u7570\u306a\u308b\u90e8\u5206\u306b\u6ce8\u610f\u3092\u6255\u3046\u300d\u304c\u3069\u3046\u95a2\u4fc2\u3057\u3066\u3044\u308b\u306e\u304b\u3001\u5206\u304b\u3089\u306a\u304f\u306a\u3063\u305f \u53d6\u308a\u7d44\u307f\uff1aChatGPT\u306b\u300cLLM f\u2026","author_url":"https://blog.hatena.ne.jp/chakoku/","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/c/chakoku/20260101/20260101222549.png","provider_name":"Hatena Blog","width":"100%","type":"rich","height":"190","provider_url":"https://hatena.blog","version":"1.0","published":"2026-01-01 22:22:36","author_name":"chakoku","blog_url":"https://chakoku.hatenablog.com/"}