{"type":"rich","image_url":null,"title":"GPT(Generative Pretrained Transformer)","provider_name":"Hatena Blog","version":"1.0","published":"2026-08-10 22:39:15","url":"https://htn20190109.hatenablog.com/entry/2026/08/10/223915","blog_url":"https://htn20190109.hatenablog.com/","provider_url":"https://hatena.blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fhtn20190109.hatenablog.com%2Fentry%2F2026%2F08%2F10%2F223915\" title=\"GPT(Generative Pretrained Transformer) - HTN20190109\u306e\u65e5\u8a18\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","description":"\u30fbGPT-12018\u5e746\u6708 OpenAI\u30d1\u30e9\u30e1\u30fc\u30bf\u6570:1\u51041700\u4e07\u4e8b\u524d\u5b66\u7fd2\u306e\u30c7\u30fc\u30bf\u91cf:4GB\u5c64\u6570:12 Transformer\u306e\u30c7\u30b3\u30fc\u30c0\u69cb\u9020Next Token Prediction\u3067\u4e8b\u524d\u5b66\u7fd2 \u30fbGPT-22019\u5e742\u6708 OpenAI\u30d1\u30e9\u30e1\u30fc\u30bf\u6570:15\u5104\u4e8b\u524d\u5b66\u7fd2\u306e\u30c7\u30fc\u30bf\u91cf:40GB\u5c64\u6570:48 \u30fbGPT-32020\u5e746\u6708 OpenAI\u30d1\u30e9\u30e1\u30fc\u30bf\u6570:1750\u5104\u4e8b\u524d\u5b66\u7fd2\u306e\u30c7\u30fc\u30bf\u91cf:570GB\u5c64\u6570:96 \u30fbGPT-3.52022\u5e743\u6708 OpenAI\u30d1\u30e9\u30e1\u30fc\u30bf\u6570:3550\u5104RLHF \u30fbChatGPT2022\u5e7411\u6708 OpenAIGPT-3.5\u3092\u30d9\u30fc\u30b9RLHF \u30fbGPT-42023\u5e743\u6708 OpenAI\u30d1\u2026","height":"190","author_url":"https://blog.hatena.ne.jp/HTN20190109/","width":"100%","blog_title":"HTN20190109\u306e\u65e5\u8a18","author_name":"HTN20190109","categories":["DL"]}