{"image_url":null,"author_url":"https://blog.hatena.ne.jp/tanuki_boosting/","height":"190","url":"https://tanuki-boosting.hatenablog.jp/entry/2024/10/23/210017","categories":["\u6a5f\u68b0\u5b66\u7fd2"],"provider_url":"https://hatena.blog","type":"rich","blog_title":"\u8da3\u5473\u306ePython\u30fb\u6df1\u5c64\u5b66\u7fd2","width":"100%","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Ftanuki-boosting.hatenablog.jp%2Fentry%2F2024%2F10%2F23%2F210017\" title=\"Squeezeformer\u3092\u7406\u89e3\u3057\u305f\u3044 - \u8da3\u5473\u306ePython\u30fb\u6df1\u5c64\u5b66\u7fd2\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","description":"Squeezeformer\u306e\u8a73\u7d30\u89e3\u8aac 1. \u5168\u4f53\u69cb\u9020\u306e\u6982\u8981 Squeezeformer\u306f\u97f3\u58f0\u8a8d\u8b58\u306a\u3069\u306e\u30b7\u30fc\u30b1\u30f3\u30b9\u51e6\u7406\u306e\u305f\u3081\u306b\u8a2d\u8a08\u3055\u308c\u305f\u52b9\u7387\u7684\u306a\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u3067\u3059\u3002\u5165\u529b\u30c7\u30fc\u30bf\u5f62\u72b6\u306f (batch_size, sequence_length, channel_size) \u3068\u306a\u3063\u3066\u304a\u308a\u3001\u4f8b\u3048\u3070: - batch_size = 2 (2\u3064\u306e\u30c7\u30fc\u30bf\u3092\u540c\u6642\u51e6\u7406) - sequence_length = 16 (\u6642\u7cfb\u5217\u306e\u9577\u3055) - channel_size = 64 (\u5404\u6642\u70b9\u3067\u306e\u7279\u5fb4\u91cf\u306e\u6b21\u5143) \u5168\u4f53\u30b3\u30fc\u30c9 import torch import torch.nn as nn class GLUMlp(nn.\u2026","version":"1.0","published":"2024-10-23 21:00:17","author_name":"tanuki_boosting","provider_name":"Hatena Blog","title":"Squeezeformer\u3092\u7406\u89e3\u3057\u305f\u3044","blog_url":"https://tanuki-boosting.hatenablog.jp/"}