{"categories":["MoE"],"image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/T/TadaoYamaoka/20260523/20260523155806.png","blog_url":"https://tadaoyamaoka.hatenablog.com/","type":"rich","provider_name":"Hatena Blog","author_name":"TadaoYamaoka","published":"2026-05-23 16:30:34","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Ftadaoyamaoka.hatenablog.com%2Fentry%2F2026%2F05%2F23%2F163034\" title=\"dropless MoE(Mixture of Experts)\u3092\u8a66\u3059 - TadaoYamaoka\u306e\u958b\u767a\u65e5\u8a18\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","author_url":"https://blog.hatena.ne.jp/TadaoYamaoka/","height":"190","provider_url":"https://hatena.blog","title":"dropless MoE(Mixture of Experts)\u3092\u8a66\u3059","description":"dlshogi\u306e\u30e2\u30c7\u30eb\u306f\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u5897\u3084\u3059\u307b\u3069\u7cbe\u5ea6\u304c\u5411\u4e0a\u3059\u308b\u3053\u3068\u304c60\u30d6\u30ed\u30c3\u30af768\u30d5\u30a3\u30eb\u30bf\u306e\u30b5\u30a4\u30ba\u307e\u3067\u78ba\u8a8d\u3067\u304d\u3066\u3044\u308b\u3002 \u3057\u304b\u3057\u3001\u63a2\u7d22\u901f\u5ea6\u304c\u843d\u3061\u308b\u305f\u3081\u3001\u5bfe\u5c40\u3057\u305f\u969b\u306e\u5f37\u3055\u306f\u300140\u30d6\u30ed\u30c3\u30af512\u30d5\u30a3\u30eb\u30bf\u306e\u30e2\u30c7\u30eb\u306b\u306f\u53ca\u3070\u306a\u3044\u3002MoE(Mixture of Experts)\u306f\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u5897\u3084\u3057\u306a\u304c\u3089\u63a8\u8ad6\u901f\u5ea6\u3092\u843d\u3068\u3055\u306a\u3044\u624b\u6cd5\u3068\u3057\u3066LLM\u3067\u53d6\u308a\u5165\u308c\u3089\u308c\u3066\u3044\u308b\u3002DL\u7cfb\u306e\u5c06\u68cbAI\u3092\u5f37\u304f\u3059\u308b\u305f\u3081\u306b\u306f\u3001MoE\u306f\u6709\u529b\u306a\u624b\u6cd5\u3067\u3042\u308b\u3068\u8003\u3048\u3066\u3044\u308b\u3002\u3057\u304b\u3057\u3001MoE\u306e\u5b9f\u88c5\u306f\u5358\u7d14\u3067\u306f\u306a\u304f\u3001GPU\u3067\u52b9\u7387\u7684\u306b\u63a8\u8ad6\u3059\u308b\u306b\u306f\u3001PyTorch \u2192 ONNX \u2192 TensorRT\u3068\u3044\u3046dlshogi\u3067\u4f7f\u7528\u3057\u3066\u3044\u308b\u6a19\u6e96\u5316\u3055\u308c\u305f\u624b\u6cd5\u304c\u4f7f\u3048\u305a\u2026","url":"https://tadaoyamaoka.hatenablog.com/entry/2026/05/23/163034","version":"1.0","blog_title":"TadaoYamaoka\u306e\u958b\u767a\u65e5\u8a18","width":"100%"}