{"published":"2026-07-05 09:12:10","title":"\u60c5\u5831\u7406\u8ad6","description":"\u25a0(\u81ea\u5df1)\u60c5\u5831\u91cf\u4ee5\u4e0b\u3092\u6e80\u305f\u3059 \u6e1b\u5c11\u95a2\u6570; x\u304c\u5c0f\u3055\u3044\u307b\u3069I(x)\u306f\u5927\u304d\u3044 \u78ba\u5b9f\u306a\u4e8b\u8c61\u306f\u30bc\u30ed; I(1) = 0 \u52a0\u6cd5\u6027; I(xy) = I(x) + I(y) \u25a0\u76f8\u4e92\u60c5\u5831\u91cf P(x, y)\u3068P( x )P( y ) \u306eKL \u30c0\u30a4\u30d0\u30fc\u30b8\u30a7\u30f3\u30b9 x\u3068y\u304c\u72ec\u7acb\u306e\u5834\u5408\u306b\u30bc\u30ed\u306b\u306a\u308b \u300cY\u3092\u77e5\u308b\u524d\u306eX\u306e\u4e0d\u78ba\u5b9f\u6027\u300d(H(X))\u3068\u300cY\u3092\u77e5\u3063\u305f\u5f8c\u306eX\u306e\u4e0d\u78ba\u5b9f\u6027\u300d(H(X|Y))\u306e\u5dee \u25a0\u30a8\u30f3\u30c8\u30ed\u30d4\u30fc(\u5e73\u5747\u60c5\u5831\u91cf) \u30a8\u30f3\u30c8\u30ed\u30d4\u30fc\u306f\u60c5\u5831\u91cf\u306e\u671f\u5f85\u5024 \u25a0\u4ea4\u5dee\u30a8\u30f3\u30c8\u30ed\u30d4\u30fc P\u3068Q\u306e\u5206\u5e03\u5dee\u7570\u306e\u6307\u6a19 : \u771f\u306e\u5206\u5e03 : \u30e2\u30c7\u30eb\u306b\u3088\u308b\u4e88\u6e2c\u5206\u5e03\u4ea4\u5dee\u30a8\u30f3\u30c8\u30ed\u30d4\u30fc = \u30a8\u30f3\u30c8\u30ed\u30d4\u30fc + KL\u30c0\u30a4\u30d0\u30fc\u30b8\u30a7\u30f3\u30b9P\u3068Q\u304c\u4e00\u81f4\u3059\u308b\u3068\u304d\u3001\u4ea4\u5dee\u30a8\u2026","image_url":null,"provider_url":"https://hatena.blog","url":"https://htn20190109.hatenablog.com/entry/2026/07/05/091210","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fhtn20190109.hatenablog.com%2Fentry%2F2026%2F07%2F05%2F091210\" title=\"\u60c5\u5831\u7406\u8ad6 - HTN20190109\u306e\u65e5\u8a18\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","categories":["DL"],"blog_title":"HTN20190109\u306e\u65e5\u8a18","provider_name":"Hatena Blog","blog_url":"https://htn20190109.hatenablog.com/","type":"rich","version":"1.0","author_name":"HTN20190109","author_url":"https://blog.hatena.ne.jp/HTN20190109/","height":"190","width":"100%"}