{"author_name":"wyukawa","type":"rich","published":"2013-07-22 19:41:32","provider_name":"Hatena Blog","url":"https://wyukawa.hatenablog.com/entry/20130722/1374489692","categories":["Hadoop"],"title":"Shuffle\u304c\u3046\u307e\u304f\u3044\u304b\u306a\u304f\u3066Reduce\u304c\u9045\u304f\u306a\u308b\u73fe\u8c61","image_url":null,"blog_title":"wyukawa's diary","width":"100%","description":"\u305f\u307e\u306b\u8d77\u3053\u308b\u73fe\u8c61\u3067\u3061\u3087\u3063\u3068\u56f0\u3063\u3066\u3044\u308b\u306e\u304cMapReduce\u306e\u30b8\u30e7\u30d6\u3092\u5b9f\u884c\u3057\u3066\u3044\u3066Shuffle\u304c\u3046\u307e\u304f\u3044\u304b\u306a\u304f\u3066Reduce\u304c\u9045\u304f\u306a\u308b\u73fe\u8c61\u3068\u3044\u3046\u306e\u304c\u3042\u308b\u3002\u9045\u304f\u306a\u3063\u3066\u3044\u308bMapReduce\u306e\u30b8\u30e7\u30d6\u306e\u30ed\u30b0\u3092\u307f\u308b\u3068\u3053\u3093\u306a\u611f\u3058\u306b\u306a\u3063\u3066\u3044\u3066TaskTracker\u304b\u3089\u306ecopy\u306b\u5931\u6557\u3057\u3066\u3044\u308b\u3088\u3046\u306b\u898b\u3048\u308b\u3002 2013-06-24 21:35:04,289 WARN org.apache.hadoop.mapred.ReduceTask: attempt_\u2026 copy failed: attempt_\u2026 from TaskTracker\u306e\u30db\u30b9\u30c8\u540d 2013-06-24 21:35:04,289 WARN or\u2026","blog_url":"https://wyukawa.hatenablog.com/","version":"1.0","provider_url":"https://hatena.blog","author_url":"https://blog.hatena.ne.jp/wyukawa/","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fwyukawa.hatenablog.com%2Fentry%2F20130722%2F1374489692\" title=\"Shuffle\u304c\u3046\u307e\u304f\u3044\u304b\u306a\u304f\u3066Reduce\u304c\u9045\u304f\u306a\u308b\u73fe\u8c61 - wyukawa&#39;s diary\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","height":"190"}