{"blog_url":"https://enakai00.hatenablog.com/","blog_title":"\u3081\u3082\u3081\u3082","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fenakai00.hatenablog.com%2Fentry%2F20100702%2F1278648805\" title=\"MapReduce \u30c7\u30b6\u30a4\u30f3\u30d1\u30bf\u30fc\u30f3 (2) - \u3081\u3082\u3081\u3082\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","height":"190","provider_url":"https://hatena.blog","description":"\"word co-occurrence problem\" \uff08\u6587\u66f8\u5185\u306e\u8fd1\u304f\u306b\u30da\u30a2\u3067\u51fa\u73fe\u3059\u308b\u5358\u8a9e\u306e\u6570\u3092\u30ab\u30a6\u30f3\u30c8\u3059\u308b\u51e6\u7406\uff09\u306e\uff12\u3064\u306e\u57fa\u672c\u30d1\u30bf\u30fc\u30f3\u3067\u3042\u308b \"Pairs\" \u3068 \"Stripes\" \u304b\u3089\u3001\u307e\u305a\u306f\u3001Pairs \u3092\u898b\u3066\u307f\u307e\u3059\u3002 \u4e8b\u524d\u6e96\u5099 \u300c\u30ab\u30e9\u30de\u30fc\u30be\u30d5\u306e\u5144\u5f1f\u300d\u306e\u30c6\u30ad\u30b9\u30c8\u3092 HDFS \u306b\u4fdd\u5b58\u3057\u3066\u304a\u304d\u307e\u3059\u3002 $ wget http://www.gutenberg.org/files/28054/28054.zip $ unzip 28054.zip $ hadoop fs -copyFromLocal 28054.txt Karamazov.txt \u30bd\u30fc\u30b9\u30b3\u30fc\u30c9 \u4f8b\u3048\u3070\u3001\u9023\u7d9a\u3057\u3066\u51fa\u73fe\u3059\u308b\u5358\u8a9e\u306e\u30da\u30a2\u3092\u2026","type":"rich","categories":[],"author_url":"https://blog.hatena.ne.jp/enakai00/","version":"1.0","author_name":"enakai00","title":"MapReduce \u30c7\u30b6\u30a4\u30f3\u30d1\u30bf\u30fc\u30f3 (2)","width":"100%","published":"2010-07-02 13:13:25","image_url":null,"url":"https://enakai00.hatenablog.com/entry/20100702/1278648805","provider_name":"Hatena Blog"}