{"provider_url":"https://hatena.blog","title":"\u3010\u5206\u6563\u51e6\u7406\u3011\u5206\u6563\u51e6\u7406\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af","published":"2019-09-13 21:23:25","author_name":"dk521123","categories":["Spark / PySpark","Hadoop"],"url":"https://dk521123.hatenablog.com/entry/2019/09/13/212325","blog_title":"\u30d7\u30ed\u30b0\u30e9\u30e0 \u306e\u8d85\u500b\u4eba\u7684\u306a\u30e1\u30e2","blog_url":"https://dk521123.hatenablog.com/","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fdk521123.hatenablog.com%2Fentry%2F2019%2F09%2F13%2F212325\" title=\"\u3010\u5206\u6563\u51e6\u7406\u3011\u5206\u6563\u51e6\u7406\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af - \u30d7\u30ed\u30b0\u30e9\u30e0 \u306e\u8d85\u500b\u4eba\u7684\u306a\u30e1\u30e2\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","author_url":"https://blog.hatena.ne.jp/dk521123/","provider_name":"Hatena Blog","image_url":null,"version":"1.0","width":"100%","type":"rich","height":"190","description":"\u25a0 \u306f\u3058\u3081\u306b \u6b21\u306e\u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u3067\u3001\u30d3\u30c3\u30b0\u30c7\u30fc\u30bf\u3092\u6271\u3046\u4ed5\u4e8b\u306b\u306a\u308a\u305d\u3046\u3067\u3001 Hadoop \u3068\u304b Spark \u3068\u304b Hive \u3068\u304b\u3063\u3066\u30ad\u30fc\u30ef\u30fc\u30c9\u304c\u3067\u3066\u304d\u305f\u306e\u3067 \u8db3\u639b\u304b\u308a\u306b\u300c\u5206\u6563\u51e6\u7406\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af\u300d\u3092\u8abf\u3079\u3066\u307f\u308b \u76ee\u6b21 \u3010\uff11\u3011\u5206\u6563\u51e6\u7406 (Distributed Processing) \u3068\u306f\uff1f \u3010\uff12\u3011\u5206\u6563\u51e6\u7406\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af \uff11\uff09Apache Hadoop \uff12\uff09Apache Spark \u3010\uff13\u3011MapReduce \u3010\uff11\u3011\u5206\u6563\u51e6\u7406 (Distributed Processing) \u3068\u306f\uff1f * \u51e6\u7406\u901f\u5ea6\u306e\u5411\u4e0a\u3068\u8ca0\u8377\u8efd\u6e1b\u306e\u305f\u3081\u306b\u3001 \u8907\u6570\u306e\u30b3\u30f3\u30d4\u30e5\u30fc\u30bf\u3067\u5206\u6563\u3057\u3066\u51e6\u7406\u3059\u308b\u3053\u3068 \u3010\uff12\u3011\u5206\u6563\u51e6\u7406\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af \uff11\uff09Apac\u2026"}