{"blog_url":"https://yohei-a.hatenablog.jp/","width":"100%","categories":["AWS"],"blog_title":"ablog","provider_name":"Hatena Blog","type":"rich","published":"2018-09-16 17:06:26","author_url":"https://blog.hatena.ne.jp/yohei-a/","image_url":"https://images-fe.ssl-images-amazon.com/images/I/51P2Kp%2Bpq8L._SL160_.jpg","version":"1.0","height":"190","url":"https://yohei-a.hatenablog.jp/entry/20180916/1537085186","title":"Spark \u306e RDD\u3001DataFrame\u3001DAG \u3068 Glue \u306e DynamicFrame \u306a\u3069\u306b\u3064\u3044\u3066","provider_url":"https://hatena.blog","description":"Spark\u3068\u306f \u30d3\u30c3\u30b0\u30c7\u30fc\u30bf\u3092\u652f\u3048\u308b\u6280\u8853\u2015\u523b\u3005\u3068\u30c7\u30fc\u30bf\u304c\u8108\u6253\u3064\u81ea\u52d5\u5316\u306e\u4e16\u754c (WEB+DB PRESS plus)\u4f5c\u8005: \u897f\u7530\u572d\u4ecb\u51fa\u7248\u793e/\u30e1\u30fc\u30ab\u30fc: \u6280\u8853\u8a55\u8ad6\u793e\u767a\u58f2\u65e5: 2017/09/22\u30e1\u30c7\u30a3\u30a2: \u5358\u884c\u672c\uff08\u30bd\u30d5\u30c8\u30ab\u30d0\u30fc\uff09\u3053\u306e\u5546\u54c1\u3092\u542b\u3080\u30d6\u30ed\u30b0 (3\u4ef6) \u3092\u898b\u308bP.100 \u300cApache Spark\u300d\u3082\u3001MapReduce \u3088\u308a\u52b9\u7387\u306e\u826f\u3044\u30c7\u30fc\u30bf\u51e6\u7406\u3092\u5b9f\u73fe\u3059\u308b\u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u3068\u3057\u3066\u958b\u767a\u304c\u9032\u3081\u3089\u308c\u3066\u3044\u307e\u3059\u3002Hadoop \u306e\u5ef6\u9577\u7dda\u4e0a\u306b\u3042\u308b Tez \u3068\u306f\u7570\u306a\u308a\u3001Spark \u306f Hadoop \u3068\u306f\u5225\u306e\u72ec\u7acb\u3057\u305f\u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u3067\u3059\u3002Spark \u306e\u7279\u5fb4\u306f\u5927\u91cf\u306e\u30e1\u30e2\u30ea\u3092\u6d3b\u7528\u3057\u3066\u9ad8\u901f\u5316\u3092\u5b9f\u73fe\u3059\u308b\u3053\u3068\u3067\u3059\u3002\uff08\u4e2d\u7565\uff09\u30b3\u30f3\u30d4\u2026","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fyohei-a.hatenablog.jp%2Fentry%2F20180916%2F1537085186\" title=\"Spark \u306e RDD\u3001DataFrame\u3001DAG \u3068 Glue \u306e DynamicFrame \u306a\u3069\u306b\u3064\u3044\u3066 - ablog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","author_name":"yohei-a"}