{"blog_url":"https://www.kwbtblog.com/","provider_url":"https://hatena.blog","published":"2019-07-27 00:33:02","version":"1.0","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fwww.kwbtblog.com%2Fentry%2F2019%2F07%2F27%2F003302\" title=\"Spark\uff08Google Dataproc\uff09\u304b\u3089AWS S3\u306b\u30a2\u30af\u30bb\u30b9\u3059\u308b\u65b9\u6cd5 - \u65b0\u3057\u3044\u3053\u3068\u306b\u306f\u30a6\u30a7\u30eb\u30ab\u30e0\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","author_url":"https://blog.hatena.ne.jp/kwbtblog/","width":"100%","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/k/kwbtblog/20190727/20190727000136.png","description":"Spark\uff08Google Dataproc\uff09\u304b\u3089\u3001AWS S3\u306b\u30a2\u30af\u30bb\u30b9\u3059\u308b\u65b9\u6cd5\u3067\u3059\u3002 \u624b\u9806 Spark\u8a2d\u5b9a \u4e0b\u8a18\u306eSpark\u30fbHaddop\u306e\u8a2d\u5b9a\u3092\u3059\u308b\u3068\u3001Spark\u304b\u3089AWS S3\u30d5\u30a1\u30a4\u30eb\u306e\u8aad\u307f\u66f8\u304d\u304c\u3067\u304d\u308b\u3088\u3046\u306b\u306a\u308a\u307e\u3059\u3002 Spark\u306b\u4e0b\u8a18AWS\u95a2\u9023\u306ejar\u30d5\u30a1\u30a4\u30eb\u3092\u8aad\u307f\u8fbc\u307f\u307e\u3059 aws-java-sdk-bundle-xxxx.jar hadoop-aws-xxxx.jar Hadoop\u306e\u8a2d\u5b9a\u30d5\u30a1\u30a4\u30eb\u300ccore-site.xml\u300d\u306b\u4e0b\u8a18\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u8a2d\u5b9a\u3057\u307e\u3059 fs.s3a.access.key\uff1aAWS S3\u306e\u30a2\u30af\u30bb\u30b9\u30ad\u30fc fs.s3a.secret.key\uff1aAWS S3\u306e\u30b7\u30fc\u30af\u30ec\u30c3\u30c8 Da\u2026","provider_name":"Hatena Blog","title":"Spark\uff08Google Dataproc\uff09\u304b\u3089AWS S3\u306b\u30a2\u30af\u30bb\u30b9\u3059\u308b\u65b9\u6cd5","author_name":"kwbtblog","categories":["AWS","AWS S3","Amazon Web Service","Dataproc","GCP","Google Cloud Platform","Hadoop","PySpark","Python","Spark","\u30c7\u30fc\u30bf\u5206\u6790"],"blog_title":"\u65b0\u3057\u3044\u3053\u3068\u306b\u306f\u30a6\u30a7\u30eb\u30ab\u30e0","url":"https://www.kwbtblog.com/entry/2019/07/27/003302","height":"190","type":"rich"}