{"title":"Spark UI \u3067\u53c2\u7167\u3057\u3066\u3044\u308b S3 \u306e\u30d1\u30b9\u3092\u5909\u66f4\u3059\u308b","categories":["AWS"],"blog_title":"ablog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fyohei-a.hatenablog.jp%2Fentry%2F20210119%2F1611022950\" title=\"Spark UI \u3067\u53c2\u7167\u3057\u3066\u3044\u308b S3 \u306e\u30d1\u30b9\u3092\u5909\u66f4\u3059\u308b - ablog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","url":"https://yohei-a.hatenablog.jp/entry/20210119/1611022950","blog_url":"https://yohei-a.hatenablog.jp/","height":"190","version":"1.0","image_url":null,"width":"100%","provider_url":"https://hatena.blog","author_name":"yohei-a","description":"CloudFormation \u3067 Spark UI \u7528\u306b EC2 \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u3092\u4f5c\u6210\u5f8c\u306b\u3001\u53c2\u7167\u3059\u308b S3 \u306e\u30d1\u30b9\u3092\u5909\u66f4\u3059\u308b\u624b\u9806\u3002 /opt/spark/conf/spark-defaults.conf \u306e spark.history.fs.logDirectory \u3092\u7de8\u96c6\u3059\u308b spark.eventLog.enabled true spark.history.fs.logDirectory s3a://spark-ui/ap-northeast-1/eventlog \u2605 spark.history.ui.port 0 spark.ssl.historyServer.enabled true s\u2026","author_url":"https://blog.hatena.ne.jp/yohei-a/","type":"rich","published":"2021-01-19 11:22:30","provider_name":"Hatena Blog"}