{"title":"\u30c7\u30fc\u30bf\u57fa\u76e4\u79fb\u884c\u8a08\u753b\u3068PySpark\uff08Spark Connect\uff09\u306e\u691c\u8a3c","height":"190","url":"https://developers.microad.co.jp/entry/2023/08/18/180000","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/t/takagi_mutsuo/20230816/20230816202510.png","provider_url":"https://hatena.blog","author_url":"https://blog.hatena.ne.jp/takagi_mutsuo/","provider_name":"Hatena Blog","blog_title":"MicroAd Developers Blog","published":"2023-08-18 18:00:00","blog_url":"https://developers.microad.co.jp/","width":"100%","author_name":"takagi_mutsuo","description":"\u30de\u30a4\u30af\u30ed\u30a2\u30c9\u3067\u30b5\u30fc\u30d0\u30b5\u30a4\u30c9\u30a8\u30f3\u30b8\u30cb\u30a2\u3092\u3057\u3066\u3044\u308b\u30bf\u30ab\u30ae\u3067\u3059\u3002 \u4eca\u56de\u306f\u30c7\u30fc\u30bf\u57fa\u76e4\u79fb\u884c\u3068PySpark\u306b\u3064\u3044\u3066\u306e\u8a71\u306b\u306a\u308a\u307e\u3059\u3002 \u76ee\u6b21 \u76ee\u6b21 \u30c7\u30fc\u30bf\u57fa\u76e4\u79fb\u884c\u306e\u6982\u8981 \u30c7\u30fc\u30bf\u57fa\u76e4\u79fb\u884c\u5f8c\u306e\u30d0\u30c3\u30c1\u51e6\u7406 Spark Connect\u3092\u5c0e\u5165\u3059\u308b Spark Connect\u306e\u554f\u984c\u70b9 \u307e\u3068\u3081 \u88dc\u8db3 \u30c7\u30fc\u30bf\u57fa\u76e4\u79fb\u884c\u306e\u6982\u8981 \u8af8\u3005\u306e\u4e8b\u60c51\u306b\u3088\u308a\u3001\u30c7\u30fc\u30bf\u57fa\u76e4\u3092Hadoop\u304b\u3089\u79fb\u884c\u3059\u308b\u3053\u3068\u306b\u306a\u308a\u307e\u3057\u305f\u3002 \u73fe\u5728\u306e\u30c7\u30fc\u30bf\u57fa\u76e4\u3067\u306eETL/ELT\u51e6\u7406\u306fHadoop\u30a8\u30b3\u30b7\u30b9\u30c6\u30e0(Hive\u3001HDFS\u306a\u3069)\u3092\u4e2d\u5fc3\u306b\u69cb\u6210\u3055\u308c\u3066\u3044\u307e\u3059\u3002 \u203bHadoop\u306b\u3064\u3044\u3066\u306f\u3053\u3061\u3089\u306e\u8a18\u4e8b\u304c\u53c2\u8003\u306b\u306a\u308a\u307e\u3059\u3002 \u3053\u308c\u3089\u3092Kubernetes\u3001PySpark\u3001S3\u4e92\u63db\u2026","version":"1.0","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fdevelopers.microad.co.jp%2Fentry%2F2023%2F08%2F18%2F180000\" title=\"\u30c7\u30fc\u30bf\u57fa\u76e4\u79fb\u884c\u8a08\u753b\u3068PySpark\uff08Spark Connect\uff09\u306e\u691c\u8a3c - MicroAd Developers Blog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","categories":["Python","PySpark"],"type":"rich"}