{"title":"\u300c\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u30a8\u30f3\u30b8\u30cb\u30a2\u306e\u305f\u3081\u306eApache Spark\u5165\u9580\u300d\u51fa\u7248\u8a18\u5ff5\u30bb\u30df\u30ca\u30fc\u306b\u884c\u3063\u3066\u304d\u305f","author_url":"https://blog.hatena.ne.jp/pandazx/","image_url":null,"provider_url":"https://hatena.blog","blog_url":"https://pandazx.hatenablog.com/","width":"100%","blog_title":"pandazx's blog","author_name":"pandazx","version":"1.0","description":"connpass.com \u306b\u884c\u3063\u3066\u304d\u305f\u3002\u4ee5\u4e0b\u306f\u30e1\u30e2 Apache Spark\u5165\u9580\u66f8\u7c4d\u306e\u7d39\u4ecb \u7406\u8ad6\u3088\u308a\u3082\u4f7f\u3044\u65b9\u306b\u91cd\u304d\u3092\u7f6e\u3044\u305f\u5165\u9580\u66f8 \u30b5\u30f3\u30d7\u30eb\u306e\u30d7\u30ed\u30b0\u30e9\u30df\u30f3\u30b0\u8a00\u8a9e\u306fPython \u30c7\u30fc\u30bf\u5206\u6790\u57fa\u76e4\u306b\u4f7f\u308f\u308c\u308bOSS\u7d39\u4ecb \u30c7\u30fc\u30bf\u53ce\u96c6\u306ffluentd, kafka \u30c7\u30fc\u30bf\u84c4\u7a4d\u306fhdfs, cassandra \u30b9\u30c8\u30ea\u30fc\u30e0\u51e6\u7406\u3001\u7c21\u6613\u306a\u96c6\u8a08\u5206\u6790\u306fSpark structured streaming \u30d0\u30c3\u30c1\u51e6\u7406\u306fSpark SQL \u30c7\u30fc\u30bf\u5206\u6790\u306fSpark MLlib, Jupyter Spark\u304c\u6ce8\u76ee\u3055\u308c\u3066\u3044\u308b\u7406\u7531\u306f\u30c7\u30fc\u30bf\u5206\u6790\u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0\u306e\u4e3b\u8981\u306a\u6a5f\u80fd\u304c\u3042\u308b\u305f\u3081 Fluentd, Kafka\u306e\u7d39\u4ecb \u6b8b\u5ff5\u306a\u304c\u3089\u30b9\u30d4\u2026","height":"190","published":"2018-03-30 18:54:24","categories":["\u52c9\u5f37\u4f1a","spark"],"url":"https://pandazx.hatenablog.com/entry/2018/03/30/185424","type":"rich","provider_name":"Hatena Blog","html":""}