{"image_url":null,"categories":["Spark / PySpark"],"url":"https://dk521123.hatenablog.com/entry/2020/01/04/150942","version":"1.0","blog_title":"\u30d7\u30ed\u30b0\u30e9\u30e0 \u306e\u8d85\u500b\u4eba\u7684\u306a\u30e1\u30e2","height":"190","title":"\u3010\u5206\u6563\u51e6\u7406\u3011PySpark \uff5e DataFrame / \u30c7\u30fc\u30bf\u64cd\u4f5c\u7de8 \uff5e","description":"\u25a0 \u306f\u3058\u3081\u306b https://dk521123.hatenablog.com/entry/2019/11/14/221126 https://dk521123.hatenablog.com/entry/2019/11/24/225534 \u306e\u7d9a\u304d\u3002 PySpark \u3067\u306e\u30c7\u30fc\u30bf\u306e\u57fa\u672c\u64cd\u4f5c\u306b\u3064\u3044\u3066\u3001\u5b66\u3076\u3002 \u76ee\u6b21 \u3010\uff10\u3011collect\uff08\u30eb\u30fc\u30d7\u3055\u305b\u308b\uff09 \u3010\uff11\u3011filter (\u62bd\u51fa) \u3010\uff12\u3011groupby (\u30b0\u30eb\u30fc\u30d7\u5316) \u3010\uff13\u3011distinct / dropDuplicates (\u91cd\u8907\u5024\u306e\u524a\u9664) \u3010\uff14\u3011orderBy (\u30bd\u30fc\u30c8) \u3010\uff15\u3011sql (SQL\u6587) \u3010\uff10\u3011collect\uff08\u30eb\u30fc\u30d7\u3055\u305b\u308b\uff09 * \u5168\u3066\u306e\u2026","published":"2020-01-04 15:09:42","width":"100%","blog_url":"https://dk521123.hatenablog.com/","provider_name":"Hatena Blog","type":"rich","author_url":"https://blog.hatena.ne.jp/dk521123/","provider_url":"https://hatena.blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fdk521123.hatenablog.com%2Fentry%2F2020%2F01%2F04%2F150942\" title=\"\u3010\u5206\u6563\u51e6\u7406\u3011PySpark \uff5e DataFrame / \u30c7\u30fc\u30bf\u64cd\u4f5c\u7de8 \uff5e - \u30d7\u30ed\u30b0\u30e9\u30e0 \u306e\u8d85\u500b\u4eba\u7684\u306a\u30e1\u30e2\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","author_name":"dk521123"}