{"author_url":"https://blog.hatena.ne.jp/yohei-a/","categories":["AWS","Glue","Spark"],"provider_name":"Hatena Blog","title":"Parquet \u306f\u30d5\u30a1\u30a4\u30eb\u3067\u30ab\u30e9\u30e0\u306e\u578b\u3092\u6301\u3063\u3066\u3044\u308b\u305f\u3081\u3001Glue \u30ab\u30bf\u30ed\u30b0\u3060\u3051\u5909\u66f4\u3057\u3066\u3082\u578b\u3092\u5909\u3048\u308b\u3053\u3068\u306f\u3067\u304d\u306a\u3044","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fyohei-a.hatenablog.jp%2Fentry%2F20230531%2F1685461001\" title=\"Parquet \u306f\u30d5\u30a1\u30a4\u30eb\u3067\u30ab\u30e9\u30e0\u306e\u578b\u3092\u6301\u3063\u3066\u3044\u308b\u305f\u3081\u3001Glue \u30ab\u30bf\u30ed\u30b0\u3060\u3051\u5909\u66f4\u3057\u3066\u3082\u578b\u3092\u5909\u3048\u308b\u3053\u3068\u306f\u3067\u304d\u306a\u3044 - ablog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","url":"https://yohei-a.hatenablog.jp/entry/20230531/1685461001","description":"S3 \u306b\u3042\u308b Parquet \u30d5\u30a1\u30a4\u30eb\u3092 Glue \u306e Crawler \u3067\u30af\u30ed\u30fc\u30eb\u3057\u3066\u30c6\u30fc\u30d6\u30eb\u3092\u4f5c\u6210\u3057\u3001\u6587\u5b57\u5217\u578b\u306e\u30ab\u30e9\u30e0\u3092\u6570\u5024\u578b\u306b\u5909\u66f4\u3059\u308b\u3068\u30a8\u30e9\u30fc\u306b\u306a\u308b\u3068\u3044\u3046\u5f53\u305f\u308a\u307e\u308a\u524d\uff08Parquet \u306f\u9805\u76ee\u5b9a\u7fa9\u306b\u578b\u3092\u6301\u3063\u3066\u3044\u308b\u30d0\u30a4\u30ca\u30ea\u30d5\u30a1\u30a4\u30eb\u306e\u305f\u3081\uff09\u306e\u3053\u3068\u3092\u691c\u8a3c\u3057\u305f\u3002\u578b\u3092\u5909\u3048\u305f\u3044\u5834\u5408\u306f\u3001Parquet \u30d5\u30a1\u30a4\u30eb\u3092\u4f5c\u308a\u76f4\u3059\u5fc5\u8981\u304c\u3042\u308b\u3002 string->decimal >>> from pyspark.sql import SparkSession >>> spark = SparkSession.builder. \\ appName(\"ExamplePySparkSubmitTask\"). \\ config\u2026","type":"rich","version":"1.0","width":"100%","blog_title":"ablog","height":"190","author_name":"yohei-a","provider_url":"https://hatena.blog","published":"2023-05-31 00:36:41","blog_url":"https://yohei-a.hatenablog.jp/","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/y/yohei-a/20230531/20230531003633.png"}