{"blog_title":"YOMON8.NET","version":"1.0","author_url":"https://blog.hatena.ne.jp/yomon8/","description":"DynamicFrame\u3092\u4f7f\u3063\u305f\u958b\u767a\u3092\u3057\u3066\u3044\u305f\u3089\u3001\u5927\u3057\u305f\u51e6\u7406\u3057\u3066\u3044\u306a\u3044\u306e\u306b\u3001\u60f3\u50cf\u4ee5\u4e0a\u306b\u6642\u9593\u304c\u304b\u304b\u308b\u306a\u3068\u601d\u3063\u3066\u8abf\u3079\u3066\u3044\u305f\u3089\u3001JSON\u306e\u66f8\u304d\u51fa\u3057\u304c\u6642\u9593\u304b\u304b\u3063\u3066\u3044\u307e\u3057\u305f\u3002 \u30bf\u30a4\u30c8\u30eb\u306e\u901a\u308a\u3001JSON\u3084CSV\u3067\u306eS3\u51fa\u529b\u3068\u6bd4\u8f03\u3057\u3066Parquet\u3067\u306e\u51fa\u529b\u306f\u51c4\u3044\u65e9\u3044\u3068\u3044\u3046\u304a\u8a71\u3067\u3059\u3002\u51e6\u7406\u5168\u4f53\u306b\u5f71\u97ff\u3059\u308b\u304f\u3089\u3044\u306e\u5dee\u304c\u51fa\u307e\u3057\u305f\u3002 \u5229\u7528\u3059\u308b\u30c7\u30fc\u30bf \u51e6\u7406\u5185\u5bb9 Parquet -> JSON Parquet -> JSON(Gzip) Parquet -> CSV(Gzip) Parquet -> Parquet \u4ed6\u306b\u3082 \u7d50\u679c \u5229\u7528\u3059\u308b\u30c7\u30fc\u30bf AWS\u304b\u3089\u63d0\u4f9b\u3055\u308c\u3066\u3044\u308bParquet\u5f62\u5f0f\u306eELB\u30ed\u30b0\u3067\u3059\u3002 $ aws s3\u2026","blog_url":"https://yomon.hatenablog.com/","provider_name":"Hatena Blog","author_name":"yomon8","height":"190","width":"100%","type":"rich","url":"https://yomon.hatenablog.com/entry/2019/01/17/063003","categories":["AWS","AWS Glue"],"title":"Glue\u306eDynamicFrame\u3067S3\u3078\u30d5\u30a1\u30a4\u30eb\u66f8\u304d\u51fa\u3059\u6642\u306fCSV\u3084JSON\u3088\u308aParquet\u304c\u65e9\u3044","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/y/yomon8/20181017/20181017121627.png","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fyomon.hatenablog.com%2Fentry%2F2019%2F01%2F17%2F063003\" title=\"Glue\u306eDynamicFrame\u3067S3\u3078\u30d5\u30a1\u30a4\u30eb\u66f8\u304d\u51fa\u3059\u6642\u306fCSV\u3084JSON\u3088\u308aParquet\u304c\u65e9\u3044 - YOMON8.NET\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","provider_url":"https://hatena.blog","published":"2019-01-17 06:30:03"}