{"author_name":"yoshitaku_jp","version":"1.0","published":"2022-01-23 18:00:00","categories":["Python"],"blog_title":"\u3088\u3057\u305f\u304f blog","title":"PyArrow\u3067CSV\u3092Parquet\u306b\u5909\u63db\u3059\u308b","image_url":"https://cdn.user.blog.st-hatena.com/default_entry_og_image/152575302/1527834878412731","provider_name":"Hatena Blog","width":"100%","author_url":"https://blog.hatena.ne.jp/yoshitaku_jp/","type":"rich","url":"https://yoshitaku-jp.hatenablog.com/entry/2022/01/23/180000","height":"190","description":"\u4eca\u56de\u306f PyArrow \u3092\u4f7f\u3063\u3066 CSV \u3092 Parquet \u306b\u5909\u63db\u3057\u3066\u307f\u305f\u3002 \u30c7\u30fc\u30bf\u30ec\u30a4\u30af\u306f\u751f\u30c7\u30fc\u30bf\u3092\u6e9c\u3081\u308b\u3053\u3068\u304c\u4e3b\u76ee\u7684\u3060\u304c\u3001\u30ec\u30a4\u30af\u30cf\u30a6\u30b9\u578b\u306e\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u306e\u6d41\u308c\u3082\u3042\u308a\u3001\u30c7\u30fc\u30bf\u3092\u5229\u7528\u3057\u305f\u3044\u30b5\u30fc\u30d3\u30b9\u5074\u304c\u5229\u7528\u3057\u3084\u3059\u3044\u3088\u3046\u306a\u6574\u5f62\u5316\u3055\u308c\u305f\u30c7\u30fc\u30bf\u3092\u7528\u610f\u3059\u308b\u7528\u9014\u3082\u5897\u3048\u3066\u304f\u308b\u3068\u601d\u3046\u3002 \u305d\u3046\u306a\u308b\u3068 CSV \u30d5\u30a1\u30a4\u30eb\u3067\u30c7\u30fc\u30bf\u3092\u6301\u3064\u3088\u308a\u304b\u306f Parquet \u3067\u6301\u3064\u307b\u3046\u304c\u3001\u5229\u4fbf\u6027\u304c\u9ad8\u3044\u306e\u3067\u3001\u4eca\u5f8c\u306f\u3053\u306e\u5909\u63db\u696d\u52d9\u3082\u5897\u3048\u3066\u304f\u308b\u3088\u3046\u306b\u8003\u3048\u3066\u3044\u308b\u3002 \u4eca\u56de\u306f Pandas \u3067 CSV \u30d5\u30a1\u30a4\u30eb\u3092\u8aad\u307f\u8fbc\u307f\u3001PyArrow \u3092\u4f7f\u3063\u3066 Parquet \u30d5\u30a1\u30a4\u30eb\u306b\u51fa\u529b\u3059\u308b\u3002 PyArrow \u304b\u3089 CSV \u30d5\u30a1\u30a4\u30eb\u3092\u8aad\u307f\u8fbc\u3093\u3067 Par\u2026","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fyoshitaku-jp.hatenablog.com%2Fentry%2F2022%2F01%2F23%2F180000\" title=\"PyArrow\u3067CSV\u3092Parquet\u306b\u5909\u63db\u3059\u308b - \u3088\u3057\u305f\u304f blog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","provider_url":"https://hatena.blog","blog_url":"https://yoshitaku-jp.hatenablog.com/"}