{"provider_name":"Hatena Blog","blog_url":"https://yomon.hatenablog.com/","blog_title":"YOMON8.NET","image_url":null,"title":"Pandas\u306e\u30c7\u30fc\u30bf\u3092pyarrow\u3067Parquet\u5909\u63db\u3057\u3066GCS(Google Cloud Storage)\u306b\u30a2\u30c3\u30d7\u30ed\u30fc\u30c9","categories":["Python","Pandas","GoogleCloud"],"height":"190","author_url":"https://blog.hatena.ne.jp/yomon8/","description":"\u30bf\u30a4\u30c8\u30eb\u306e\u901a\u308a\u3067\u3059\u3002Pandas\u306eDataframe\u3092pyarrow\u3067Parquet\u306b\u5909\u63db\u3057\u3066\u3001\u305d\u306e\u307e\u307eGCS\u306b\u30a2\u30c3\u30d7\u30ed\u30fc\u30c9\u3057\u3066\u3044\u307e\u3059\u3002 \u30b9\u30af\u30ea\u30d7\u30c8 \u3053\u3093\u306a\u5f62\u3067\u5b9f\u884c\u53ef\u80fd\u3067\u3059\u3002\u30d5\u30a1\u30a4\u30eb\u3092\u7d4c\u7531\u3057\u306a\u3044\u3067Buffer\u304b\u3089\u3001\u305d\u306e\u307e\u307e\u30a2\u30c3\u30d7\u30ed\u30fc\u30c9\u3057\u3066\u3044\u307e\u3059\u3002 import pandas as pd import pyarrow as pa import pyarrow.parquet as pq import numpy as np import datetime from google.cloud import storage as gcs # \u30c0\u30df\u30fc\u30c7\u30fc\u30bf\u3067Dataframe\u4f5c\u6210 row_num = \u2026","provider_url":"https://hatena.blog","url":"https://yomon.hatenablog.com/entry/2019/12/pandas_to_gcs_as_parquet","type":"rich","published":"2019-12-10 20:11:26","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fyomon.hatenablog.com%2Fentry%2F2019%2F12%2Fpandas_to_gcs_as_parquet\" title=\"Pandas\u306e\u30c7\u30fc\u30bf\u3092pyarrow\u3067Parquet\u5909\u63db\u3057\u3066GCS(Google Cloud Storage)\u306b\u30a2\u30c3\u30d7\u30ed\u30fc\u30c9 - YOMON8.NET\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","width":"100%","version":"1.0","author_name":"yomon8"}