{"provider_url":"https://hatena.blog","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fengineering.meetsmore.com%2Fentry%2F2024%2F12%2F09%2F193208\" title=\"S3\u5185\u306eCloudFront\u306eCSV\u30ed\u30b0\u30c7\u30fc\u30bf\u3092BQ\u306b\u9023\u643a\u3057\u305f\u8a71 - \u30df\u30c4\u30e2\u30a2 Tech blog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","author_url":"https://blog.hatena.ne.jp/meetsmore/","width":"100%","height":"190","url":"https://engineering.meetsmore.com/entry/2024/12/09/193208","published":"2024-12-09 19:32:08","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/m/meetsmore/20241209/20241209165553.png","categories":[],"version":"1.0","author_name":"meetsmore","type":"rich","blog_title":"\u30df\u30c4\u30e2\u30a2 Tech blog","title":"S3\u5185\u306eCloudFront\u306eCSV\u30ed\u30b0\u30c7\u30fc\u30bf\u3092BQ\u306b\u9023\u643a\u3057\u305f\u8a71","blog_url":"https://engineering.meetsmore.com/","provider_name":"Hatena Blog","description":"\u203b\u3053\u3061\u3089\u306f\u30df\u30c4\u30e2\u30a2Advent Calendar 2024\u306e6\u65e5\u76ee\u306e\u8a18\u4e8b\u3067\u3059 \u30df\u30c4\u30e2\u30a2\u30c7\u30fc\u30bf\u30c1\u30fc\u30e0\u306e\u8d64\u85e4\u3068\u7533\u3057\u307e\u3059\u3002 \u4e3b\u306b\u30c7\u30fc\u30bf\u57fa\u76e4\u306e\u904b\u7528\u3001\u30c7\u30fc\u30bf\u52a0\u5de5\u3001\u53ef\u8996\u5316\u3092\u884c\u306a\u3063\u3066\u3044\u307e\u3059\u3002 \u4eca\u56de\u306fAWS\u306eS3\u5185\u306b\u4fdd\u5b58\u3057\u3066\u3044\u308bCloudFront\u306e\u30ed\u30b0\u30d5\u30a1\u30a4\u30eb\u3092BigQuery(BQ)\u306b\u9023\u643a\u3057\u305f\u8a71\u3092\u3057\u3088\u3046\u304b\u3068\u601d\u3044\u307e\u3059\u3002 \u63a1\u7528\u3057\u305f\u30c7\u30fc\u30bf\u9023\u643a\u6cd5 AWS\u306eS3\u30d5\u30a1\u30a4\u30eb\u3092BQ\u306b\u9023\u643a\u3059\u308b\u65b9\u6cd5\u306f\u69d8\u3005\u304b\u3068\u601d\u3044\u307e\u3059\u304c\u3001Google Cloud\u306eData Transfer Service(DTS)\u3092\u4f7f\u7528\u3057\u307e\u3057\u305f\u3002DTS\u306f\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u8a2d\u5b9a\u3082\u7c21\u5358\u306b\u884c\u3046\u3053\u3068\u304c\u3067\u304d\u3001UI\u4e0a\u3067\u3082\u8a2d\u5b9a\u304c\u3067\u304d\u308b\u306e\u3067\u7c21\u5358\u306bPipeline\u3092\u69cb\u7bc9\u3059\u308b\u3053\u3068\u304c\u3067\u2026"}