{"author_name":"highlink-hr1","author_url":"https://blog.hatena.ne.jp/highlink-hr1/","type":"rich","blog_title":"High Link \u30c6\u30c3\u30af\u30d6\u30ed\u30b0","blog_url":"https://tech.high-link.co.jp/","version":"1.0","description":"\u306f\u3058\u3081\u306b \u3053\u3093\u306b\u3061\u306f, \u57fa\u76e4\u958b\u767a\u30c1\u30fc\u30e0\u306e\u5965\u5c71(okue)\u3067\u3059. High Link \u3067\u306f, BigQuery \u3092\u6d3b\u7528\u3057\u3066\u30c7\u30fc\u30bf\u306e\u5206\u6790\u3084\u53ef\u8996\u5316, \u6a5f\u68b0\u5b66\u7fd2\u3078\u306e\u6d3b\u7528\u3092\u884c\u3063\u3066\u3044\u307e\u3059. \u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3 DB \u306e BigQuery \u3078\u8ee2\u9001\u306b\u306f, AWS ECS Fargate + Embulk \u3068\u3044\u3046\u69cb\u6210\u3067\u30d0\u30c3\u30c1\u51e6\u7406\u3092\u5b9f\u884c\u3057\u3066\u3044\u307e\u3057\u305f\u304c, \u3044\u304f\u3064\u304b\u904b\u7528\u4e0a\u306e\u554f\u984c\u70b9\u304c\u3042\u308a\u307e\u3057\u305f. \u672c\u8a18\u4e8b\u3067\u306f, BigQuery \u3078DB\u306e\u30c7\u30fc\u30bf\u3092\u8ee2\u9001\u3059\u308b\u30d0\u30c3\u30c1\u51e6\u7406\u3092, AWS Step Functions + AWS ECS Fargate + Embulk \u3067\u5b9f\u88c5\u3057\u6539\u5584\u3057\u305f\u8a71\u3092\u3057\u307e\u3059. \u6539\u5584\u524d\u306e\u69cb\u6210\u3068\u554f\u984c\u70b9 \u69cb\u6210 \u6539\u5584\u524d\u2026","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/h/highlink-hr1/20240703/20240703120253.png","title":" BigQuery\u3078Embulk\u3067\u8ee2\u9001\u3059\u308b\u30d0\u30c3\u30c1\u51e6\u7406\u3092\u6539\u5584\u3057\u305f\u8a71","width":"100%","published":"2022-09-29 18:16:43","categories":["\u57fa\u76e4\u958b\u767a"],"provider_url":"https://hatena.blog","provider_name":"Hatena Blog","url":"https://tech.high-link.co.jp/entry/bigquery-embulk-batch-improvement","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Ftech.high-link.co.jp%2Fentry%2Fbigquery-embulk-batch-improvement\" title=\" BigQuery\u3078Embulk\u3067\u8ee2\u9001\u3059\u308b\u30d0\u30c3\u30c1\u51e6\u7406\u3092\u6539\u5584\u3057\u305f\u8a71 - High Link \u30c6\u30c3\u30af\u30d6\u30ed\u30b0\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","height":"190"}