{"blog_title":"APC \u6280\u8853\u30d6\u30ed\u30b0","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/a/apc_watanabe/20240607/20240607094954.png","author_url":"https://blog.hatena.ne.jp/ap_sato/","blog_url":"https://techblog.ap-com.co.jp/","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Ftechblog.ap-com.co.jp%2Fentry%2F2024%2F06%2F13%2F180015\" title=\"Migrating and Optimizing Large-Scale Streaming Applications with Databricks\uff08Databricks\u306b\u3088\u308b\u5927\u898f\u6a21\u30b9\u30c8\u30ea\u30fc\u30df\u30f3\u30b0\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u306e\u79fb\u884c\u3068\u6700\u9069\u5316\uff09 - APC \u6280\u8853\u30d6\u30ed\u30b0\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","author_name":"ap_sato","type":"rich","url":"https://techblog.ap-com.co.jp/entry/2024/06/13/180015","published":"2024-06-13 18:00:15","provider_name":"Hatena Blog","title":"Migrating and Optimizing Large-Scale Streaming Applications with Databricks\uff08Databricks\u306b\u3088\u308b\u5927\u898f\u6a21\u30b9\u30c8\u30ea\u30fc\u30df\u30f3\u30b0\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u306e\u79fb\u884c\u3068\u6700\u9069\u5316\uff09","description":"Freewheel\u3068BizWax\u306e\u7d39\u4ecb Beeswax\u30c7\u30fc\u30bf\u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3 Databricks\u3078\u306e\u79fb\u884c\u306b\u95a2\u3059\u308b\u8a73\u7d30\u306a\u8aac\u660e \u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u6700\u9069\u5316\u30c6\u30af\u30cb\u30c3\u30af 1. Spark Streaming\u3068Kinesis Stream 2. DataStreamWriter\u306e\u8a2d\u5b9a 3. ForEachBatch\u30e1\u30bd\u30c3\u30c9\u306e\u5229\u7528 DataFrame API Databricks Terraform\u30d7\u30ed\u30d0\u30a4\u30c0 Databricks Asset Bundles Databricks IQ\u30d1\u30ef\u30fc\u30c9\u6a5f\u80fd Freewheel\u3068BizWax\u306e\u7d39\u4ecb \u304a\u306f\u3088\u3046\u3054\u3056\u3044\u307e\u3059\u3002\u3053\u306e\u4f1a\u8b70\u306e\u6700\u521d\u306e\u30bb\u30c3\u30b7\u30e7\u30f3\u306e\u4e00\u3064\u306b\u3054\u53c2\u2026","height":"190","provider_url":"https://hatena.blog","version":"1.0","categories":["Databricks","DAIS2024"],"width":"100%"}