{"provider_url":"https://hatena.blog","author_name":"ocadaruma","author_url":"https://blog.hatena.ne.jp/ocadaruma/","height":"190","categories":[],"published":"2021-01-31 14:30:05","type":"rich","provider_name":"Hatena Blog","blog_url":"https://ocadaruma.hatenablog.com/","image_url":null,"width":"100%","description":"Kafka 2.7.0\u73fe\u5728\u3001consumer\u306eauto.offset.reset config\u306flatest\u304c\u30c7\u30d5\u30a9\u30eb\u30c8\u3068\u306a\u3063\u3066\u3044\u307e\u3059\u3002 \u3053\u308c\u306f\u3001consumer group\u304c\u3042\u308bpartition\u3092subscribe\u3059\u308b\u3068\u304d\u3001commit\u6e08\u307foffset\u304c\u5b58\u5728\u3057\u306a\u3044\u5834\u5408\uff08consumer\u306e\u521d\u56de\u30c7\u30d7\u30ed\u30a4\u6642\u3084\u3001offsets.retention.minutes\u4ee5\u4e0a\u306e\u671f\u9593consumer\u3092\u8d77\u52d5\u3057\u3066\u3044\u306a\u304b\u3063\u305f\u5834\u5408\u306a\u3069\u304c\u8a72\u5f53\u3057\u307e\u3059\uff09\u3001consume\u958b\u59cb\u4f4d\u7f6e\u3092log end offset\u306b\u30bb\u30c3\u30c8\u3059\u308b\u3068\u3044\u3046\u3082\u306e\u3067\u3059\u3002 \u901a\u5e38\u306f1) consumer 2) producer\u306e\u624b\u9806\u3067\u30c7\u30d7\u30ed\u30a4\u3057\u307e\u3059\u306e\u3067\u3001\u3053\u308c\u3067\u554f\u2026","url":"https://ocadaruma.hatenablog.com/entry/2021/01/31/143005","version":"1.0","title":"A pitfall in Kafka partition splitting when auto.offset.reset = latest","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Focadaruma.hatenablog.com%2Fentry%2F2021%2F01%2F31%2F143005\" title=\"A pitfall in Kafka partition splitting when auto.offset.reset = latest - 1954\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","blog_title":"1954"}