{"published":"2018-09-24 18:21:52","width":"100%","description":"emr-5.17.0 \u3067 /etc/hadoop/conf/core-site.xml \u3092\u78ba\u8a8d\u3059\u308b\u3068\u4ee5\u4e0b\u306e\u901a\u308a*1\u3002 <property> <name>io.file.buffer.size</name> <value>65536</value> </property> Note that HDFS Readers do not read whole blocks of data at a time, and instead stream the data via a buffered read (64k-128k typically). That the block size is X MB\u2026","version":"1.0","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/y/yohei-a/20180924/20180924183353.png","author_name":"yohei-a","url":"https://yohei-a.hatenablog.jp/entry/20180924/1537780912","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fyohei-a.hatenablog.jp%2Fentry%2F20180924%2F1537780912\" title=\"HDFS \u306e I/O \u30b5\u30a4\u30ba - ablog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","categories":["Hadoop"],"author_url":"https://blog.hatena.ne.jp/yohei-a/","provider_name":"Hatena Blog","provider_url":"https://hatena.blog","blog_title":"ablog","type":"rich","height":"190","title":"HDFS \u306e I/O \u30b5\u30a4\u30ba","blog_url":"https://yohei-a.hatenablog.jp/"}