{"url":"https://ktr89-en.hatenadiary.jp/entry/2019/09/01/202204","version":"1.0","title":"AWS Glue's GetPartition API is slow for table with much Partitions.","author_url":"https://blog.hatena.ne.jp/ktr89/","blog_url":"https://ktr89-en.hatenadiary.jp/","categories":["AWS","Hadoop","Hive","Spark","Presto"],"blog_title":"Data is Nutritious","provider_name":"Hatena Blog","width":"100%","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/k/ktr89/20190901/20190901151711.png","author_name":"ktr89","height":"190","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fktr89-en.hatenadiary.jp%2Fentry%2F2019%2F09%2F01%2F202204\" title=\"AWS Glue&#39;s GetPartition API is slow for table with much Partitions. - Data is Nutritious\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","description":"Introduction AWS Glue is very useful Hive Metastore service for people using Hive on EMR / Spark on EMR / Presto on Athena. I felt that fetching partitions is very slow, especially tables with much partitions. Technically users need to call API many times because the api does not response all partit\u2026","provider_url":"https://hatena.blog","type":"rich","published":"2019-09-01 20:22:04"}