{"url":"https://kurita1.hatenadiary.com/entry/2024/03/06/144138","blog_url":"https://kurita1.hatenadiary.com/","author_name":"kurita1","author_url":"https://blog.hatena.ne.jp/kurita1/","published":"2024-03-06 14:41:38","image_url":null,"provider_url":"https://hatena.blog","version":"1.0","description":"\u5404bot\u306e\u8aac\u660e\u30b5\u30a4\u30c8\u3068\u5b9f\u969b\u306e\u30b5\u30fc\u30d3\u30b9\u30b5\u30a4\u30c8\u3092\u5f35\u3063\u3066\u304a\u304d\u307e\u3059 Semrush \u306f\u7121\u6599\u3067\u306f\u4f7f\u3048\u306a\u3044\u306e\u3067 Disallow: / \u3067\u3088\u3044\u3068\u601d\u3044\u307e\u3059 Ahrefs \u306f\u7121\u6599\u3067\u591a\u5c11\u4f7f\u3048\u307e\u3059\u304c\u3001\u8a73\u3057\u304f\u898b\u3088\u3046\u3068\u601d\u3046\u3068\u6709\u6599 majestic MJ12bot \u306f\u7121\u6599\u3067\u3055\u308f\u308a\u3092\u898b\u308b\u3053\u3068\u304c\u3067\u304d\u3001\u8a73\u3057\u304f\u898b\u3088\u3046\u3068\u601d\u3046\u3068\u6709\u6599 webmup BLEXbot \u306f\u7121\u6599\u3067\u3055\u308f\u308a\u3092\u898b\u308b\u3053\u3068\u304c\u3067\u304d\u3001\u8a73\u3057\u304f\u898b\u3088\u3046\u3068\u601d\u3046\u3068\u6709\u6599\u30fbSemrushBot https://ja.semrush.com/bot/ https://ja.semrush.com/ \u30fbAhrefsBot https://ahrefs.com/ja/robot https\u2026","height":"190","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fkurita1.hatenadiary.com%2Fentry%2F2024%2F03%2F06%2F144138\" title=\"bot deny nginx - external storage 1\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","categories":[],"provider_name":"Hatena Blog","blog_title":"external storage 1","type":"rich","title":"bot deny nginx","width":"100%"}