{"blog_url":"https://www.sem-r.com/","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fwww.sem-r.com%2Fentry%2F20261102%2F1793573542\" title=\"robots.txt \u306e1\u884c\u3067AI\u5b66\u7fd2\u3092\u4e00\u62ec\u62d2\u5426\u3078 Google\u30fbOpenAI\u30fbMicrosoft \u304c\u5171\u901a\u30b7\u30b0\u30ca\u30eb\u5bfe\u5fdc\u3092\u8868\u660e\u3001\u4f55\u304c\u5909\u308f\u308a\u4f55\u304c\u5909\u308f\u3089\u306a\u3044\u304b - SEM\u30ea\u30b5\u30fc\u30c1\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","url":"https://www.sem-r.com/entry/20261102/1793573542","title":"robots.txt \u306e1\u884c\u3067AI\u5b66\u7fd2\u3092\u4e00\u62ec\u62d2\u5426\u3078 Google\u30fbOpenAI\u30fbMicrosoft \u304c\u5171\u901a\u30b7\u30b0\u30ca\u30eb\u5bfe\u5fdc\u3092\u8868\u660e\u3001\u4f55\u304c\u5909\u308f\u308a\u4f55\u304c\u5909\u308f\u3089\u306a\u3044\u304b","provider_url":"https://hatena.blog","categories":["\u30cb\u30e5\u30fc\u30b9"],"author_url":"https://blog.hatena.ne.jp/takahwata/","height":"190","version":"1.0","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/t/takahwata/20261102/20261102074955.png","author_name":"takahwata","type":"rich","description":"Google\u30fbOpenAI\u30fbMicrosoft\u3001robots.txt \u306e\u5171\u901a\u300cAI\u5b66\u7fd2\u62d2\u5426\u30b7\u30b0\u30ca\u30eb\u300d\u306b\u5bfe\u5fdc\u8868\u660e\u2500\u2500\u5b66\u7fd2\u62d2\u5426\u306f\u5171\u901a\u5316\u3001AI\u691c\u7d22\u3067\u306e\u9732\u51fa\u306f\u5f15\u304d\u7d9a\u304d\u5404\u793e\u30d0\u30e9\u30d0\u30e9 2026\u5e7410\u670830\u65e5\uff08\u7c73\u56fd\u6642\u9593\uff09\u3001Google\u3001OpenAI\u3001Microsoft \u306e3\u793e\u304c\u540c\u65e5\u306b\u3001robots.txt \u306b\u8a18\u8ff0\u3059\u308b\u5171\u901a\u306e\u300cAI\u5b66\u7fd2\u62d2\u5426\u30b7\u30b0\u30ca\u30eb\u300d\u306b\u5bfe\u5fdc\u3059\u308b\u65b9\u91dd\u3092\u767a\u8868\u3057\u307e\u3057\u305f\u3002\u540c\u65e5\u3001IETF*1\u306b\u305d\u306e\u4ed5\u69d8\u3092\u8a18\u3057\u305f\u8349\u6848\uff08Internet-Draft\uff09\u304c\u63d0\u51fa\u3055\u308c\u3066\u3044\u307e\u3059\u3002 \u3053\u308c\u307e\u3067\u30b5\u30a4\u30c8\u904b\u55b6\u8005\u306f\u3001AI\u4f01\u696d\u3054\u3068\u306b\u7570\u306a\u308b\u30af\u30ed\u30fc\u30e9\u30fc\u540d\u3092 robots.txt \u306b\u4e26\u3079\u3066\u5b66\u7fd2\u62d2\u5426\u3092\u8868\u660e\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3057\u305f\u3002\u4eca\u56de\u306e\u4ed5\u7d44\u307f\u304c\u5404\u2026","published":"2026-11-02 07:52:22","provider_name":"Hatena Blog","width":"100%","blog_title":"SEM\u30ea\u30b5\u30fc\u30c1"}