{"published":"2020-12-22 23:52:00","author_url":"https://blog.hatena.ne.jp/takuya-a/","title":"Information Retrieval and Web Search \u307e\u3068\u3081(22): Web\u30af\u30ed\u30fc\u30ea\u30f3\u30b0","blog_url":"https://stop-the-world.hatenablog.com/","blog_title":"stop-the-world","url":"https://stop-the-world.hatenablog.com/entry/cs276-information-retrieval-22","provider_url":"https://hatena.blog","provider_name":"Hatena Blog","categories":[],"html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fstop-the-world.hatenablog.com%2Fentry%2Fcs276-information-retrieval-22\" title=\"Information Retrieval and Web Search \u307e\u3068\u3081(22): Web\u30af\u30ed\u30fc\u30ea\u30f3\u30b0 - stop-the-world\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/t/takuya-a/20201223/20201223044312.png","width":"100%","version":"1.0","type":"rich","description":"\u524d\u56de\u306f PageRank \u306a\u3069\u306e\u30ea\u30f3\u30af\u89e3\u6790\u624b\u6cd5\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u305f\u3002\u4eca\u56de\u306f\u3001Web \u306e\u30af\u30ed\u30fc\u30ea\u30f3\u30b0\u3092\u6271\u3046\u3002 \u3053\u306e\u8a18\u4e8b\u306f Information Retrieval and Web Search Advent Calendar 2020 \u306e22\u65e5\u76ee\u306e\u8a18\u4e8b\u3067\u3059\u3002 adventar.org \u30af\u30ed\u30fc\u30ea\u30f3\u30b0\u306e\u6982\u8981 \u30af\u30ed\u30fc\u30e9\u306e\u52d5\u4f5c \u30af\u30ed\u30fc\u30ea\u30f3\u30b0\u306e\u96e3\u3057\u3055 \u30af\u30ed\u30fc\u30e9\u306e\u8981\u4ef6 \u30af\u30ed\u30fc\u30e9\u306e MUST \u8981\u4ef6 robots.txt robots.txt \u306e\u4f8b \u30af\u30ed\u30fc\u30e9\u306e SHOULD \u8981\u4ef6 \u30af\u30ed\u30fc\u30e9\u306e\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3 \u30af\u30ed\u30fc\u30e9\u306e\u51e6\u7406\u30b9\u30c6\u30c3\u30d7 \u30af\u30ed\u30fc\u30e9\u306e\u57fa\u672c\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3 \u5206\u6563\u578b\u30af\u30ed\u30fc\u30e9 URL frontier Mercat\u2026","height":"190","author_name":"takuya-a"}