Wikipediaのrobotsが説明的だ・・
Wikipediaのrobots.txtが気になったので覗いてみたら、めちゃくちゃ丁寧にコメントアウトで説明書きしてあった。
読み解くだけで勉強になりそうなので、時間がある日に全文読み解き記事を出そう。
一旦貼り付けます。JST2024年4月6日2時34分の情報。
- # robots.txt for http://www.wikipedia.org/ and friends
- #
- # Please note: There are a lot of pages on this site, and there are
- # some misbehaved spiders out there that go _way_ too fast. If you're
- # irresponsible, your access to the site may be blocked.
- #
- # Observed spamming large amounts of https://en.wikipedia.org/?curid=NNNNNN
- # and ignoring 429 ratelimit responses, claims to respect robots:
- # http://mj12bot.com/
- User-agent: MJ12bot
- Disallow: /
- # advertising-related bots:
- User-agent: Mediapartners-Google*
- Disallow: /
- # Wikipedia work bots:
- User-agent: IsraBot
- Disallow:
- User-agent: Orthogaffe
- Disallow:
- # Crawlers that are kind enough to obey, but which we'd rather not have
- # unless they're feeding search engines.
- User-agent: UbiCrawler
- Disallow: /
- User-agent: DOC
- Disallow: /
- User-agent: Zao
- Disallow: /
- # Some bots are known to be trouble, particularly those designed to copy
- # entire sites. Please obey robots.txt.
- User-agent: sitecheck.internetseer.com
- Disallow: /
- User-agent: Zealbot
- Disallow: /
- User-agent: MSIECrawler
- Disallow: /
- User-agent: SiteSnagger
- Disallow: /
- User-agent: WebStripper
- Disallow: /
- User-agent: WebCopier
- Disallow: /
- User-agent: Fetch
- Disallow: /
- User-agent: Offline Explorer
- Disallow: /
- User-agent: Teleport
- Disallow: /
- User-agent: TeleportPro
- Disallow: /
- User-agent: WebZIP
- Disallow: /
- User-agent: linko
- Disallow: /
- User-agent: HTTrack
- Disallow: /
- User-agent: Microsoft.URL.Control
- Disallow: /
- User-agent: Xenu
- Disallow: /
- User-agent: larbin
- Disallow: /
- User-agent: libwww
- Disallow: /
- User-agent: ZyBORG
- Disallow: /
- User-agent: Download Ninja
- Disallow: /
- # Misbehaving: requests much too fast:
- User-agent: fast
- Disallow: /
- #
- # Sorry, wget in its recursive mode is a frequent problem.
- # Please read the man page and use it properly; there is a
- # --wait option you can use to set the delay between hits,
- # for instance.
- #
- User-agent: wget
- Disallow: /
- #
- # The 'grub' distributed client has been *very* poorly behaved.
- #
- User-agent: grub-client
- Disallow: /
- #
- # Doesn't follow robots.txt anyway, but...
- #
- User-agent: k2spider
- Disallow: /
- #
- # Hits many times per second, not acceptable
- # http://www.nameprotect.com/botinfo.html
- User-agent: NPBot
- Disallow: /
- # A capture bot, downloads gazillions of pages with no public benefit
- # http://www.webreaper.net/
- User-agent: WebReaper
- Disallow: /
- #
- # Friendly, low-speed bots are welcome viewing article pages, but not
- # dynamically-generated pages please.
- #
- # Inktomi's "Slurp" can read a minimum delay between hits; if your
- # bot supports such a thing using the 'Crawl-delay' or another
- # instruction, please let us know.
- #
- # There is a special exception for API mobileview to allow dynamic
- # mobile web & app views to load section content.
- # These views aren't HTTP-cached but use parser cache aggressively
- # and don't expose special: pages etc.
- #
- # Another exception is for REST API documentation, located at
- # /api/rest_v1/?doc.
- #
- User-agent: *
- Allow: /w/api.php?action=mobileview&
- Allow: /w/load.php?
- Allow: /api/rest_v1/?doc
- Disallow: /w/
- Disallow: /api/
- Disallow: /trap/
- Disallow: /wiki/Special:
- Disallow: /wiki/Spezial:
- Disallow: /wiki/Spesial:
- Disallow: /wiki/Special%3A
- Disallow: /wiki/Spezial%3A
- Disallow: /wiki/Spesial%3A
- #
- # ar:
- Disallow: /wiki/%D8%AE%D8%A7%D8%B5:Search
- Disallow: /wiki/%D8%AE%D8%A7%D8%B5%3ASearch
- #
- # dewiki:
- # T6937
- # sensible deletion and meta user discussion pages:
- Disallow: /wiki/Wikipedia:L%C3%B6schkandidaten/
- Disallow: /wiki/Wikipedia:Löschkandidaten/
- Disallow: /wiki/Wikipedia:Vandalensperrung/
- Disallow: /wiki/Wikipedia:Benutzersperrung/
- Disallow: /wiki/Wikipedia:Vermittlungsausschuss/
- Disallow: /wiki/Wikipedia:Administratoren/Probleme/
- Disallow: /wiki/Wikipedia:Adminkandidaturen/
- Disallow: /wiki/Wikipedia:Qualitätssicherung/
- Disallow: /wiki/Wikipedia:Qualit%C3%A4tssicherung/
- # 4937#5
- Disallow: /wiki/Wikipedia:Vandalismusmeldung/
- Disallow: /wiki/Wikipedia:Gesperrte_Lemmata/
- Disallow: /wiki/Wikipedia:Löschprüfung/
- Disallow: /wiki/Wikipedia:L%C3%B6schprüfung/
- Disallow: /wiki/Wikipedia:Administratoren/Notizen/
- Disallow: /wiki/Wikipedia:Schiedsgericht/Anfragen/
- Disallow: /wiki/Wikipedia:L%C3%B6schpr%C3%BCfung/
- # T14111
- Disallow: /wiki/Wikipedia:Checkuser/
- Disallow: /wiki/Wikipedia_Diskussion:Checkuser/
- Disallow: /wiki/Wikipedia_Diskussion:Adminkandidaturen/
- # T15961
- Disallow: /wiki/Wikipedia:Spam-Blacklist-Log
- Disallow: /wiki/Wikipedia%3ASpam-Blacklist-Log
- Disallow: /wiki/Wikipedia_Diskussion:Spam-Blacklist-Log
- Disallow: /wiki/Wikipedia_Diskussion%3ASpam-Blacklist-Log
- #
- # enwiki:
- # Folks get annoyed when VfD discussions end up the number 1 google hit for
- # their name. See T6776
- Disallow: /wiki/Wikipedia:Articles_for_deletion/
- Disallow: /wiki/Wikipedia%3AArticles_for_deletion/
- Disallow: /wiki/Wikipedia:Votes_for_deletion/
- Disallow: /wiki/Wikipedia%3AVotes_for_deletion/
- Disallow: /wiki/Wikipedia:Pages_for_deletion/
- Disallow: /wiki/Wikipedia%3APages_for_deletion/
- Disallow: /wiki/Wikipedia:Miscellany_for_deletion/
- Disallow: /wiki/Wikipedia%3AMiscellany_for_deletion/
- Disallow: /wiki/Wikipedia:Miscellaneous_deletion/
- Disallow: /wiki/Wikipedia%3AMiscellaneous_deletion/
- Disallow: /wiki/Wikipedia:Copyright_problems
- Disallow: /wiki/Wikipedia%3ACopyright_problems
- Disallow: /wiki/Wikipedia:Protected_titles/
- Disallow: /wiki/Wikipedia%3AProtected_titles/
- # T15398
- Disallow: /wiki/Wikipedia:WikiProject_Spam/
- Disallow: /wiki/Wikipedia%3AWikiProject_Spam/
- # T16075
- Disallow: /wiki/MediaWiki:Spam-blacklist
- Disallow: /wiki/MediaWiki%3ASpam-blacklist
- Disallow: /wiki/MediaWiki_talk:Spam-blacklist
- Disallow: /wiki/MediaWiki_talk%3ASpam-blacklist
- # T13261
- Disallow: /wiki/Wikipedia:Requests_for_arbitration/
- Disallow: /wiki/Wikipedia%3ARequests_for_arbitration/
- Disallow: /wiki/Wikipedia:Requests_for_comment/
- Disallow: /wiki/Wikipedia%3ARequests_for_comment/
- Disallow: /wiki/Wikipedia:Requests_for_adminship/
- Disallow: /wiki/Wikipedia%3ARequests_for_adminship/
- # T12288
- Disallow: /wiki/Wikipedia_talk:Articles_for_deletion/
- Disallow: /wiki/Wikipedia_talk%3AArticles_for_deletion/
- Disallow: /wiki/Wikipedia_talk:Votes_for_deletion/
- Disallow: /wiki/Wikipedia_talk%3AVotes_for_deletion/
- Disallow: /wiki/Wikipedia_talk:Pages_for_deletion/
- Disallow: /wiki/Wikipedia_talk%3APages_for_deletion/
- Disallow: /wiki/Wikipedia_talk:Miscellany_for_deletion/
- Disallow: /wiki/Wikipedia_talk%3AMiscellany_for_deletion/
- Disallow: /wiki/Wikipedia_talk:Miscellaneous_deletion/
- Disallow: /wiki/Wikipedia_talk%3AMiscellaneous_deletion/
- # T16793
- Disallow: /wiki/Wikipedia:Changing_username
- Disallow: /wiki/Wikipedia%3AChanging_username
- Disallow: /wiki/Wikipedia:Changing_username/
- Disallow: /wiki/Wikipedia%3AChanging_username/
- Disallow: /wiki/Wikipedia_talk:Changing_username
- Disallow: /wiki/Wikipedia_talk%3AChanging_username
- Disallow: /wiki/Wikipedia_talk:Changing_username/
- Disallow: /wiki/Wikipedia_talk%3AChanging_username/
- #
- # eswiki:
- # T8746
- Disallow: /wiki/Wikipedia:Consultas_de_borrado/
- Disallow: /wiki/Wikipedia%3AConsultas_de_borrado/
- #
- # fiwiki:
- # T10695
- Disallow: /wiki/Wikipedia:Poistettavat_sivut
- Disallow: /wiki/K%C3%A4ytt%C3%A4j%C3%A4:
- Disallow: /wiki/Käyttäjä:
- Disallow: /wiki/Keskustelu_k%C3%A4ytt%C3%A4j%C3%A4st%C3%A4:
- Disallow: /wiki/Keskustelu_käyttäjästä:
- Disallow: /wiki/Wikipedia:Yll%C3%A4pit%C3%A4j%C3%A4t/
- Disallow: /wiki/Wikipedia:Ylläpitäjät/
- #
- # hewiki:
- Disallow: /wiki/%D7%9E%D7%99%D7%95%D7%97%D7%93:Search
- Disallow: /wiki/%D7%9E%D7%99%D7%95%D7%97%D7%93%3ASearch
- #T11517
- Disallow: /wiki/????????:?????_???????_??????/
- Disallow: /wiki/????????%3A?????_???????_??????/
- Disallow: /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94:%D7%A8%D7%A9%D7%99%D7%9E%D7%AA_%D7%9E%D7%95%D7%A2%D7%9E%D7%93%D7%99%D7%9D_%D7%9C%D7%9E%D7%97%D7%99%D7%A7%D7%94/
- Disallow: /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%A8%D7%A9%D7%99%D7%9E%D7%AA_%D7%9E%D7%95%D7%A2%D7%9E%D7%93%D7%99%D7%9D_%D7%9C%D7%9E%D7%97%D7%99%D7%A7%D7%94/
- Disallow: /wiki/????????:?????_??_??????_???????
- Disallow: /wiki/????????%3A?????_??_??????_???????
- Disallow: /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94:%D7%A2%D7%A8%D7%9B%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D
- Disallow: /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%A2%D7%A8%D7%9B%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D
- Disallow: /wiki/????????:????_??_??????_???????
- Disallow: /wiki/????????%3A????_??_??????_???????
- Disallow: /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94:%D7%93%D7%A4%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D
- Disallow: /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%93%D7%A4%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D
- #
- # huwiki:
- Disallow: /wiki/Speci%C3%A1lis:Search
- Disallow: /wiki/Speci%C3%A1lis%3ASearch
- #
- # itwiki:
- # T7545
- Disallow: /wiki/Wikipedia:Pagine_da_cancellare
- Disallow: /wiki/Wikipedia%3APagine_da_cancellare
- Disallow: /wiki/Wikipedia:Utenti_problematici
- Disallow: /wiki/Wikipedia%3AUtenti_problematici
- Disallow: /wiki/Wikipedia:Vandalismi_in_corso
- Disallow: /wiki/Wikipedia%3AVandalismi_in_corso
- Disallow: /wiki/Wikipedia:Amministratori
- Disallow: /wiki/Wikipedia%3AAmministratori
- Disallow: /wiki/Wikipedia:Proposte_di_cancellazione_semplificata
- Disallow: /wiki/Wikipedia%3AProposte_di_cancellazione_semplificata
- Disallow: /wiki/Categoria:Da_cancellare_subito
- Disallow: /wiki/Categoria%3ADa_cancellare_subito
- Disallow: /wiki/Wikipedia:Sospette_violazioni_di_copyright
- Disallow: /wiki/Wikipedia%3ASospette_violazioni_di_copyright
- Disallow: /wiki/Categoria:Da_controllare_per_copyright
- Disallow: /wiki/Categoria%3ADa_controllare_per_copyright
- Disallow: /wiki/Progetto:Rimozione_contributi_sospetti
- Disallow: /wiki/Progetto%3ARimozione_contributi_sospetti
- Disallow: /wiki/Categoria:Da_cancellare_subito_per_violazione_integrale_copyright
- Disallow: /wiki/Categoria%3ADa_cancellare_subito_per_violazione_integrale_copyright
- Disallow: /wiki/Progetto:Cococo
- Disallow: /wiki/Progetto%3ACococo
- Disallow: /wiki/Discussioni_progetto:Cococo
- Disallow: /wiki/Discussioni_progetto%3ACococo
- #
- # jawiki
- Disallow: /wiki/%E7%89%B9%E5%88%A5:Search
- Disallow: /wiki/%E7%89%B9%E5%88%A5%3ASearch
- # T7239
- Disallow: /wiki/Wikipedia:%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC/
- Disallow: /wiki/Wikipedia%3A%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC/
- Disallow: /wiki/Wikipedia:%E5%88%A9%E7%94%A8%E8%80%85%E3%83%9A%E3%83%BC%E3%82%B8%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%3A%E5%88%A9%E7%94%A8%E8%80%85%E3%83%9A%E3%83%BC%E3%82%B8%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- # nowiki
- # T13432
- Disallow: /wiki/Bruker:
- Disallow: /wiki/Bruker%3A
- Disallow: /wiki/Brukerdiskusjon
- Disallow: /wiki/Wikipedia:Administratorer
- Disallow: /wiki/Wikipedia%3AAdministratorer
- Disallow: /wiki/Wikipedia-diskusjon:Administratorer
- Disallow: /wiki/Wikipedia-diskusjon%3AAdministratorer
- Disallow: /wiki/Wikipedia:Sletting
- Disallow: /wiki/Wikipedia%3ASletting
- Disallow: /wiki/Wikipedia-diskusjon:Sletting
- Disallow: /wiki/Wikipedia-diskusjon%3ASletting
- #
- # plwiki
- # T10067
- Disallow: /wiki/Wikipedia:Strony_do_usuni%C4%99cia
- Disallow: /wiki/Wikipedia%3AStrony_do_usuni%C4%99cia
- Disallow: /wiki/Wikipedia:Do_usuni%C4%99cia
- Disallow: /wiki/Wikipedia%3ADo_usuni%C4%99cia
- Disallow: /wiki/Wikipedia:SDU/
- Disallow: /wiki/Wikipedia%3ASDU/
- Disallow: /wiki/Wikipedia:Strony_podejrzane_o_naruszenie_praw_autorskich
- Disallow: /wiki/Wikipedia%3AStrony_podejrzane_o_naruszenie_praw_autorskich
- #
- # ptwiki:
- # T7394
- Disallow: /wiki/Wikipedia:Páginas_para_eliminar/
- Disallow: /wiki/Wikipedia:P%C3%A1ginas_para_eliminar/
- Disallow: /wiki/Wikipedia%3AP%C3%A1ginas_para_eliminar/
- Disallow: /wiki/Wikipedia_Discussão:Páginas_para_eliminar/
- Disallow: /wiki/Wikipedia_Discuss%C3%A3o:P%C3%A1ginas_para_eliminar/
- Disallow: /wiki/Wikipedia_Discuss%C3%A3o%3AP%C3%A1ginas_para_eliminar/
- #
- # rowiki:
- # T14546
- Disallow: /wiki/Wikipedia:Pagini_de_%C5%9Fters
- Disallow: /wiki/Wikipedia%3APagini_de_%C5%9Fters
- Disallow: /wiki/Discu%C5%A3ie_Wikipedia:Pagini_de_%C5%9Fters
- Disallow: /wiki/Discu%C5%A3ie_Wikipedia%3APagini_de_%C5%9Fters
- #
- # ruwiki:
- Disallow: /wiki/%D0%A1%D0%BF%D0%B5%D1%86%D0%B8%D0%B0%D0%BB%D1%8C%D0%BD%D1%8B%D0%B5:Search
- Disallow: /wiki/%D0%A1%D0%BF%D0%B5%D1%86%D0%B8%D0%B0%D0%BB%D1%8C%D0%BD%D1%8B%D0%B5%3ASearch
- #
- # svwiki:
- # T12229
- Disallow: /wiki/Wikipedia%3ASidor_f%C3%B6reslagna_f%C3%B6r_radering
- Disallow: /wiki/Wikipedia:Sidor_f%C3%B6reslagna_f%C3%B6r_radering
- Disallow: /wiki/Wikipedia:Sidor_föreslagna_för_radering
- Disallow: /wiki/Användare
- Disallow: /wiki/Anv%C3%A4ndare
- Disallow: /wiki/Användardiskussion
- Disallow: /wiki/Anv%C3%A4ndardiskussion
- Disallow: /wiki/Wikipedia:Skyddade_sidnamn
- Disallow: /wiki/Wikipedia%3ASkyddade_sidnamn
- # T13291
- Disallow: /wiki/Wikipedia:Sidor_som_bör_raderas
- Disallow: /wiki/Wikipedia:Sidor_som_b%C3%B6r_raderas
- Disallow: /wiki/Wikipedia%3ASidor_som_b%C3%B6r_raderas
- #
- # zhwiki:
- # T7104
- Disallow: /wiki/Wikipedia:?除投票/侵?
- Disallow: /wiki/Wikipedia:%E5%88%A0%E9%99%A4%E6%8A%95%E7%A5%A8/%E4%BE%B5%E6%9D%83
- Disallow: /wiki/Wikipedia:?除投票和?求
- Disallow: /wiki/Wikipedia:%E5%88%A0%E9%99%A4%E6%8A%95%E7%A5%A8%E5%92%8C%E8%AF%B7%E6%B1%82
- Disallow: /wiki/Category:快速?除候?
- Disallow: /wiki/Category:%E5%BF%AB%E9%80%9F%E5%88%A0%E9%99%A4%E5%80%99%E9%80%89
- Disallow: /wiki/Category:?基百科需要翻?的文章
- Disallow: /wiki/Category:%E7%BB%B4%E5%9F%BA%E7%99%BE%E7%A7%91%E9%9C%80%E8%A6%81%E7%BF%BB%E8%AF%91%E7%9A%84%E6%96%87%E7%AB%A0
- #
- # sister projects
- #
- # enwikinews:
- # T7340
- Disallow: /wiki/Portal:Prepared_stories/
- Disallow: /wiki/Portal%3APrepared_stories/
- #
- # itwikinews
- # T11138
- Disallow: /wiki/Wikinotizie:Richieste_di_cancellazione
- Disallow: /wiki/Wikinotizie:Sospette_violazioni_di_copyright
- Disallow: /wiki/Categoria:Da_cancellare_subito
- Disallow: /wiki/Categoria:Da_cancellare_subito_per_violazione_integrale_copyright
- Disallow: /wiki/Wikinotizie:Storie_in_preparazione
- #
- # enwikiquote:
- # T17095
- Disallow: /wiki/Wikiquote:Votes_for_deletion/
- Disallow: /wiki/Wikiquote%3AVotes_for_deletion/
- Disallow: /wiki/Wikiquote_talk:Votes_for_deletion/
- Disallow: /wiki/Wikiquote_talk%3AVotes_for_deletion/
- Disallow: /wiki/Wikiquote:Votes_for_deletion_archive/
- Disallow: /wiki/Wikiquote%3AVotes_for_deletion_archive/
- Disallow: /wiki/Wikiquote_talk:Votes_for_deletion_archive/
- Disallow: /wiki/Wikiquote_talk%3AVotes_for_deletion_archive/
- #
- # enwikibooks
- Disallow: /wiki/Wikibooks:Votes_for_deletion
- #
- # working...
- Disallow: /wiki/Fundraising_2007/comments
- #
- #
- #
- #----------------------------------------------------------#
- #
- #
- #
- # ここに書かれた内容はグローバルRobots.txtに追加されます。設定はローカルでのみ有効です。<!--この行頭のスペースは除去しないでください。--><pre>
- #
- # ブラックリスト関係
- Disallow: /wiki/MediaWiki:Spam-blacklist
- Disallow: /wiki/MediaWiki%3ASpam-blacklist
- Disallow: /wiki/MediaWiki%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88:Spam-blacklist
- Disallow: /wiki/MediaWiki%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88%3ASpam-blacklist
- Disallow: /wiki/MediaWiki:Titleblacklist
- Disallow: /wiki/MediaWiki%3ATitleblacklist
- Disallow: /wiki/MediaWiki%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88:Titleblacklist
- Disallow: /wiki/MediaWiki%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88%3ATitleblacklist
- #
- # 削除依頼関係
- Disallow: /wiki/Wikipedia:削除依頼
- Disallow: /wiki/Wikipedia:%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%3A%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia‐ノート:削除依頼
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88:%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88%3A%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia:利用者ページの削除依頼
- Disallow: /wiki/Wikipedia:%E5%88%A9%E7%94%A8%E8%80%85%E3%83%9A%E3%83%BC%E3%82%B8%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%3A%E5%88%A9%E7%94%A8%E8%80%85%E3%83%9A%E3%83%BC%E3%82%B8%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia‐ノート:利用者ページの削除依頼
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88:%E5%88%A9%E7%94%A8%E8%80%85%E3%83%9A%E3%83%BC%E3%82%B8%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88%3A%E5%88%A9%E7%94%A8%E8%80%85%E3%83%9A%E3%83%BC%E3%82%B8%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia:リダイレクトの削除依頼
- Disallow: /wiki/Wikipedia:%E3%83%AA%E3%83%80%E3%82%A4%E3%83%AC%E3%82%AF%E3%83%88%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%3A%E3%83%AA%E3%83%80%E3%82%A4%E3%83%AC%E3%82%AF%E3%83%88%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia‐ノート:リダイレクトの削除依頼
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88:%E3%83%AA%E3%83%80%E3%82%A4%E3%83%AC%E3%82%AF%E3%83%88%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88%3A%E3%83%AA%E3%83%80%E3%82%A4%E3%83%AC%E3%82%AF%E3%83%88%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia:削除の過去ログ
- Disallow: /wiki/Wikipedia:%E5%89%8A%E9%99%A4%E3%81%AE%E9%81%8E%E5%8E%BB%E3%83%AD%E3%82%B0
- Disallow: /wiki/Wikipedia%3A%E5%89%8A%E9%99%A4%E3%81%AE%E9%81%8E%E5%8E%BB%E3%83%AD%E3%82%B0
- Disallow: /wiki/Wikipedia:削除記録
- Disallow: /wiki/Wikipedia:%E5%89%8A%E9%99%A4%E8%A8%98%E9%8C%B2
- Disallow: /wiki/Wikipedia%3A%E5%89%8A%E9%99%A4%E8%A8%98%E9%8C%B2
- Disallow: /wiki/Category:削除依頼中のページ
- Disallow: /wiki/Category%3A%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC%E4%B8%AD%E3%81%AE%E3%83%9A%E3%83%BC%E3%82%B8
- Disallow: /wiki/Category:%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC%E4%B8%AD%E3%81%AE%E3%83%9A%E3%83%BC%E3%82%B8
- Disallow: /wiki/Category:緊急案件
- Disallow: /wiki/Category:%E7%B7%8A%E6%80%A5%E6%A1%88%E4%BB%B6
- Disallow: /wiki/Category%3A%E7%B7%8A%E6%80%A5%E6%A1%88%E4%BB%B6
- Disallow: /wiki/Wikipedia:削除の復帰依頼
- Disallow: /wiki/Wikipedia:%E5%89%8A%E9%99%A4%E3%81%AE%E5%BE%A9%E5%B8%B0%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%3A%E5%89%8A%E9%99%A4%E3%81%AE%E5%BE%A9%E5%B8%B0%E4%BE%9D%E9%A0%BC
- #
- # Wikipedia名前空間へのショートカット
- Disallow: /wiki/WP:
- Disallow: /wiki/WP%3A
- Disallow: /wiki/ノート:WP
- Disallow: /wiki/%E3%83%8E%E3%83%BC%E3%83%88:WP:
- Disallow: /wiki/%E3%83%8E%E3%83%BC%E3%83%88%3AWP%3A
- Disallow: /wiki/LTA:
- Disallow: /wiki/LTA%3A
- #
- # 不適切な利用者名を記載する可能性があるページ
- Disallow: /wiki/Wikipedia:投稿ブロック依頼
- Disallow: /wiki/Wikipedia:%E6%8A%95%E7%A8%BF%E3%83%96%E3%83%AD%E3%83%83%E3%82%AF%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%3A%E6%8A%95%E7%A8%BF%E3%83%96%E3%83%AD%E3%83%83%E3%82%AF%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia‐ノート:投稿ブロック依頼
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88:%E6%8A%95%E7%A8%BF%E3%83%96%E3%83%AD%E3%83%83%E3%82%AF%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88%3A%E6%8A%95%E7%A8%BF%E3%83%96%E3%83%AD%E3%83%83%E3%82%AF%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia:管理者伝言板
- Disallow: /wiki/Wikipedia:%E7%AE%A1%E7%90%86%E8%80%85%E4%BC%9D%E8%A8%80%E6%9D%BF
- Disallow: /wiki/Wikipedia%3A%E7%AE%A1%E7%90%86%E8%80%85%E4%BC%9D%E8%A8%80%E6%9D%BF
- Disallow: /wiki/Wikipedia‐ノート:管理者伝言板
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88:%E7%AE%A1%E7%90%86%E8%80%85%E4%BC%9D%E8%A8%80%E6%9D%BF
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88%3A%E7%AE%A1%E7%90%86%E8%80%85%E4%BC%9D%E8%A8%80%E6%9D%BF
- Disallow: /wiki/Wikipedia:進行中の荒らし行為
- Disallow: /wiki/Wikipedia:%E9%80%B2%E8%A1%8C%E4%B8%AD%E3%81%AE%E8%8D%92%E3%82%89%E3%81%97%E8%A1%8C%E7%82%BA
- Disallow: /wiki/Wikipedia%3A%E9%80%B2%E8%A1%8C%E4%B8%AD%E3%81%AE%E8%8D%92%E3%82%89%E3%81%97%E8%A1%8C%E7%82%BA
- Disallow: /wiki/Wikipedia‐ノート:進行中の荒らし行為
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88:%E9%80%B2%E8%A1%8C%E4%B8%AD%E3%81%AE%E8%8D%92%E3%82%89%E3%81%97%E8%A1%8C%E7%82%BA
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88%3A%E9%80%B2%E8%A1%8C%E4%B8%AD%E3%81%AE%E8%8D%92%E3%82%89%E3%81%97%E8%A1%8C%E7%82%BA
- Disallow: /wiki/Wikipedia:利用者名変更依頼
- Disallow: /wiki/Wikipedia:%E5%88%A9%E7%94%A8%E8%80%85%E5%90%8D%E5%A4%89%E6%9B%B4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%3A%E5%88%A9%E7%94%A8%E8%80%85%E5%90%8D%E5%A4%89%E6%9B%B4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia‐ノート:利用者名変更依頼
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88:%E5%88%A9%E7%94%A8%E8%80%85%E5%90%8D%E5%A4%89%E6%9B%B4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88%3A%E5%88%A9%E7%94%A8%E8%80%85%E5%90%8D%E5%A4%89%E6%9B%B4%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia:CheckUser依頼
- Disallow: /wiki/Wikipedia:CheckUser%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%3ACheckUser%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia‐ノート:CheckUser依頼
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88:CheckUser%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88%3ACheckUser%E4%BE%9D%E9%A0%BC
- Disallow: /wiki/Wikipedia:チェックユーザー依頼
- Disallow: /wiki/Wikipedia:%E3%83%81%E3%82%A7%E3%83%83%E3%82%AF%E3%83%A6%E3%83%BC%E3%82%B6%E3%83%BC
- Disallow: /wiki/Wikipedia%3A%E3%83%81%E3%82%A7%E3%83%83%E3%82%AF%E3%83%A6%E3%83%BC%E3%82%B6%E3%83%BC
- Disallow: /wiki/Wikipedia‐ノート:チェックユーザー依頼
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88:%E3%83%81%E3%82%A7%E3%83%83%E3%82%AF%E3%83%A6%E3%83%BC%E3%82%B6%E3%83%BC
- Disallow: /wiki/Wikipedia%E2%80%90%E3%83%8E%E3%83%BC%E3%83%88%3A%E3%83%81%E3%82%A7%E3%83%83%E3%82%AF%E3%83%A6%E3%83%BC%E3%82%B6%E3%83%BC
- #
- # 利用者ページ・会話ページ
- Disallow: /wiki/利用者:
- Disallow: /wiki/%E5%88%A9%E7%94%A8%E8%80%85:
- Disallow: /wiki/%E5%88%A9%E7%94%A8%E8%80%85%3A
- Disallow: /wiki/利用者‐会話:
- Disallow: /wiki/%E5%88%A9%E7%94%A8%E8%80%85%E2%80%90%E4%BC%9A%E8%A9%B1:
- Disallow: /wiki/%E5%88%A9%E7%94%A8%E8%80%85%E2%80%90%E4%BC%9A%E8%A9%B1%3A
- #
- # </pre>
「きらいじゃないけどブロックするよ」的なこととか、「このrobotsに従ってね」とか、クローラー(並びにその開発者)に語りかけていて面白い。それに、なぜそのクローラーをブロックしているのか明示しているので、robotsの勉強としてはちょうど良さそう。