MediaWiki:Robots.txt


 * 1) Added additional sitemaps

Sitemap: https://grayravens.com/sitemap.xml

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_0-0.xml.gz

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_2-0.xml.gz

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_4-0.xml.gz

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_6-0.xml.gz

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_8-0.xml.gz

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_10-0.xml.gz

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_14-0.xml.gz

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_200-0.xml.gz

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_400-0.xml.gz

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_1198-0.xml.gz

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_3000-0.xml.gz

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_3002-0.xml.gz

Sitemap: https://grayravens.com/sitemaps/pgrwiki/sitemaps/sitemap-pgrwiki-NS_3004-0.xml.gz

User-agent: * Allow: /w/load.php? Disallow: /w/
 * 1) Prevent crawling of non-article pages.