# This file was generated on Thu, 12 Feb 2015 17:33:39 +0000 # If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead. # Please see http://en.wordpress.com/firehose/ for more details. Sitemap: http://science.time.com/sitemap.xml Sitemap: http://science.time.com/news-sitemap.xml User-agent: IRLbot Crawl-delay: 3600 User-agent: * Disallow: /next/ User-agent: * Disallow: /mshots/v1/ # har har User-agent: * Disallow: /activate/ User-agent: * Disallow: /wp-login.php User-agent: * Disallow: /related-tags.php User-agent: * Disallow: /public.api/ # MT refugees User-agent: * Disallow: /cgi-bin/ User-agent: * Disallow: /wp-admin/