Sitemap: http://catalog.hathitrust.org/static/sitemaps/sitemapindex.xml
User-agent: *
Disallow: /Search
Disallow: /static/api
Disallow: /Tags