# www.robotstxt.org/

User-agent: *
Disallow: /wp-admin/
Disallow: /fastspot-test-pages/course-listing/
Disallow: /fastspot-test-pages/flexible-content/
Disallow: /fastspot-test-pages/flexible-content-video/
Disallow: /fastspot-test-pages/flexible-content-image/
Disallow: /fastspot-test-pages/forms/
Disallow: /fastspot-test-pages/
Disallow: /fastspot-test-pages/full-width-components/

Sitemap: https://summer.jhu.edu/sitemap_index.xml
Crawl-delay: 10