# Information for robots how to crawl the web User-agent: * Crawl-delay: 5 # Disallow list Disallow: /xml