# Define a sitemap in the robots.txt Sitemap: https://www.broadbandsearch.net/sitemap/index.xml # Prevent robots from bad pages User-agent: * Disallow: /availability/ Disallow: /health Disallow: /phone/ Disallow: /url/ Disallow: /proof/ Disallow: /admin/