# Don't allow web crawlers to index Craft CMS User-agent: * Disallow: /coming-soon/ Disallow: /craft/ # Googlebot was crawling URLs on the location search with specific zip codes--this impacted our API quota Disallow: /*&address=* Disallow: /all-locations/nearby