GeoScoreBot
GeoScoreBot is a user-requested technical crawler. It fetches a public page so GeoScore can estimate how ready that page is for search and answer-engine discovery. It does not crawl the web autonomously.
Request behavior
Checks robots.txt first
GeoScore checks the requested path before every page request, including redirect destinations. A matching GeoScoreBot or wildcard Disallow rule stops the fetch.
Uses public web addresses only
Requests are limited to public HTTP or HTTPS sites on standard ports. Private networks, local hosts, credentials in URLs, and unsafe redirect targets are rejected.
Keeps each scan bounded
A user starts each scan. Page downloads have a 15-second request timeout, a 2 MB response limit, and at most four redirects.
Stores analysis, not source HTML
GeoScore may retain the submitted URL, domain, calculated technical metrics, score, and request IP for product history and abuse controls. Raw downloaded HTML is not stored in the analysis record.
Control access
Site owners can block all GeoScore page fetches with this robots.txt group. More specific Allow and Disallow paths are also supported. A wildcard rule applies when no GeoScoreBot-specific group exists.
User-agent: GeoScoreBot
Disallow: /Request identity
Requests identify GeoScoreBot with the following user-agent. GeoScoreBot is independent of OpenAI, Google, Microsoft, Anthropic, and Perplexity crawlers.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; GeoScoreBot/1.1; +https://geoscore.dev/bot