Crawler

SeorunaBot

SeorunaBot is the crawler behind Seoruna, an SEO and AI-visibility platform. It analyzes websites for technical SEO health and AI-engine readability, and produces prioritized fixes for their owners, alongside visibility measurement across AI engines.

Consent-based by design

SeorunaBot does not crawl the open web. It visits two kinds of sites, both at a customer's explicit request: sites their owners added to a Seoruna dashboard, and a small number of competitor sites a customer chose to track. Competitor crawls carry the same user agent, always obey robots.txt, and are bounded the same way — if you would rather not be crawled at all, the robots.txt rule below stops both kinds.

Identification

• User agent: SeorunaBot/1.0 (+https://seoruna.com)
• Cryptographic identity (Web Bot Auth): every request carries an Ed25519 HTTP Message Signature (RFC 9421, tag="web-bot-auth"). Verify it against our signed key directory: https://seoruna.com/.well-known/http-message-signatures-directory
• Egress IPs: all crawls originate from the addresses in our machine-readable list: https://seoruna.com/bot-ip-list.txt

Behavior

• Obeys robots.txt, including per-agent rules, disallows and the Crawl-delay directive.
• Polite pacing: requests are rate-limited per site with delays between fetches.
• Honors ETag / If-Modified-Since — unchanged pages are not re-downloaded.
• Reads public HTML only; it never submits forms, logs in, or executes purchases.
• Crawls are bounded (page caps per site) and typically run once per night; what we store per URL is described in Pages.

Allowing or blocking

To allow SeorunaBot through a firewall or CDN, permit the user agent above — or verify our request signatures against the key directory. To refuse crawling entirely, add this to your robots.txt:

User-agent: SeorunaBot
Disallow: /

Questions or reports: info@seoruna.com