NauticBot

The crawler of VeloceYachts, a search engine of boats for sale.

What it does

NauticBot reads the boats for sale that boat dealers, brokers and shipyards publish on their own websites, so that buyers can find them in one search and visit the seller's website. It reads public pages only: it never logs in, fills in forms or contacts anyone.

How it behaves

• It follows robots.txt rules for NauticBot (or * if there is no specific group), including Crawl-delay.
• It makes at most one request every 1.5 seconds to the same website, and fewer if Crawl-delay asks for it.
• It backs off when a site answers 429 or 503 and honours Retry-After.
• It never tries to get around a CAPTCHA, a login or any other access control.

How to recognise it

User-Agent:

Mozilla/5.0 (compatible; NauticBot/1.0; +https://veloceyachts.es/bot)

Its requests are signed with HTTP Message Signatures (Web Bot Auth). The public key directory is at /.well-known/http-message-signatures-directory, and every request carries Signature-Agent: "https://veloceyachts.es".

How to block it or slow it down

Add this to your robots.txt to stop it completely:

User-agent: NauticBot
Disallow: /

Or ask it to go slower, for example one request every 10 seconds:

User-agent: NauticBot
Crawl-delay: 10

Contact

Questions or problems with NauticBot: [email protected].