Navisio's bot

NavisioDocWatcherreads insurers' documents

It is the program Navisio AI uses to keep its library of insurance products up to date. It visits an insurer's website once a month, at night, and downloads only the pre-contractual documents the insurer publishes for everyone.

The bot at a glance

Who runs it: Navisio AI, a platform of Nano i-Tech S.r.l.
What it reads: Product pages and the documents they link: information sets (Set informativo), DIP, additional DIP, KID, policy terms (Condizioni di assicurazione).
When it visits: Once a month per website, only at night, finishing by 6:00 Italian time.
How fast: One request at a time, at least 2 seconds apart, and a maximum number of requests per visit. Where the website allows it, it asks only for the files that changed.
What it never does: It does not enter reserved areas, fill in forms, run scripts or use a browser.
When it stops: If the website turns it away (401 or 403 on its entry pages, or on most requests), asks it to slow down (429) or shows an anti-bot check, it ends the visit and tries no other way in. It honours Retry-After.
What happens to the files: They are checked by an antivirus and compared with Navisio's library. A person reviews every change before it reaches insurance intermediaries.

Your robots.txt

The bot follows the rules written for NavisioDocWatcher or, if there are none, for *.

# Do not visit the website
User-agent: NavisioDocWatcher
Disallow: /

# Slow down: 10 seconds between two requests
User-agent: NavisioDocWatcher
Crawl-delay: 10

A Crawl-delay of up to 60 seconds is honoured; a longer one stops the visits to your website.

Every request introduces itself like this:

NavisioDocWatcher/1.0 (+https://navisio.ai/bot)

Write to us

With a question, to check that a request is ours, or to ask us not to visit your website.

support@navisio.ai