DemandRadarBot

DemandRadarBot is a crawler used for search trend research.

What it fetches

robots.txt, sitemap files, and a small number of pages that newly appear in a sitemap (to check whether they still exist).

How often

At most one sitemap fetch per site per day, with at least 1 second between page requests to the same site.

How it behaves

It respects robots.txt. It does not log in, submit forms, run page scripts, or collect personal information.

How to block it

To block it, add this to your robots.txt:

User-agent: DemandRadarBot
Disallow: /