The MapflareBot is a web crawler responsible for indexing web sites which contain news articles.

Collected information

If a page contains a news arcticle and if the content of this article can be assigned to a place, the following information are stored:

  • URL to the article
  • title of the article
  • publishing date
  • places mentioned in the article

Note: Only the titles of news articles are stored, never any parts of the content.

How to stop MapflareBot from crawling your site

Add this to your robots.txt file:

User-agent: MapflareBot
Disallow: / 


If you still have questions about MapflareBot or you think that your rules in your robots.txt are not obeyed correctly by MapflareBot, feel free to contact us.

contact [at]