The MapflareBot is a web crawler responsible for indexing web sites which contain news articles.
If a page contains a news arcticle and if the content of this article can be assigned to a place, the following information are stored:
Note: Only the titles of news articles are stored, never any parts of the content.
Add this to your robots.txt file:
User-agent: MapflareBot Disallow: /
If you still have questions about MapflareBot or you think that your rules in your robots.txt are not obeyed correctly by MapflareBot, feel free to contact us.contact [at] mapflare.com