FAQ

  • What is MediaMonitoringBot and why it crawls m website?

    MediaMonitoringBot is a robot for crawling and indexing news and media publishers web pages. Its intent is finding new information as fast as possible and serve it for subscribers. Data collected by MediaMonitorinfBot is used by thousands SMO, PR and communication specialists to monitor and react based on actual up-to-the-minute data. Our crawler does not triggers any ads and would not add numbers to your Google Analytics.

  • What user-agents MediaMonitoringBot is using to identify itself?

    While accessing websites our crawler is identified by user-agent string. The full user-agent strings you will see in your website access logs are:● MediaMonitoringBot/1.1 (+https://mediamonitoringbot.com/crawler; moc.tobgnirotinomaidem%40relwarc)● MediaMonitoringBot/1.0 (+https://mediamonitoringbot.com)

  • How can I verify authenticity of MediaMonitoringBot?

    You can identify our crawlers with the user agent string. But user agent strings are easy to spoof, so not every request with these user agent strings may be coming from a real MediaMonitoringBot crawler. As a rule, our crawler does not share the IP addresses from which we crawl the web. The best way to verify that a request actually comes from MediaMonitoringBot crawler is to use a reverse DNS lookup on the source IP of the request, or to match the source IP against the MediaMonitoringBot IP addresses.

  • What suffix is used for a reverse DNS lookup?

    For a reverse DNS lookup our crawler is using .mediamonitoringbot.com suffix

  • Will MediaMonitoringBot slow down my website?

    Our crawler is designed to make requests that don't overburden websites. If you have any concerns about your web site performance, you can restrict the pages for crawling by disallowing them.

  • How to prevent MediaMonitoringBot from reading pages on my website?

    MediaMonitoringBot obeys the Robot Exclusion Standard. If you'd like to prevent it from reading some portion of your site, create a robots.txt file in the root directory (home folder) of your site and add disallow rules. Please also note that if your robots.txt contains errors then MediaMonitoringBot would not be able to recognize your commands, so it will continue crawling your website the way it did before.

  • Does it respect robots.txt file?

    We strictly respect robots.txt, both disallow and allow rules.

  • What is the list of your IP addresses?

    Our main crawler uses the following IP addresses:● 34.140.18.108● 104.199.105.26
    You can check the instructions for IP lists on Cloudflare here: https://developers.cloudflare.com/firewall/cf-dashboard/rules-lists/manage-lists

  • Get support

    Webmasters can contact MediaMonitoringBot Support directly by emailing us at: moc.tobgnirotinomaidem%40relwarc.

© 2019–2022MediaMonitoringBot