A bot, also known as a web robot, web spider or web crawler, is a software application designed to automatically perform simple and repetitive tasks in a more effective, structured, and concise manner than any human could ever do. The most common use of bots is in web spidering or web crawling.
AwarioSmartBot and AwarioRssBot are legitimate web crawlers sent by Awario to discover and collect new and updated web data (that is further used by Internet marketers from all over the world).
The AwarioSmartBot and AwarioRssBot crawlers are identified by having user-agents of the following form:
AwarioRssBot/1.0 (+https://awario.com/bots.html; email@example.com)
AwarioSmartBot/1.0 (+https://awario.com/bots.html; firstname.lastname@example.org)
The AwarioSmartBot and AwarioRssBot crawlers can be identified by the user-agent above. Please do not try to identify the bots via IP as we do not use any consecutive IP blocks.
AwarioSmartBot and AwarioRssBot are very site-friendly crawlers. We made them as "gentle" as possible when crawling sites: they make only 1 request per 3 seconds, or even less frequently, if another crawl delay is specified in your robots.txt file. The bots respect rules you specify in your robots.txt file.
If any problems arise, they may be due to peculiarities of your particular site, or a bug on another site linking to you. Therefore, we would like to ask you — if you noticed any problem with Awario bots, please report it to email@example.com. We will quickly make unique settings for your particular site, so that the crawling will never affect your site's performance.
AwarioSmartBot and AwarioRssBot collect Web data that is further used by Awario application to let Internet marketers find who is mentioning their brand online.
If the AwarioSmartBot/AwarioRssBot crawlers have visited your page, this means that its content has never been collected and analyzed or needed to be refreshed. For this reason you will not see recurring requests from the AwarioSmartBot/AwarioRssBot crawlers to the same page.
AwarioSmartBot and AwarioRssBot are:
However, even though Awario bots are harmless, you still may want to prevent bots from crawling your site. The easiest and quickest way to do this is to use “robots.txt”. This text file contains instructions on how a bot should process your site data.
With a robots.txt file you may block the Awario crawlers from your site or slow them down as shown in the following examples:
For more information about bots, please refer to http://www.robotstxt.org/.
If you still have any questions about AwarioSmartBot or AwarioRssBot, please contact us at firstname.lastname@example.org and we will respond as soon as possible.