DrumblyBot is the crawler behind Drumbly, an AI marketing assistant. It visits a website only when someone adds that site to Drumbly or enters one of its pages in our free tools, or when the site is found as a competitor of a site added to Drumbly, and it reads a small number of public pages to understand what the business offers.
How it behaves
- It identifies itself with the user agent
DrumblyBot/1.0 (+https://drumbly.com/bot). - It reads a site's
robots.txtbefore it requests any page, and follows the rules forDrumblyBot, or for*when there are none. If the start page redirects to another host, it reads that host'srobots.txttoo and throws the page away if that host disallows it. The one exception: our free tools fetch the single page someone enters. - It reads at most 50 pages of a site it has been asked to analyse, and three pages of each competitor, fetching no more than four pages at a time.
- It reads public pages only. It never submits forms, signs in, or follows links to private or internal network addresses.
Blocking it
To stop DrumblyBot reading your site, add this to your robots.txt. It will then request only robots.txt itself, apart from a single page someone enters in our free tools:
User-agent: DrumblyBot
Disallow: /
Contact
If DrumblyBot causes you a problem, write to hello@drumbly.com and we will look into it the same day.