HasmordResearch bot

What it is

HasmordResearch is Hasmord’s research reader. When a Hasmord merchant researches a competitor, it reads a small number of that site’s public pages to compare publicly stated product information. Each run is started by a merchant; it is not a continuous crawler.

How it behaves

• Identifies itself with the User-Agent HasmordResearch/1.0 (+https://hasmord.com/bot).
• Reads robots.txt before every request, including each redirect, and follows the HasmordResearch group first, then *.
• Reads at most 20 pages per research run, with a bounded number of retries.
• Uses GET requests only. It never submits forms, never logs in and never reads pages behind a login.
• Ignores files that are not HTML pages.

How to block it

Add this to your robots.txt:

User-agent: HasmordResearch
Disallow: /

Answering requests from this User-Agent with a 403 also stops it.

What we do with the text

Page text is read to compare public statements for the merchant who started the research. It is kept for a limited period, up to 12 weeks, and is not resold as data.

Contact

For questions or removal requests, email support@hasmord.com.