TangoKalenderBot

TangoKalenderBot is the research crawler of Tango Kalender. It reads the public pages of tango organizers, venues and listing calendars to find milongas, prácticas, classes and workshops, and lists them with a link back to the page where they were found. It is part of a calendar run by one person for the tango community, without ads or payment.

How it behaves

  • It identifies itself as “TangoKalenderBot/1.0” with a link to this page and a contact address.
  • It honours robots.txt (user agents “TangoKalenderBot” and “*”) and a “noai” or “noindex” robots directive in the header or a meta tag.
  • At most one request per second per site, usually one page per site every few days; pages that do not change are read less often.
  • It never signs in, never fills in forms and never fetches more than two megabytes of a page.
  • It publishes no pictures and no texts of yours: the calendar shows dates, places and a short summary of its own, with the source named and linked. The text of a page is kept only until it has been read, at most a week.

Keeping it out

A line in your robots.txt is enough:

User-agent: TangoKalenderBot
Disallow: /

Or use the form “Do not list me”: it blocks your site, venue, name or events for our research permanently, and removes what was found. Questions: broicher@outlook.com