I've been wondering why my fly machines weren't auto-suspending after I added
#sentry to a project. From the logs, I could see /
was being requested every
second... Smells like a bot.
So I added more logging to catch the user-agent from request headers, and was surprised to see the following:
user-agent: SentryUptimeBot/1.0 (+http://docs.sentry.io/product/alerts/uptime-monitoring/)
I guess #sentry has a new feature (beta) that does a healthcheck on URLs that
have thrown exceptions. I need to read the docs more closely, but a GET
every
second seems a bit excessive. To disable it, I just revised my robots.txt:
User-agent: SentryUptimeBot
Disallow: *