SweepTakersBot
SweepTakers uses a small, polite crawler to read sweepstakes feeds we have permission to use. Here's how to recognize it and how to reach us.
User agent
SweepTakersBot/1.0 (+https://sweeptakers.com/bot)
Requests come from our hosting provider's servers and always carry this user agent. To block it, add this to your robots.txt:
User-agent: SweepTakersBot
Disallow: /How it behaves
Only feeds we are allowed to use
We fetch a feed only after its owner has licensed it to us or publicly permits this kind of use. Sources without that permission are switched off and never fetched.
Honors robots.txt
We read your robots.txt and treat a disallow rule as a no. We also follow standard caching headers, so unchanged feeds aren't downloaded again.
Stops when asked
An HTTP 401, 403 or 429 response, or any bot challenge page, stops crawling of that source automatically. It stays off until a person on our team reviews it and has permission to resume.
Never bypasses protections
We don't solve challenges or CAPTCHAs, rotate IP addresses, use proxies, disguise our user agent, or log in to anything.
Low frequency
One request at a time per site, on a fixed schedule (by default once an hour per feed, never more than every 15 minutes). We fetch the feed itself, not your whole site.
Facts and a link back
From a permitted feed we keep only basic facts about a giveaway and a link to it. We credit the source where its terms allow and never copy images.
Want changes, or want us to stop?
Email support@evolve-group-llc.com from an address at your domain. We can slow the crawler down, change what it reads, correct how we credit you, or stop crawling and remove listings that came from your site. We act on removal requests within 24 hours.
Sponsors who want a listing corrected, or autofill turned off for their entry pages, can use the same address. See also our Copyright & DMCA Policy.