- Apr 25, 2015
- 1,845
- 2
- 2,199
- 327
So, when someone decides to start using Amazon to spider/index your website --- that is kind of annoying. Blocking addresses by ASN is a nice feature CloudFlare has.
Just throw an IP address in the url like this: http://bgp.he.net/ip/52.19.83.75 --- get the ASNs and block them. If you are lazy and want to block Amazon addresses from your website: AS16509, AS39111, AS64890 --- those 3 are what I have seen so far.
This is very simple, all of the annoying Amazon bots/spiders are gone.
Code:
52.19.83.75 (ec2-52-19-83-75.eu-west-1.compute.amazonaws.com)
Announced By
Origin AS Announcement Description
AS16509 52.18.0.0/15 Amazon Technologies Inc.
AS39111 52.18.0.0/15 Amazon Technologies Inc.
AS64890 52.18.0.0/15 Amazon Technologies Inc.Just throw an IP address in the url like this: http://bgp.he.net/ip/52.19.83.75 --- get the ASNs and block them. If you are lazy and want to block Amazon addresses from your website: AS16509, AS39111, AS64890 --- those 3 are what I have seen so far.
This is very simple, all of the annoying Amazon bots/spiders are gone.
