While I was migrating my web sites from AWS US east to US west, it’s interesting to see behavior of those spiders, good and bad.
I set TTL of my domain to 30 minutes, and after 12 hours some spiders are still NOT going to my new sites: Continue reading »