Okay, at times, UserAgents can hit annoyingly apache, so what a better way to stop them from transferring the whole site for a pointless reason So yeah, what I’ve done is .htaccess and block them, in my case CURL and Pingdom… why?… Okay, CURL can be used to do automated actions on your website through