Just be clear when I'm referencing bots for this post I speaking of the bots using browser user agents coming from thousands of different IP's
I run a forum on my site and I wish to go back to the days in the 2000's at the height of the spammers, it was so much easier.
I'm currently behind Cloudflare, excluding the US and CA minimally any request is getting the "Checking your browser page..." US and Canadian traffic gets a pass and I have some custom rules for a lot data centers and other source of bots inside of the US and CA. As soon as you solve the problem from one source it's coming from somewhere else.
One issue was Cox IP's leased to African company. They are "US" Ip's but the traffic is from Africa so I had to track down all the IP's for this company. Current issue and it's a major one is residential proxies US, I haven't pulled the rigger on CF for US IP's in general so I don't even know if it will be effective and I don;t want to inconvenience real users. Wasn't even aware this was a thing until recently.
Something I'm curious about is if anyone from Knownhost could comment. I know for at least the past two years this has been escalating with no end in site. Certainly this must be impacting your services and costs. I'm on small VPS that would get buried with this traffic if it wasn't for CF.
The second question I would have is are forums more susceptible to all this bot traffic?
I run a forum on my site and I wish to go back to the days in the 2000's at the height of the spammers, it was so much easier.
I'm currently behind Cloudflare, excluding the US and CA minimally any request is getting the "Checking your browser page..." US and Canadian traffic gets a pass and I have some custom rules for a lot data centers and other source of bots inside of the US and CA. As soon as you solve the problem from one source it's coming from somewhere else.
One issue was Cox IP's leased to African company. They are "US" Ip's but the traffic is from Africa so I had to track down all the IP's for this company. Current issue and it's a major one is residential proxies US, I haven't pulled the rigger on CF for US IP's in general so I don't even know if it will be effective and I don;t want to inconvenience real users. Wasn't even aware this was a thing until recently.
Something I'm curious about is if anyone from Knownhost could comment. I know for at least the past two years this has been escalating with no end in site. Certainly this must be impacting your services and costs. I'm on small VPS that would get buried with this traffic if it wasn't for CF.
The second question I would have is are forums more susceptible to all this bot traffic?