Pintwin173a
Member
- Messages
- 56
- Reaction score
- 3
- Points
- 8
Over the past month someone using Tencent Cloud Computing' server(s) has been systematically crawling my website.
The attached image is just the very tip of the problem, I could show hundreds of entries from the same host.
I've tried editing my robots.txt and htaccess files to slow down and/or deny the various ISPs but the slurping continues.
• Does x10 monitor for bad bots / crawlers based on frequency, and take steps to mitigate against it?
• x10 already uses CAPTCHA to verify that anyone logging into their servers is an actual human. Is it possible for a client to install such a system to protect their website(s)?
• All client-side solutions I've read to deny / delay malicious bots appear woefully inadequate. All suggest the best solution requires both a backend and frontend component.
Any help would be appreciated.
Regards,
Pintwin173a (the reincarnation of Pintwin173)
The attached image is just the very tip of the problem, I could show hundreds of entries from the same host.
I've tried editing my robots.txt and htaccess files to slow down and/or deny the various ISPs but the slurping continues.
• Does x10 monitor for bad bots / crawlers based on frequency, and take steps to mitigate against it?
• x10 already uses CAPTCHA to verify that anyone logging into their servers is an actual human. Is it possible for a client to install such a system to protect their website(s)?
• All client-side solutions I've read to deny / delay malicious bots appear woefully inadequate. All suggest the best solution requires both a backend and frontend component.
Any help would be appreciated.
Regards,
Pintwin173a (the reincarnation of Pintwin173)