PDA

View Full Version : Chinese Website Crawlers



Unregistered
29-11-13, 17:32
I have been trying to make an online website for Uyghurs and it seems like, the Chinese Website Spiders have already crawled onto my site. I think their crawlers use a mathematical tracking system where it checks every site on the internet with the name Uyghur on it. I find this pretty ridiculous and annoying. I will block it off now, and only keep Google crawlers which are safe. Anyone have idea idea as to how this actually works?
I blocked off my site's name for security measures.

http://s17.postimg.org/sx2cxwd7z/china.jpg (http://postimage.org/)