Detecting Crawlers?

[apoorav]

Can any body give me PHP code to detect web crawlers(BOTS) crawling the webpage

For Example, it should show that GOOGLE bot was last visitor and similarly should show total list.

 

[Mr. DOS]

I don't have code to give you, but you'll want to check the PHP internal variable $_SERVER['HTTP_USER_AGENT'] against a list of user agents used by bots (Google for them). If a match is found, you can then log it.

--- Mr. DOS

 

[descalzo]

I don't have code to give you, but you'll want to check the PHP internal variable $_SERVER['HTTP_USER_AGENT'] against a list of user agents used by bots (Google for them). If a match is found, you can then log it.

This will get you a list of the "legit" bots. The "not-so-legit" bots spoof IE or Firefox. They also ignore robots.txt.

 

[apoorav]

Ok, but i want code for it , if anybody can give??

 

[misson]

Have you tried Google? Always try Google.