I was trying to read this article : http://www.linux-mag.com/id/1731
but It need to be login, generally websites put login for user but still allow bots to view their contents. such as Google bots. Webservers read user agent of browser and determine that you are a bot or a user. You can still view many websites without login by changing user agent in firefox.
all you need to install firefox "user agent switcher" addons and add a entry for googlebot --
see also : http://www.ogletreeseo.com/22.html
Post a Comment