We have a website that operates fine when anyone other than Google hits the site. When Google hits the site (or you use a tool like Smart IT Consulting's "Browse as Googlebot" tool) the response header that is provided to Google bot is full of spam links inserted immediately after the connection: closed line. In examining the server, there is nothing obviously wrong with any IIS settings and the HTTP Response Headers in the IIS managers just list the X-Powered-By listing (typical). I can't find any documentation that tells me how IIS is examining the http_user_agent ID (I'm assuming that is how it is detecting it is Google bot) or what .dll or other files IIS references to build the response header.
↧