Hi,
Before asking here I posted a similar post to the Webmaster Tools Forum and got nothing but worthless comments. So, please no replies saying post in the Webmaster Tools Forum
I have a 2008 R2 Enterprise Server using IIS 7.5 and the site is fine
Around a month ago I DCPROMO'd it making it a domain controller. Since then Google Webmaster Tools says it cannot access the robots.txt. If I look at the permissions I see read/execute for IIS USRS. In the IIS logs I see the 66.249.*.* with the Google Bot user agent but of course not as much as there was but MSN, Yahoo, Bing, Yandex, and so on have no issues whatsoever. In Webmaster Tools, I use Fetch As GoogleBot, etc which returns 100% fine with all fetches using image bot and the others yet once a week Webmaster Tools says things like 53% of the time cannot access the robots.txt. MS Exchange, WSUS are using the Default Website by default and they are all fine.
Just seems silly that Google moans it cannot access it all the time and yet everyone is returning a 200 return code
Any ideas?