Quantcast
Channel: All Forums
Viewing all articles
Browse latest Browse all 27852

Can the user-agent of the SEO crawler be changed?

$
0
0

The site I own that wish to check is hosted for me, and I do not control the robots.txt page it serves up. My problem is that it only allows the common web search crawlers and disallows everything else:http://photos.hemsfamily.com/robots.txt

Can I override the user-agent that the SEO crawler behaves as in order for it to index my stuff?


Viewing all articles
Browse latest Browse all 27852

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>