View Single Post
  #1 (permalink)  
Old 12-01-2008, 11:29 PM
Janna Janna is offline
Regular Babbler
 
Join Date: Mar 2008
Location: Seattle area
Posts: 48
Janna has a few positive reputation points
Default Putting adsense on SBI site

I posted in the Adsense thread, but also wanted to ask another Adsense question here, because if I am understanding correctly, I have some kind of SBI issue with the google crawler.

this is the message:

If our crawler finds any issues with your pages, they'll be listed in the table below. We encourage you to resolve these issues in order to allow us to crawl more of your pages and provide relevant ads.

For help resolving issues with any blocked URLs, please visit our Help Center

This crawl report is updated weekly, and we are unable to accommodate requests for more frequent crawling. Please also keep in mind that this report is not exhaustive.

Blocked URL:
http:/ / build32. sitesell. com/ cgi-bin/ sbi/ buildIndexPreview-SBIB. pl

Reason Blocked:
Robots.txt File

Last Crawl Attempt:
Nov. 24, 2008

I have no idea what a robots. txt file is. How do I fix this? it tells me I can fix it by granting permission in my robots.txt file. I have SBI, so I'm confused as to where to find this file?

thanks!
Reply With Quote