Where should a robots.txt file go -- in the real account root or in the folder public_html? I have FTP'd a robots.txt file in both places, but Google's tester tool only seems able to read the one in public_html, though they say here that it should go in the domain root. (I can tell the difference between the two files because one of them has a blank line in it.) My problem is that although the tester tool does not flag any syntax errors or warnings, it seems to take no notice of the Disallow line. When tested it just reports "allowed".