Robot.txt

computerkids

New Member
Messages
54
Reaction score
2
Points
0
My website was recently indexed by jayde and they seem to have skipped my home webpage and indexed my crappy forum page that I havent had time to work on yet. I was recently playing with the robot.txt and am wondering if this was the cause. Anyway my questions are

1. What should be in my robot.txt file or should it be blank ie exactly how do I write it.

2. Exactly where and how do I upload it. I know it should be in the root but I am not sure I guess where or how to do this. Pardon my ignorance thi my first attempt at my own site.
 

farscapeone

Community Advocate
Community Support
Messages
1,165
Reaction score
27
Points
48
Create a robots.txt file in the root of your site and add folowing code to it:
Code:
User-agent: *
Disallow: /

You can find more info here
 

Coolmaty

Member
Messages
68
Reaction score
0
Points
6
Hopefully i use this:

User-agent: *
Disallow:
Seems if there is anything wrong in it...
 
Top