My girlfriend has made a website which we now host on our WHS. This works fine offcourse.
However, when we tried to get the site indexed through google we discovered a problem.
Apparently we need to edit the "robot.txt" file if we want to get the site properly indexed on Google.
If we enter our url
http://<my_domain>.homeserver.com/robot.txt we get the following:
User-agent: *
Disallow: /
Now we know what it should read but we do not know where to find the robot.txt file on the server itself.
I have tried to search for the file on the WHS itself through a remote connection but even then I cannot find it on the server. Even if I search with hidden files on.
My question is where would we find this robot.txt file on the home server?
I hope anyone can shed some light on this small problem.
Sincerily,
John.
