Page 1 of 1

Restricting SE2 debate

Posted: Sat Dec 29, 2007 1:55 am
by Sanjøy
How happy was I to see that the Google spider has indexed the SE user profiles and that this comes up when googling myself.

I would imagine others might not want that to happen either if a prospective employer was to google them as I do when recruiting.

Simon any chance of updating the robots.txt ?

Posted: Sat Dec 29, 2007 10:44 am
by robin
Hmm. Well, I would tend to avoid posting things that an employer would worry about; although I suspect that if they weren't registered on the site they wouldn't see your profile - but then registration is free and easy, so in the end they could get there.

Whilst updating robots.txt would go some way towards restricting the visibility of SE2 to search engines, it would stop them finding it by cross linking from other sites I think.

SE2 is essentially a public place, so don't put stuff here that you wouldn't want to be challenged with later.

Cheers,
Robin

Posted: Sat Dec 29, 2007 10:50 am
by Rich H
Yeah, get back to work! :D