LinkBack URL
About LinkBacksPlease don't hit me over the head if this is killingly simple (or if I've chosen the wrong section of the forums again :deadbut -
How does one stop search engine bots from crawling and indexing a page that's just up for test purposes?
(I have done a search for this and similar questions in the forums and couldn't find any threads that seemed to fit).
Thanks
Sara
If this is your first visit, please click the Sign Up now button to begin the process of creating your account so you can begin posting on our forums! The Sign Up process will only take up about a minute of two of your time.
Results 1 to 6 of 6
Thread: Suppressing the bots...
-
Aug 17th, 2004, 09:40 AM #1Senior Member
- Join Date
- Feb 2004
- Location
- UK
- Posts
- 525
- Member #
- 4818
- Liked
- 1 times
...............................................
My best pal's site: Algarve Beach Life :ichatcool:
-
Aug 17th, 2004 09:40 AM
-
Aug 17th, 2004, 11:16 AM #2Senior Member
- Join Date
- Jun 2003
- Location
- Cornwall, England.
- Posts
- 1,202
- Member #
- 1879
I read about it once before. Something to do with "robot.txt" google it and it will tell you how to go about it.
Basically I think the bot will read that file and in the file you tell the bots what not to index. Don't hold me to this, this is what I think I can remember.
-
Aug 17th, 2004, 11:30 AM #3Unpaid WDF Intern
- Join Date
- Dec 2002
- Location
- Not from USA
- Posts
- 14,482
- Member #
- 425
- Liked
- 2784 times
http://www.robotstxt.org/wc/exclusion.html
That will pretty much explain everything you need to know, My Darling English Rose.If I've helped you out in any way, please pay it forward. My wife and I are walking for Autism Speaks. Please donate, and thanks.
If someone helped you out, be sure to "Like" their post and/or help them in kind. The "Like" link is on the bottom right of each post, beside the "Share" link.
My stuff (well, some of it): My bowling alley site | Canadian Postal Code Info (beta)
-
Aug 17th, 2004, 12:20 PM #4
Yeah, that's a really good site.
The Rules
Was another WDF member's post helpful? Click the like button below the post.
Admin at houseofhelp.com
-
Aug 23rd, 2004, 03:57 AM #5Senior Member
- Join Date
- Feb 2004
- Location
- UK
- Posts
- 525
- Member #
- 4818
- Liked
- 1 times
You're a wonderful resource, Game, not to mention my knight in shining polyester... :thumbsup:That will pretty much explain everything you need to know, My Darling English Rose.
And my thanks also to Daniel O. :classic:
I shall check that out and learn lots, I'm sure................................................
My best pal's site: Algarve Beach Life :ichatcool:
-
Aug 23rd, 2004, 07:47 AM #6Unpaid WDF Intern
- Join Date
- Dec 2002
- Location
- Not from USA
- Posts
- 14,482
- Member #
- 425
- Liked
- 2784 times
It's polycotton now. My new girlfriend is influencing my sense of style (you know...complete slob.
Originally Posted by sarab
)
If I've helped you out in any way, please pay it forward. My wife and I are walking for Autism Speaks. Please donate, and thanks.
If someone helped you out, be sure to "Like" their post and/or help them in kind. The "Like" link is on the bottom right of each post, beside the "Share" link.
My stuff (well, some of it): My bowling alley site | Canadian Postal Code Info (beta)
Reply With Quote
