Register

If this is your first visit, please click the Sign Up now button to begin the process of creating your account so you can begin posting on our forums! The Sign Up process will only take up about a minute of two of your time.

Page 1 of 2 1 2 LastLast
Results 1 to 10 of 14
Like Tree3Likes

Thread: What is a robots.txt file?

  1. #1
    Banned
    Join Date
    Jan 2016
    Location
    307,1st Floor,46th Cross, 9th Main, 4th Block Rajajinagar Bangalore - 560 010 banglore, Karnataka
    Posts
    21
    Member #
    52938
    Liked
    2 times

    What is a robots.txt file?

    hi friends,

    What is a robots.txt file?

  2.  

  3. #2
    Junior Member
    Join Date
    Jun 2016
    Posts
    1
    Member #
    54347

    Smile

    "robots.txt " file means the text file which is readable for the search engine robots. Like -

    1. anchor text : <a href="http://www.example.com">Example Anchor Text</a>

    2. Title tag: <title>Example Title name </title>

    3. h1 tag : <h1 class='title'>

    which is readable for robots. It's helps the robot for indexing website.

  4. #3
    Unpaid WDF Intern TheGAME1264's Avatar
    Join Date
    Dec 2002
    Location
    Not from USA
    Posts
    14,485
    Member #
    425
    Liked
    2783 times
    The Web Robots Pages

    There's everything you need to know.
    If I've helped you out in any way, please pay it forward. My wife and I are walking for Autism Speaks. Please donate, and thanks.

    If someone helped you out, be sure to "Like" their post and/or help them in kind. The "Like" link is on the bottom right of each post, beside the "Share" link.

    My stuff (well, some of it): My bowling alley site | Canadian Postal Code Info (beta)

  5. #4
    Senior Member
    Join Date
    Feb 2006
    Posts
    800
    Member #
    12463
    Liked
    296 times
    Quote Originally Posted by CochinWebdesign View Post
    It is one process of seo
    Are you using a sneaky link drop in each of your posts? You won't last long here if you keep this up.
    TheGAME1264 likes this.

  6. #5
    Unpaid WDF Intern TheGAME1264's Avatar
    Join Date
    Dec 2002
    Location
    Not from USA
    Posts
    14,485
    Member #
    425
    Liked
    2783 times
    No, he will not.

    This is the only warning I'm issuing.
    If I've helped you out in any way, please pay it forward. My wife and I are walking for Autism Speaks. Please donate, and thanks.

    If someone helped you out, be sure to "Like" their post and/or help them in kind. The "Like" link is on the bottom right of each post, beside the "Share" link.

    My stuff (well, some of it): My bowling alley site | Canadian Postal Code Info (beta)

  7. #6
    Junior Member Joshua Butler's Avatar
    Join Date
    Sep 2015
    Posts
    6
    Member #
    52074
    Liked
    2 times
    Robots.txt is a text file you put on your site to tell search robots which pages you don’t want them to visit. It is by no means mandatory for search engines but generally, search engines obey what they are asked not to do.
    iMaxTechnologies likes this.

  8. #7
    Senior Member khenney's Avatar
    Join Date
    Apr 2016
    Location
    Half Moon Bay, California
    Posts
    276
    Member #
    53911
    Liked
    148 times
    Quote Originally Posted by VeronicaSmith View Post
    Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit.


    You're pretty much checking off all of the boxes on the spammer checklist. You didn't try to drop a link yet but I'm sure that's coming if you don't get banned.

    This thread and the "What is Gray Hat" thread are just magnets for spammers, I suspect mods leave them up just as honeypots.
    Kevin Henney
    CRUCIAL CREATIVE
    Web Development - Graphic Design - Branding

  9. #8
    Senior Member khenney's Avatar
    Join Date
    Apr 2016
    Location
    Half Moon Bay, California
    Posts
    276
    Member #
    53911
    Liked
    148 times
    Quote Originally Posted by Joshua Butler View Post
    It is by no means mandatory for search engines but generally, search engines obey what they are asked not to do.
    Copy and paste from a 2010 article here: What Is the Robots Txt File?
    Kevin Henney
    CRUCIAL CREATIVE
    Web Development - Graphic Design - Branding

  10. #9
    Junior Member
    Join Date
    Jul 2016
    Location
    New Delhi/India
    Posts
    2
    Member #
    54648
    "robots.txt " file means the text file which is reliable for the search engine robots.

  11. #10
    Junior Member webiletechnologies's Avatar
    Join Date
    May 2016
    Location
    Ahmedabad
    Posts
    6
    Member #
    54228
    Robots.txt file specially created for search engine spiders to give the m instructions that which pages they do not have to visit.


Page 1 of 2 1 2 LastLast

Remove Ads

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
All times are GMT -6. The time now is 08:16 AM.
Powered by vBulletin® Version 4.2.3
Copyright © 2019 vBulletin Solutions, Inc. All rights reserved.
vBulletin Skin By: PurevB.com