Register

If this is your first visit, please click the Sign Up now button to begin the process of creating your account so you can begin posting on our forums! The Sign Up process will only take up about a minute of two of your time.

Results 1 to 10 of 10

Thread: robots.txt

  1. #1
    Junior Member
    Join Date
    Jun 2015
    Posts
    1
    Member #
    50368

    robots.txt

    Hi All

    I am new to building and designing websites and have run into a snag after publishing my last website.
    if I type the website into google search it gives me the following message:

    "www.lodgelakealbert.com/
    A description for this result is not available because of this site's robots.txt learn more."

    I used weebly.com to design the website.

    How do I fix this problem to enable possible customers to find my website?

    Thanks very much for your assistance.

  2.  

  3. #2
    Senior Member Vapr_Arts's Avatar
    Join Date
    Oct 2013
    Location
    California
    Posts
    1,930
    Member #
    37412
    Liked
    544 times
    Ive never messed with weebly but the first thing id do is find that robot.txt file and show us what it says. Robot.txt files are pretty easy to understand and if you aren't familiar with it many of us here are. Essentially its just two lists(or one) of who is allowed and not allowed to crawl your site.


    Sent from my iPhone using Tapatalk

  4. #3
    Banned
    Join Date
    Feb 2015
    Posts
    100
    Member #
    42499
    Liked
    4 times
    You only need a robots.txt file if your site includes content that you don't want Google or other search engines to index.

  5. #4
    Banned
    Join Date
    Aug 2015
    Location
    Bangalore
    Posts
    4
    Member #
    51660
    robots.txt is a text file webmasters create to instruct robots or search engine robot how to crawl and index pages on their website.

  6. #5
    Junior Member ss.aaronschwartz's Avatar
    Join Date
    Aug 2015
    Location
    Henderson
    Posts
    8
    Member #
    51536
    Well It would be better if you can provide the snapshot of robots.txt in order to give proper feedback.For a time being you can write Good Description which describes your product/service and next time google crawler craws you may see the results as expected.

    But as of now the description you have provided does not fits with search engine definition.

  7. #6
    Junior Member jaysmith's Avatar
    Join Date
    Aug 2015
    Location
    UAE, Dubai
    Posts
    10
    Member #
    51681
    i will fix and customers find your website

  8. #7
    Banned
    Join Date
    Jun 2014
    Location
    Chandigarh, India
    Posts
    24
    Member #
    39446
    Liked
    1 times
    You need to check your robots.txt file.

  9. #8
    Junior Member stylelifefame's Avatar
    Join Date
    Feb 2016
    Location
    Gurgaon
    Posts
    6
    Member #
    53408
    Liked
    3 times
    Robots.txt is a text (not html) file you put on your site to tell search robots which pages you would like them not to visit. Robots.txt is by no means mandatory for search engines but generally search engines obey what they are asked not to do.

  10. #9
    Banned
    Join Date
    Dec 2015
    Posts
    20
    Member #
    52733
    robots.txt file is the control all the search engine bot for crawling and indexing.

  11. #10
    Junior Member
    Join Date
    Mar 2016
    Location
    Chicago, IL
    Posts
    24
    Member #
    53671
    Liked
    8 times
    Quote Originally Posted by Nicky888 View Post
    How do I fix this problem to enable possible customers to find my website?
    Delete robots.txt file from the root directory of your website.


Remove Ads

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
All times are GMT -6. The time now is 04:23 PM.
Powered by vBulletin® Version 4.2.3
Copyright © 2019 vBulletin Solutions, Inc. All rights reserved.
vBulletin Skin By: PurevB.com