Site not indexed yet...

by Kaari
18 replies
Hi,

I am experiencing a bit of a problem with getting my site indexed. It is a wordpress blog that I have installed via godaddy. I have changed the settings on the robots.txt, or I have in the settings set it to be indexed by search engines, but it's been a week or more now! What's going on? I can't provide google with a sitemap either as google tells me there is a robots.txt file stopping it. The thing is I changed the settings of the robots.txt file so it shouln't give that warning...

Can you speed up the process of getting indexed?

Help!
#indexed #site
  • Profile picture of the author VegasGreg
    I would submit your site to Digg.com and then it should get indexed
    within a few hours tops.
    Signature

    Greg Schueler - Wordpress Fanatic... Living The Offline Marketing Dream...

    {{ DiscussionBoard.errors[361603].message }}
    • Profile picture of the author milamber
      Originally Posted by VegasMan2k View Post

      I would submit your site to Digg.com and then it should get indexed
      within a few hours tops.
      Not just on digg but on stumble and other social bookmarking sites. And you'll see results for 3-4 hours after.
      {{ DiscussionBoard.errors[361610].message }}
  • Profile picture of the author Kaari
    Yeah I have done! That was the first thing I did! Digg, Stumble, Mixx you name it
    That's why I am a bit curious why it isn't out there...
    {{ DiscussionBoard.errors[361615].message }}
    • Profile picture of the author Mad Dawg
      a good way to get a site indexed is to go to google adwords.

      go to the keyword tool and the go down the page a bit to the option where it lets you search for keywords relevent to the keywords appearing on a site

      enter your site in as the URL and this willl send the google spiders to your site and should get it indexed
      {{ DiscussionBoard.errors[361621].message }}
      • Profile picture of the author 07knev
        Have you added you site to Welcome to Webmaster Tools
        Signature
        Now it's your Turn to Earn from CPA
        {{ DiscussionBoard.errors[361693].message }}
        • Profile picture of the author Kaari
          Originally Posted by 07knev View Post

          Have you added you site to Welcome to Webmaster Tools
          If you mean manually submit it to Google... Yes I have. Should I do it again I wonder??
          {{ DiscussionBoard.errors[361699].message }}
  • Profile picture of the author Kaari
    Thanks Mad Dawg,

    I have just done what you said... any ideas of how long you have to wait until it shows up?
    {{ DiscussionBoard.errors[361695].message }}
  • Profile picture of the author radhika
    Originally Posted by Kaari View Post

    Hi,
    I have changed the settings on the robots.txt, or I have in the settings set it to be indexed by search engines, but it's been a week or more now! What's going on? I can't provide google with a sitemap either as google tells me there is a robots.txt file stopping it.
    Help!
    What is your robots.txt content? Post it here. May be your code stopping Google crawling?

    .
    Signature
    Follow up Autoresponder PRO :: 33% Discount!!
    FREE Upgrades! IMPROVED Email Deliverability!!
    {{ DiscussionBoard.errors[361796].message }}
    • Profile picture of the author Kaari
      Originally Posted by radhika View Post

      What is your robots.txt content? Post it here. May be your code stopping Google crawling?

      .
      Hi,

      My robots.txt is:
      Code:
      User-agent: *
      Disallow:
      So it should be no problems right...
      {{ DiscussionBoard.errors[361833].message }}
      • Profile picture of the author radhika
        Originally Posted by Kaari View Post

        Hi,

        My robots.txt is:
        Code:
        User-agent: *
        Disallow:
        So it should be no problems right...
        Kaari,

        It seems you keep empty at 'Disaalow:' tag. I am not sure of this. But if you keep like that it might be telling search engines to stop crawling entire domain.

        Change your code to this:

        User-agent: *
        Disallow: /cgi-bin/

        This removesempty variable there. Search engines might be seeing it as 'Disallow: /', so stop crawling entire site. Try above two lines that I told you.

        .
        Signature
        Follow up Autoresponder PRO :: 33% Discount!!
        FREE Upgrades! IMPROVED Email Deliverability!!
        {{ DiscussionBoard.errors[361844].message }}
        • Profile picture of the author Kaari
          Originally Posted by radhika View Post

          Kaari,

          It seems you keep empty at 'Disaalow:' tag. I am not sure of this. But if you keep like that it might be telling search engines to stop crawling entire domain.

          Change your code to this:

          User-agent: *
          Disallow: /cgi-bin/

          This removesempty variable there. Search engines might be seeing it as 'Disallow: /', so stop crawling entire site. Try above two lines that I told you.

          .
          Thanks!

          The thing is I can't get to the file... It is kept somewhere in the Wordpress settings and I have not found it. I only have the option to change it in my admin section of the blog. Where of course I have set it to get crawled.

          However I took a look at this site seoconsultants.com/robots-text-file/ and it appears that an empty "disallow:" is telling the crawler to index... But I don't know
          {{ DiscussionBoard.errors[361928].message }}
          • Profile picture of the author radhika
            Originally Posted by Kaari View Post

            Thanks!

            The thing is I can't get to the file... It is kept somewhere in the Wordpress settings and I have not found it.
            robots.txt file must be in your root folder. So ftp to your site and check under your root folder.

            .
            Signature
            Follow up Autoresponder PRO :: 33% Discount!!
            FREE Upgrades! IMPROVED Email Deliverability!!
            {{ DiscussionBoard.errors[361934].message }}
            • Profile picture of the author Kaari
              Originally Posted by radhika View Post

              robots.txt file must be in your root folder. So ftp to your site and check under your root folder.

              .
              I know.... but it's not there.. It is some sort of feature within Wordpress so it is hidden somewhere... I don't know where!
              {{ DiscussionBoard.errors[361943].message }}
  • Profile picture of the author Ivancho
    I ussually gets my websites indexed within 2 hours of put them online.

    All I do is using the All in One Seo plugin - for wordpress

    Try it, it will help you to get indexed
    {{ DiscussionBoard.errors[361800].message }}
  • Profile picture of the author bombdiggity
    It's probably just not popular enough. Try pinging and RSS'ing the blog whenever you make an update to it, and try to get some cross-links with it's address out there. Submitting it to social bookmarking sites, like previous posters suggested, isn't a bad idea either.
    Signature
    **bombdiggity**

    =ask me about my unique high quality content articles=
    >>explosive content starting at only $3.50!<<
    .boom.baby.boom.
    {{ DiscussionBoard.errors[361807].message }}
    • Profile picture of the author Kaari
      Originally Posted by JoshuaCreighton View Post

      It's probably just not popular enough. Try pinging and RSS'ing the blog whenever you make an update to it, and try to get some cross-links with it's address out there. Submitting it to social bookmarking sites, like previous posters suggested, isn't a bad idea either.
      I have done quite a lot of back-linking (not cross linking) however. Written articles in hubpages, squidoo and other places.. I have just done a similar blog that got indexed straight away so I really don't know what is going on here...

      On the otherone I uploaded WordPress through dreamweaver but this time I installed via godaddy which might make a difference. I don't know.

      I socially bookmarked a new post today on about 10 sites but still not a glimpse of my site on google. I mean I put in "site:mysite.com" and nothing! It's not even indexed...
      {{ DiscussionBoard.errors[361838].message }}
  • Profile picture of the author Kaari
    Ok my site has been indexed now. I don't know why or how but thanks for all the tips, guys I learned a few new things today!
    {{ DiscussionBoard.errors[362444].message }}
  • Profile picture of the author milamber
    Always welcome kaari. Keep exploring WF to learn more
    {{ DiscussionBoard.errors[363330].message }}

Trending Topics