Only 1 URL index, 424 submitted?

9 years ago

Originally Posted by jsmith2482

Was looking in my webmaster tools the other day and I see that only 1 url is in google's index yet 424 were submitted? I'm slightly confused as it has been this way for awhile. Not sure what to do next?

How old is the site?

Have you set a noindex tag to the pages by mistake with an SEO plugin?

Is the content unique?

Have you fetched your site using GWT fetch tool?

Have you blocked something in error with robots.txt or .htaccess?

Have you checked your server logs for crawl errors?

Thanks
1 reply

Signature

{{ DiscussionBoard.errors[10024385].message }}

jsmith2482

9 years ago

The site is 1 year old

I use all in one seo pack so I did not set a noindex tag

content is 100% unique

I have fetched it a few times

Nothing was blocked on my end

There are no crawl errors

I get two sitemap errors though

-When we tested a sample of the URLs from your Sitemap, we found that some URLs were not accessible to Googlebot due to an HTTP status error. All accessible URLs will still be submitted.

2-Some URLs listed in this Sitemap have a high response time. This may indicate a problem with your server or with the content of the page.

Any idea?

I have worked on my response time and have drastically improved it and other pagespeed factors

Thanks
1 reply

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10024401].message }}

SEO Power

9 years ago

Originally Posted by jsmith2482

The site is 1 year old

I use all in one seo pack so I did not set a noindex tag

content is 100% unique

I have fetched it a few times

Nothing was blocked on my end

There are no crawl errors

I get two sitemap errors though

-When we tested a sample of the URLs from your Sitemap, we found that some URLs were not accessible to Googlebot due to an HTTP status error. All accessible URLs will still be submitted.

2-Some URLs listed in this Sitemap have a high response time. This may indicate a problem with your server or with the content of the page.

Any idea?

I have worked on my response time and have drastically improved it and other pagespeed factors

If you haven't blocked any URLs via your robots.txt file and your content is unique, all you need do is wait. It takes time to index 400+ urls and Google doesn't guarantee that all your urls will be indexed. Make sure you've implemented proper internal linking for faster crawling.

Thanks
1 reply

Signature

ONE HOUR INDEXING - STOP WASTING MONEY ON LINKS GOOGLE NEVER FINDS

{{ DiscussionBoard.errors[10024530].message }}

jsmith2482

9 years ago

Originally Posted by SEO Power

If you haven't blocked any URLs via your robots.txt file and your content is unique, all you need do is wait. It takes time to index 400+ urls and Google doesn't guarantee that all your urls will be indexed. Make sure you've implemented proper internal linking for faster crawling.

I have proper internal linking and have been waiting for about 4 months to get more than 1 url indexed

Thanks
2 replies

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10025244].message }}

Tim3 9 years ago

Originally Posted by jsmith2482

I have proper internal linking and have been waiting for about 4 months to get more than 1 url indexed

Another thought just occurred,
It looks like you know what you are doing, but are your canonicals correct?
- Thanks
Signature
{{ DiscussionBoard.errors[10025757].message }}
yukon Banned 9 years ago

Originally Posted by Tim3

Have you set a noindex tag to the pages by mistake with an SEO plugin?

Originally Posted by jsmith2482

I use all in one seo pack so I did not set a noindex tag

You'll need to do better than that...

View the problem live page HTML source code in your browser & verify there's not a noindex tag on the page/s.

Originally Posted by jsmith2482

I have proper internal linking and have been waiting for about 4 months to get more than 1 url indexed

You're wasting time because there's no possible way it takes 4 months to index a webpage on Google SERPs unless you're blocking Googlebot from your page.
- Thanks
{{ DiscussionBoard.errors[10025799].message }}

Tim3

9 years ago

Hmm,
I haven't come across that problem before, but others have, trying searching this in quotes...
"Sitemap, we found that some URLs were not accessible to Googlebot due to an HTTP status error"

Have you got Adsense on your site? if try putting an ad in the sidebar, or if not a some related YT video, see if Big G picks that up.

Thanks

Signature

{{ DiscussionBoard.errors[10024437].message }}

SEWARRIOR

9 years ago

1. check you site navigation is proper from homepage to deep page
2. may be tweet your links, try some 20 links in tweet and see if they get crawled or nor
3. Also google index quickly from social signal than webmaster tool. so try social signal for indexing

Thanks

{{ DiscussionBoard.errors[10026737].message }}

jsmith2482

9 years ago

The site is The Physique Formula Diet.

I have no idea how or why Googlebot would be blocked. I NEVER blocked it myself and I do not have any webmaster. How would I check to see if it's blocked?

Thanks
1 reply

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10026800].message }}

yukon

Banned 9 years ago

Originally Posted by jsmith2482

The site is The Physique Formula Diet.

I have no idea how or why Googlebot would be blocked. I NEVER blocked it myself and I do not have any webmaster. How would I check to see if it's blocked?

Looks like a problem on your end because I seriously doubt Google would index a robots.txt file If they had a problem with your domain.

site:www.physiqueformuladiet.com

Plus, your Home page was cached yesterday (4/26/2015).

Thanks

{{ DiscussionBoard.errors[10026816].message }}

AndresNWD

9 years ago

Seems totally weird.
I don't think it is related but is this sitemap ok? http://physiqueformuladiet.com/sitemap.xml I've never seen one like this before.

Thanks
1 reply

{{ DiscussionBoard.errors[10026831].message }}

yukon

Banned 9 years ago

Originally Posted by AndresNWD

Seems totally weird.
I don't think it is related but is this sitemap ok? http://physiqueformuladiet.com/sitemap.xml I've never seen one like this before.

That's a typical Wordpress Arne Brachhold plugin xml sitemap.

[edit]

All the pages in that xml sitemap are dead links. That xml sitemap is useless.

Example:

http://physiqueformuladiet.com/sitemap-pt-post-2013-10.xml

Thanks
1 reply

{{ DiscussionBoard.errors[10026845].message }}

jsmith2482

9 years ago

So you're saying get rid of the site map plugin and use another one?

Are you saying all the page in MY sitemap are dead?

Originally Posted by yukon

That's a typical Wordpress Arne Brachhold plugin xml sitemap.

[edit]

All the pages in that xml sitemap are dead links. That xml sitemap is useless.

Example:

http://physiqueformuladiet.com/sitemap-pt-post-2013-10.xml

Thanks
1 reply

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10027526].message }}

yukon Banned 9 years ago

Originally Posted by jsmith2482

So you mean google acknowledged those specific pages yesterday?

Yes,

Caching & SERP updating aren't always done on the same dates but the Google cache date is still proof Google has returned to the page/URL.

Originally Posted by jsmith2482

So you're saying get rid of the site map plugin and use another one?

Are you saying all the page in MY sitemap are dead?

Fix the sitemap or remove it, no point in having 404 pages.
- Thanks
{{ DiscussionBoard.errors[10031726].message }}

yukon

Banned 9 years ago

Here's an internal page indexed & cached yesterday (4/26/2015), I'm not sure why it doesn't show up while doing a full site search.

[edit]

Here's another random internal page cached yesterday (4/26/2015).

Thanks
1 reply

{{ DiscussionBoard.errors[10026836].message }}

jsmith2482

9 years ago

So you mean google acknowledged those specific pages yesterday?

Originally Posted by yukon

Here's an internal page indexed & cached yesterday (4/26/2015), I'm not sure why it doesn't show up while doing a full site search.

[edit]

Here's another random internal page cached yesterday (4/26/2015).

Thanks

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10027524].message }}

Tim3

9 years ago

Your site has 562 indexed pages in Google.com and .co.uk. so there is no problem as far as I can see.

I recall having a problem with a sitemap plug-in too, that is now in the trash, suggest you build and submit my own using an online XML tool, end of problem.

Thanks
1 reply

Signature

{{ DiscussionBoard.errors[10026901].message }}

yukon

Banned 9 years ago

Originally Posted by Tim3

Your site has 562 indexed pages in Google.com and .co.uk. so there is no problem as far as I can see.

I recall having a problem with a sitemap plug-in too, that is now in the trash, suggest you build and submit my own using an online XML tool, end of problem.

WHOA, now that's some weird stuff.

I did a site: search a few minutes ago for OPs entire site & the only page showing was the sitemap file. Now I see 490 pages indexed. I tested both www & non-www on the site: search earlier, same results (nothing).

If it was my site I would defiantly keep an eye on that site: search for a while.

OP, fix that xml sitemap. There's also 2 404 pages on your site (run Screaming Frog & sort by error code column).

Thanks
1 reply

{{ DiscussionBoard.errors[10026921].message }}

Tim3

9 years ago

Originally Posted by yukon

WHOA, now that's some weird stuff.

I did a site: search a few minutes ago for OPs entire site & the only page showing was the sitemap file. Now I see 490 pages indexed. I tested both www & non-www on the site: search earlier, same results (nothing).

Strange indeed,
I wonder if when you checked first, there was some sort of algo sorting/updating going in Big G's box of tricks but when I checked the updating was resolved and displaying the latest crawl results.

Thanks

Signature

{{ DiscussionBoard.errors[10026948].message }}

jsmith2482

9 years ago

Here's what webmaster tools tells me.

1-When we tested a sample of the URLs from your Sitemap, we found that some URLs were not accessible to Googlebot due to an HTTP status error. All accessible URLs will still be submitted.

2-Some URLs listed in this Sitemap have a high response time. This may indicate a problem with your server or with the content of the page.

Thanks

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10027530].message }}

AndresNWD

9 years ago

This thread can be used as an SEO audit manual. Thanks Yukon.

Thanks

{{ DiscussionBoard.errors[10031471].message }}

yukon

Banned 9 years ago

There's still an issue with OPs site, he needs to decide If he wants to use www or non-www for indexing pages. Pick one & stick with it.

site:physiqueformuladiet.com (490 pages indexed)
site:www.physiqueformuladiet.com (1 page indexed)

Thanks
1 reply

{{ DiscussionBoard.errors[10031720].message }}

jsmith2482

9 years ago

Originally Posted by yukon

There's still an issue with OPs site, he needs to decide If he wants to use www or non-www for indexing pages. Pick one & stick with it.

site:physiqueformuladiet.com (490 pages indexed)
site:www.physiqueformuladiet.com (1 page indexed)

Hey Yukon,
Thanks. Can you explain that? How would I pick one?

Thanks
1 reply

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10031918].message }}

yukon

Banned 9 years ago

Originally Posted by jsmith2482

Hey Yukon,
Thanks. Can you explain that? How would I pick one?

Just pick one & stick with it, especially for internal links. It doesn't matter which one you pick though you do have 99% of your pages currently indexed without www so personally I would stick to non-www for that domain/site.

Neither one matters (www vs non-www) as far as ranking pages but you need to stick to only one of them because as you can see it's a bit confusing for Google when listing pages in the SERPs.

Thanks
2 replies

{{ DiscussionBoard.errors[10032038].message }}

jsmith2482

9 years ago

Originally Posted by yukon

Just pick one & stick with it, especially for internal links. It doesn't matter which one you pick though you do have 99% of your pages currently indexed without www so personally I would stick to non-www for that domain/site.

Neither one matters (www vs non-www) as far as ranking pages but you need to stick to only one of them because as you can see it's a bit confusing for Google when listing pages in the SERPs.

Thanks. How do I "pick it" in google's eyes? How do I pick it in webmaster tools?

Also, how do I delete my sitemap in webmaster tools and what plugin do you suggest to build my new sitemap?

Thanks

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10032315].message }}

jsmith2482

9 years ago

Originally Posted by yukon

Just pick one & stick with it, especially for internal links. It doesn't matter which one you pick though you do have 99% of your pages currently indexed without www so personally I would stick to non-www for that domain/site.

Neither one matters (www vs non-www) as far as ranking pages but you need to stick to only one of them because as you can see it's a bit confusing for Google when listing pages in the SERPs.

Thanks, I figured out how to set the preference but Webmaster tools always moves the button back to "don't set preferred domain". It gives me this message
Part of the process of setting a preferred domain is to verify that you own http://physiqueformuladiet.com/. Please verify http://physiqueformuladiet.com/.

Yet it doesn't tell me how to verify that I own the url

Thanks
1 reply

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10042011].message }}

yukon

Banned 9 years ago

Originally Posted by jsmith2482

Thanks, I figured out how to set the preference but Webmaster tools always moves the button back to "don't set preferred domain". It gives me this message
Part of the process of setting a preferred domain is to verify that you own The Physique Formula Diet. Please verify The Physique Formula Diet.

Yet it doesn't tell me how to verify that I own the url

Did you copy/paste the Webmaster Tools verification code in your website HTML <head>?

Thanks
1 reply

{{ DiscussionBoard.errors[10042050].message }}

jsmith2482

9 years ago

Originally Posted by yukon

Did you copy/paste the Webmaster Tools verification code in your website HTML <head>?

Okay I figured out how to use the non-www. domain. But now I get 24 sitemap errors. I'm using the google XML sitemap which is the best reviewed in the wordpress plugin section.

Not sure what to do.

Here's the error
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit. General HTTP error 404 not found

Thanks
1 reply

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10042962].message }}

yukon

Banned 9 years ago

Originally Posted by yukon

That's a typical Wordpress Arne Brachhold plugin xml sitemap.

[edit]

All the pages in that xml sitemap are dead links. That xml sitemap is useless.

Example:

http://physiqueformuladiet.com/sitemap-pt-post-2013-10.xml

Originally Posted by jsmith2482

Okay I figured out how to use the non-www. domain. But now I get 24 sitemap errors. I'm using the google XML sitemap which is the best reviewed in the wordpress plugin section.

Not sure what to do.

Here's the error
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit. General HTTP error 404 not found

That's why I said to fix all the dead links in the xml sitemap.

Google eventually found them...

Thanks
1 reply

{{ DiscussionBoard.errors[10043208].message }}

jsmith2482 9 years ago

Originally Posted by yukon

That's why I said to fix all the dead links in the xml sitemap.

Google eventually found them...

Yes I understand that but it's not I created the dead links. I have NO idea how they are there.
- Thanks
Signature
six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only
{{ DiscussionBoard.errors[10044639].message }}

johnyjee

9 years ago

In order to index your page there must be unique content on the page. If your page has nothing other than URL and few duplicate content then Google will not bother to crawl your backlinks irrespective of how many times you submit your backlinks to Google.

Thanks
1 reply

Signature

SEO Company India BSolutions | Outsource SEO to India

{{ DiscussionBoard.errors[10031801].message }}

yukon

Banned 9 years ago

Originally Posted by johnyjee

In order to index your page there must be unique content on the page. If your page has nothing other than URL and few duplicate content then Google will not bother to crawl your backlinks irrespective of how many times you submit your backlinks to Google.

Stop the madness...

Even duplicate internal pages still get indexed on Supplemental SERPs. Traffic won't find those specific pages but they're still indexed.

Thanks

{{ DiscussionBoard.errors[10031810].message }}

AndresNWD

9 years ago

You just need to redirect from www to non-www. This guide should help:
regex - Generic htaccess redirect www to non-www - Stack Overflow

Thanks

{{ DiscussionBoard.errors[10039973].message }}

Hostnameclub

9 years ago

Hi,

Please check be careful. Sometimes we enabled both of Wordpress SEO by Yoast and Google XML Sitemap. Both of them has sitemap generator, and usually Google XML Sitemap works better, so you must disable Sitemap function from a Wordpress SEO by Yoast..

Thanks

{{ DiscussionBoard.errors[10043098].message }}

Jeff Willy

9 years ago

Have you tried any legit indexing service sites like Indexification or Lindexed to potentially index your website?

Thanks
1 reply

{{ DiscussionBoard.errors[10043319].message }}

jsmith2482 9 years ago

Originally Posted by Jeff Caceres

Have you tried any legit indexing service sites like Indexification or Lindexed to potentially index your website?

Nope, thought those were considered bad?
- Thanks
Signature
six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only
{{ DiscussionBoard.errors[10044647].message }}

jsmith2482

9 years ago

So I uploaded a NEW sitemap plugin and I STILL get the same error messages. Someone told me "just get rid of the error pages" and that's great but I have NO idea how the error pages were created and I can't find them on my server or in my site to delete.

For example
http://physiqueformuladiet.com/sitem...st-2013-11.xml

That open to a 404 page, I don't know how to delete that

Thanks

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10050197].message }}

jsmith2482

9 years ago

Hey All,
Still having the same issues. Any advice?
Thanks

Thanks
1 reply

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10057424].message }}

yukon Banned 9 years ago
Originally Posted by jsmith2482

Hey All,
Still having the same issues. Any advice?
Thanks

I see 569 pages indexed.
- site:physiqueformuladiet.com
The robots.txt file is still www.

...and still dead links on the xml sitemap.
- Thanks
- 1 reply
{{ DiscussionBoard.errors[10057461].message }}
- jsmith2482 9 years ago
  
  Originally Posted by yukon
  
  I see 569 pages indexed.
  
  site:physiqueformuladiet.com
  
  The robots.txt file is still www.
  
  ...and still dead links on the xml sitemap.
  
  That's just it, I do NOT know how to change the robots.txt file or get rid of the dead links. I've changed the sitemap plugin that I use but I have no idea how to fix it. What can I do?
  
  Thanks
  
  Signature
  six pack diet
  how to lose fat
  increase metabolism
  how to gain weight
  FREE fat loss report for warriors only
  
  {{ DiscussionBoard.errors[10058874].message }}

MikeFriedman

9 years ago

Just delete the sitemap and get rid of the sitemap plugin.

For a site of only 400 pages, you do not need a sitemap. If you do need one, that means your navigation is lousy.

Thanks
2 replies

Signature

The SEO Pub Forums

For SEO news, discussions, tactics, and more.

{{ DiscussionBoard.errors[10058890].message }}

deezn

9 years ago

Originally Posted by MikeFriedman

Just delete the sitemap and get rid of the sitemap plugin.

For a site of only 400 pages, you do not need a sitemap. If you do need one, that means your navigation is lousy.

Two things I always did was an XML sitemap because people said to for Google. Another was an HTML sitemap for visitors. I've stopped using both. Google will eventually find your pages as long as they are not orphaned.

Thanks
1 reply

{{ DiscussionBoard.errors[10059355].message }}

OmerFaruk 9 years ago

I think your xml sitemap is wrong.
- Thanks
- 1 reply
Signature

Hostgator is the world best hosting company. If you want to buy hostgator 1 cent hosting Package? Use Hostgator 1 Cent Coupon to save Dollar.
{{ DiscussionBoard.errors[10060158].message }}
- jsmith2482 9 years ago
  
  Originally Posted by OmerFaruk
  
  I think your xml sitemap is wrong.
  
  How do I fix it?
  
  Thanks
  
  Signature
  six pack diet
  how to lose fat
  increase metabolism
  how to gain weight
  FREE fat loss report for warriors only
  
  {{ DiscussionBoard.errors[10062974].message }}

jsmith2482

9 years ago

Originally Posted by MikeFriedman

Just delete the sitemap and get rid of the sitemap plugin.

For a site of only 400 pages, you do not need a sitemap. If you do need one, that means your navigation is lousy.

Delete the sitemap from webmaster tool?

Thanks
1 reply

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10062979].message }}

MikeFriedman 9 years ago

Originally Posted by jsmith2482

Delete the sitemap from webmaster tool?

Delete it off webmaster tools. Delete it from your site.

Get rid of every trace of a sitemap.
- Thanks
- 1 reply
Signature
The SEO Pub Forums

For SEO news, discussions, tactics, and more.
{{ DiscussionBoard.errors[10063024].message }}
- jsmith2482 9 years ago
  
  Originally Posted by MikeFriedman
  
  Delete it off webmaster tools. Delete it from your site.
  
  Get rid of every trace of a sitemap.
  
  Thanks.
  
  I'm still confused as to WHAT causes the error. It's not like I created those 404 pages. My site is only growing weekly and eventually I'll need a sitemap so how do I fix those errors?
  
  Thanks
  
  Signature
  six pack diet
  how to lose fat
  increase metabolism
  how to gain weight
  FREE fat loss report for warriors only
  
  {{ DiscussionBoard.errors[10064458].message }}

escapeadvertising

9 years ago

Are you checking from the webmaster tool?

Thanks
1 reply

Signature

SEO - Escape Advertising | SEO Services Dubai

{{ DiscussionBoard.errors[10060163].message }}

jsmith2482 9 years ago

Originally Posted by escapeadvertising

Are you checking from the webmaster tool?

Yes I am checking from webmaster tools. Why?
- Thanks
Signature
six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only
{{ DiscussionBoard.errors[10062971].message }}

Hudson White

9 years ago

You can generate and upload the sitemap xml as well as HTML again. Also, if you have done nay changes on your website then again submit your website for index in Google webmasters as Fetch as Google.

Thanks

{{ DiscussionBoard.errors[10060494].message }}

jsmith2482

9 years ago

Any idea how I'd get rid of the 404 error?

Thanks

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10062984].message }}

deepakrajput

9 years ago

You have not submit your website in right way OR you have added your website pages in your sitemap.xml file.

Thanks

Signature

Digital Marketing Consultant, Internet Marketing Expert

{{ DiscussionBoard.errors[10063223].message }}

jsmith2482

9 years ago

I just ran a google safe browsing diagnostic on my site. It gives a category titled "What happened when Google visited this site?"

The result
Google has not visited this site within the past 90 days.

I'd imagine that this means they aren't crawling my site and recognizing all the new articles I'm putting up.

Thanks

Signature

six pack diet
how to lose fat
increase metabolism
how to gain weight
FREE fat loss report for warriors only

{{ DiscussionBoard.errors[10121608].message }}

Only 1 URL index, 424 submitted?

Trending Topics

best high quality crypto traffic.

Some interesting stats about brand comms

Fixing a massive traffic drop after rebranding

Meta AI now has Google Search results

What's the Best IM-Related Skill to Learn Today That Can Help in the Future?