Why are my pages not being indexed by Bing?

by rexjoec

Posted: 10 years ago 11 replies

I am working on a website that has over 89k pages, but when I check Bing Webmaster Tools there are only 460 pages indexed in Bing? The pages indexed have been like this for 2 years and I'm not sure why Bing is not indexing the pages?

Here is what I discovered so far:

We do have limitations on what search engines can crawl the website in the robots.txt file, but Bingbot and msnbot are not being blocked in the robot.txt file.
The on page meta tags include:
<meta name="Robots" content="INDEX,FOLLOW" /><meta name="Revisit-after" content="7 Days" />
The website is an https website.
Since there are so many pages, the sitemap is broken into multiple sitemaps and submitted to bing.
The pages do have back links going to them. Not many, but shouldn't the pages be indexed?
Here is what I see when I do a Bing Fetch: HTTP/1.1 200 OKConnection: Keep-AliveDate: Mon, 08 Sep 2014 19:07:52 GMTKeep-Alive: timeout=5, max=100Transfer-Encoding: chunkedContent-Type: text/html; charset=UTF-8Content-Encoding: gzipContent-Language: en,en-usServer: Oracle-Application-Server-11gSet-Cookie: ShopMarketingTracking=SM-1410203272764_207.46.13.51_Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm); expires=Tue, 08-Sep-2015 19:07:53 GMTSet-Cookie: JSESSIONID=qiVWqkfIngFBROEtFB9WOsi99wi3laK-Cpo2SqLo4UA5ETdSP7Br!-1482754256; path=/; HttpOnlySet-Cookie: BIGipServerpool.pw_web_carwize_8360=168578314.4023 4.0000; path=/Vary: User-Agent,Accept-EncodingX-Powered-By: Servlet/2.5 JSP/2.1
Google is able to index all our pages. Why can't Bing.

If anyone can give my some suggetions or clues on why Bing is having a hard time indexing the pages of this website, I would truly appreciate it.Thanks!

#bing #indexed #pages

rexjoec 10 years ago

One more thing, when using the Bing SEO Analyzer....when I analyze one of the URLs that are showing up in Google Index, but not Bing it gives an error message:

"Evaluated size of HTML is estimated to be over 125 KB and risks not being fully cached."

Could this be one of the reasons why Bing isn't indexing most of the web pages?
- Thanks
{{ DiscussionBoard.errors[9505179].message }}
InitialEffort 10 years ago

Bing is just really really really slow. That is the plain and simple part. Like don't be surprised if it takes months on non-news worthy pages.
- Thanks
Signature

--> [10,000+ SOLD] Rank Your Affiliate Website & Video [$1 MILLION PROOF INSIDE] <--
{{ DiscussionBoard.errors[9505243].message }}
rexjoec 10 years ago

Thanks. I'm not surprised if it takes Bing to Index pages, but its been over 2 years since these pages were live. I would assume that it would be quicker than that?
- Thanks
{{ DiscussionBoard.errors[9505279].message }}
UMS 10 years ago

Given that the amount of traffic you'd get from Bing would be very low compared to Google, I really wouldn't spend too much time worrying about it.
- Thanks
Signature

SECockpit - Get the world's most POWERFUL Keyword Research Tool for ONLY $1

Grab a LIFETIME Discount off Elegant Themes

Grab a LIFETIME 40% Discount off The Best Spinner
{{ DiscussionBoard.errors[9505411].message }}
laurencewins 10 years ago

I wouldn't worry about Bing at all. Google is the engine you need to focus on. It's the biggest grandaddy of them all nowadays.
- Thanks
- 1 reply
Signature

Cheers, Laurence.
Writer/Editor/Proofreader.
{{ DiscussionBoard.errors[9505966].message }}
- fastreplies 10 years ago
  
  Originally Posted by laurencewins
  
  I wouldn't worry about Bing at all. Google is the engine you need to focus on. It's the biggest grandaddy of them all nowadays.
  
  Just curious if you still going to have that "Google is the God" attitude if it finally say goodbye to PR?
  
  fastreplies
  
  Thanks
  
  1 reply
  
  Signature
  AMRAY Free Web Directory Since Year 2000
  AMRAY List of Top 50 Web Directories <> Best 5 Web Directories Reviews
  
  {{ DiscussionBoard.errors[9506268].message }}
  
  Kevin Maguire 10 years ago
  
  Originally Posted by fastreplies
  
  Just curious if you still going to have that "Google is the God" attitude if it finally say goodbye to PR?
  
  fastreplies
  
  Yeah, they'll use social signals instead. And Justin Beiber will be spot 1 "Buy Weed Online".
  
  Thanks
  
  {{ DiscussionBoard.errors[9506278].message }}
timbo333 10 years ago

I use a instant indexer it cost about $8 a month and about 60%+ get indexed almost straight away Ive been using it quite a bit and its boosted my rankings in just a few days
- Thanks
{{ DiscussionBoard.errors[9506145].message }}
Fkmdiscountcoupons 10 years ago

I also faced this situation in past & tried all things but no change & I left bing on his situation. Google is best
- Thanks
{{ DiscussionBoard.errors[9506448].message }}
rexjoec 10 years ago

I agree Google is best and I shouldn't worry about Bing. However, you all know from workplaces that you can't make your boss happy. He doesn't care about the Bing market share and is more concerned on the technical aspect of why Bing is only indexing 0.51% of our pages. I agreed with him that it is unusual and there must be a reason why Bing isn't indexing the pages.

One thing I noticed about the vast majority of pages is that they have useless and obsolete meta tags like the revisit-after, rating, distribution, author, and robots meta tags.

I saw these meta tags and didn’t say anything because I knew they were useless and I thought they weren’t doing any harm. However I've been reading that others feel that those tags may be hurting us in Bing and these useless tags that you think will be ignored might actually hurt your site.

For the robots tag, someone said that the search engines are going to crawl your site by default anyway if they have your URL. Explicitly telling them to INDEX or FOLLOW through the robots meta tag isn’t going to increase your chances of getting indexed, so don’t do it. It just might piss them off.

Do you think these useless tags are a reason why Bing isn't indexing my website's pages?
- Thanks
{{ DiscussionBoard.errors[9507709].message }}
melvinsh 10 years ago

I had to put in a support ticket after my new site was flagged somehow but they resolved quickly after I informed them it was not being indexed.
- Thanks
Signature
Syndr.com - Social Media Syndication - stop buying fake shares & likes! Get Real Shares from Onlywire & Sendible users managing their own social profiles! Drip feed - Anonymous Shares - Spun Content - View Reports - FREE Accounts - 45+ Social Networks - Take The Tour

Wanna run a successful Giveaway? SKYPE: Justin.chasar I can get you 1000s of real subscribers, facebook likes, etc. in days
{{ DiscussionBoard.errors[9508099].message }}