vBET 3.4.1
vBSEO 3.6
vBulletin 3.6.8
vBSEO Sitemap
I integrated vBET with vBSEO Sitemap and the URLs generated in sitemap increased significantly because of additional languages. However Google refuses to index most of them on web with the following message sent to me on my Webmaster Tool:
As a result, while with vBET I submitted much more URLs than before (661,934) to Google through sitemap, Google rejected most of them and only indexed 44,506 of them.Googlebot found an extremely high number of URLs on your site: http://xxxx.com/
Googlebot encountered problems while crawling your site http://xxxx.com/.
Googlebot encountered extremely large numbers of links on your site. This may indicate a problem with your site's URL structure. Googlebot may unnecessarily be crawling a large number of distinct URLs that point to identical or similar content, or crawling parts of your site that are not intended to be crawled by Googlebot. As a result Googlebot may consume much more bandwidth than necessary, or may be unable to completely index all of the content on your site.
More information about this issue
Here's a list of sample URLs with potential problems. However, this list may not include all problematic URLs on your site.
(note: the sample URLs listed are the foreign language URLs(such as http://xxx.com/forums/no/something-something.html) and they are working URLs, NOT broken URLs).
The detailed message that explains why Google did not index those URLs is like the following:
Shouldn't Google index more of my URLs if not all? I read on this forum the good stories about vBET increasing the indexed URLs on web, thus bringing in additional traffic. This has not happened to me.URLs not followed
When we tested a sample of URLs from your Sitemap, we found that some URLs redirect to other locations. We recommend that your Sitemap contain URLs that point to the final destination (the redirect target) instead of redirecting to another URL.
HTTP Error: 301
URL:
http://xxx.com/forums/sl/blah-blah-b...er-sample.html
Problem detected on: Aug 18, 2011
How to fix my problem?




Reply With Quote
