indexed still going down for this week

[badawidollah]

RewriteEngine On

RewriteBase /forum/

RewriteCond %{HTTP_HOST} !^www\.nusantaraku\.org
RewriteRule (.*) http://www.nusantaraku.org/forum/$1 [L,R=301]

RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

RewriteRule ^/?(af|sq|ar|be|bg|ca|zh-CN|hr|cs|da|nl|en|et|tl|fi|fr|gl|de|el|iw|hi|hu|is|id|ga|it|ja|ko|lv|lt|mk|ms|mt|no|fa|pl|pt|ro|ru|sr|sk|sl|es|sw|sv|zh-TW|th|tr|uk|vi|cy|yi)/$ vbenterprisetranslator_seo.php?vbet_lang=$1&redirected=/forum/index.php [L,QSA]
RewriteRule ^/?(af|sq|ar|be|bg|ca|zh-CN|hr|cs|da|nl|en|et|tl|fi|fr|gl|de|el|iw|hi|hu|is|id|ga|it|ja|ko|lv|lt|mk|ms|mt|no|fa|pl|pt|ro|ru|sr|sk|sl|es|sw|sv|zh-TW|th|tr|uk|vi|cy|yi)/(.*)?$ vbenterprisetranslator_seo.php?vbet_lang=$1&redirected=/forum/$2 [L,QSA]

RewriteCond %{REQUEST_URI} !(admincp/|modcp/|vbseo_sitemap/|cron)
RewriteRule ^((archive/)?(.*\.php(/.*)?))$ vbenterprisetranslator_seo.php [L,QSA]

RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{REQUEST_FILENAME} !^(admincp|modcp|clientscript|cpstyles|images)/
RewriteRule $ vbenterprisetranslator_seo.php [L,QSA]

RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron|vbseo_sitemap)
RewriteRule ^((archive/)?(.*\.php(/.*)?))$ vbseo.php [L,QSA]

RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{REQUEST_FILENAME} !/(admincp|modcp|clientscript|cpstyles|images)/
RewriteRule ^(.+)$ vbseo.php [L,QSA]

is it correct?

and for url in sitemap
which one must choose,

/en/ or ?language=en

i am using default one now, but adding this below <?php
because cant run without this code

require_once(DIR. '/includes/vbenterprisetranslator_functions_vbseo.php');
define('DIR', dirname(__FILE__).'/../');

Sitemap stats
Total URLs: 331,647
Indexed URLs: 9,047

thanks

[vBET]

is it correct?

and for url in sitemap
which one must choose,

i am using default one now, but adding this below <?php
because cant run without this code





thanks

Your rules looks OK. Please check readme.html in vBET package and see what changes in vBSEO files you have to do. I see that link which you gave still have double redirect (you can see it i.e. in Opera).

About your change in Sitemap Generator file - use one for /en/
Also require_once -where are you adding it - in which file? I can see that it is wrong, because DIR is defined after it is used - you have it in wrong file. Please see here for Sitemap Generator integration:
http://www.vbenterprisetranslator.co...tegration.html

Please fallow precisely integration instructions for vBSEO and Sitemap Generator. If you are not sure which steps you done and which not - just start from original files and do the changes again but precisely.
If you feel like it is trouble for you we can offer you this integration as Upgrade Service ($30).

Also if all links which you have in your sitemap are like this one which you gave, this can be the reason of your issues - wrong Sitemap integration. Please note that the link which you gave is broken - there is no title included. Does original links (without language code) are also broken? Please PM me your full sitemap content.

[badawidollah]

vbseo_sitemap_functions.php modified.

<?php
require_once(DIR. '/includes/vbenterprisetranslator_functions_vbseo.php');

vbseo_log_entry("[showthread] forum_id: $forumid, thread_id: $threadrow[threadid], total posts: $totalposts, pages: $totalpages, views: $threadrow[views] $prior");
//additional code
$alanguages = array ('ar','zh-CN','en','ms','ru','th');
if(!$archived) {
$strlenhost = strlen($vbseo_vars['bburl']."/");
$currentthreadurl = vbseo_url_thread($threadrow, 1, $archived);
$currentthreadurl_before = substr($currentthreadurl,0,$strlenhost);
$currentthreadurl_after = "/".substr($currentthreadurl,$strlenhost);
$lastpost =& $threadrow['lastpost'];
$vbseo_stat['t'] += sizeof($alanguages);
foreach($alanguages as $language) {
vbseo_add_url($currentthreadurl_before.$language.$currentthreadurl_after, $prior, $lastpost, $freq);
}
}
//end additional code

for($p=1; $p<=$totalpages; $p++)

my default is "id"
thanks

** i am using vbseo sitemap generator 2.6 beta 1
i am using sample /en/address
my users down 15%

[vBET]

This looks OK right now. Also please PM me your actual sitemap result files - as I wrote link which you gave before looks broken (no title included) I would like to see does it still happens and if yes then does for original links also. In such case I will check it on your side and fix it.

NOTE: you still have double redirect - please integrate vBSEO appropriately. You unnecessarily loose performance.

[badawidollah]

URLs not followed
When we tested a sample of URLs from your Sitemap, we found that some URLs redirect to other locations. We recommend that your Sitemap contain URLs that point to the final destination (the redirect target) instead of redirecting to another URL.
HTTP Error: 301
URL: Go to URLhttp://www.nusantaraku.org/forum/ru/obat-obatan-dan-farmasi/116222-pintar-membaca-obat.html
Problem detected on: Apr 16, 2010

** now i remove vbet from sitemap.
my google index still going down

Results 1 - 10 of about 79,200 from nusantaraku.org. (0.10 seconds)

[vBET]

I see that you do not have double redirections anymore - it will save you performance. I also see that your links for translated pages in sitemap are not broken anymore.

As I wrote at the beginning we do not believe that your sitemap content has anything to do with your pages disappearing from index. 1st - Google just doesn't react so fast so it is not reaction on your sitemap; 2nd - sitemap has nothing to do with pages removed from index, sitemap simply shows what you would like to have indexed and does nothing more.
So removing translated URLs from sitemap will not solve the issue. It will make Google warnings about 301 redirect disappear. Please note that Google will know and index your translated pages anyway. Google will find links to it directly on your forum, but indexing it can take more time that if they are in sitemap.

Please keep in mind that you added new entries to robots.txt and blocked some pages. So those blocked pages will and should be removed from Google index. In Google webmaster tools you can even check exactly which URLs are blocked by robots.txt (please note that those data are not up do date - those are updated periodically).

Also please think what other changes you did on your forum. You wrote that you changed names of over 50% of forums. It shouldn't be reason if you have 301 redirect - still it is only shouldn't. Please think did you also changed some privileges on forum? If you blocked access to some forums for guests, then definitively this can be reason. Please remember that Google see your forum as guest. If you blocked some content then on pages which was previously indexed Google see same communicate about not enough privileges. And in such case remove those form index as duplication of content (all blocked pages are the same). Please remember that I'm writing here about blocking by vB privileges not by robots.txt which can also be the reason.

One more time - think what other changes was made on your forum in last 2 months.

Also - are you able to determine which of your pages disappear from index? Maybe disappears only those which you blocked by robots.txt and we have no issue at all. If you are able to write some robot which will collect your actual links displayed by Google and compare differences between one harvesting and another, then you could see what is missing (I do not know does Google gives some ready solution).

And there is one more thing - please keep in mind that in searching results Google shows only approximated number of results. And Google is changing his algorithms and cache all the time. So please keep in mind that numbers shown in searching results are not real and those can change (giving better or worst approximation) even if you have still same pages indexed. Of course in your case pages are really disappearing, because you blocked some in robots.txt

[badawidollah]

index going up and back to normal.
no more redirection