[KinoSearch] Merging indexes, etc

henka at cityweb.co.za henka at cityweb.co.za
Tue Oct 17 23:56:05 PDT 2006



Hello all,

I was wondering about the following and would appreciate any comments.

1.  Would the master index survive an interrupted
$iv->add_invindexes($a,$b,...), and be receptive to further
add_invindexes()s without a problem?  If not, how can it be resolved?


2.  The docs aren't specific:  I presume one can
$iv->delete_docs_by_term($term) on the same $iv as the one being operated
on with add_invindexes()?  I've encountered no errors so far, but was
wondering.


3.  During a merge operation of many temp indexes into a master index, if
no call is made to add_invindexes() before a finish() (maby because of an
empty/invalid temp index, etc), it generates an error (sorry, busy with a
run at the moment, so will paste sample error later).  I've recoded the
logic to side-step the error (ie, don't finish() if nothing is added), but
I wonder if this might have any repercussions (ie, calling "my $iv =
KinoSearch::InvIndexer->new(...)" on the same index without calling
finish() in a loop).


4.  What's a good test to detect a bad/invalid/broken temp index?  At the
moment I just check if the "segments" file exists and is non-zero. 
However, the segments file *will* exist if a temp index run is interrupted
- what other files *shouldn't* exist (and indicate a temp index which is
half-baked) so that I can refine the temp index validation?

Thanks


_______________________________________________
KinoSearch mailing list
KinoSearch at rectangular.com
http://www.rectangular.com/mailman/listinfo/kinosearch




More information about the kinosearch mailing list