[KinoSearch] Index size

Marvin Humphrey marvin at rectangular.com
Wed Oct 18 23:36:11 PDT 2006




On Oct 18, 2006, at 6:29 PM, Chris Nandor wrote:

> At 16:43 -0700 2006.10.18, Marvin Humphrey wrote:
>> Something is wrong.  Either segments are not being merged away often
>> enough, or old, unused segment files are not being deleted.
>
> I was thinking the latter was most likely.
>
> $ ls -l invindex/ | wc -l
>    6973
> $ ls -l invindex/_*.cfs | wc -l
>      12
> $ ls -l invindex/_*.f* | wc -l
>    6948

The .f* files are temporary, one per indexed field, and they should  
be cleaned up at the end of each session.  I surprised that they are  
still around.

I'd still like to know how many fields you have.  It would be useful  
to know if the problem is that .f* files in particular aren't being  
deleted, or that you have a lot of fields and it's whole segments  
that aren't being deleted.

> I just realized I had code (which I found out Monday I didn't need) to
> maintain two indexes, and I was copying files back and forth, which  
> (duh!)
> copied the deleted files back and forth.  But then I discovered I  
> didn't
> need to update a non-live index, since it safely updates the live  
> index.
>
> So, rather than fixing my code, I'll just pull it and update the  
> live index
> instead.

Glad you've found a fix.

Marvin Humphrey
Rectangular Research
http://www.rectangular.com/



_______________________________________________
KinoSearch mailing list
KinoSearch at rectangular.com
http://www.rectangular.com/mailman/listinfo/kinosearch




More information about the kinosearch mailing list