[KinoSearch] Index size
Marvin Humphrey
marvin at rectangular.com
Wed Oct 18 23:36:11 PDT 2006
On Oct 18, 2006, at 6:29 PM, Chris Nandor wrote:
> At 16:43 -0700 2006.10.18, Marvin Humphrey wrote:
>> Something is wrong. Either segments are not being merged away often
>> enough, or old, unused segment files are not being deleted.
>
> I was thinking the latter was most likely.
>
> $ ls -l invindex/ | wc -l
> 6973
> $ ls -l invindex/_*.cfs | wc -l
> 12
> $ ls -l invindex/_*.f* | wc -l
> 6948
The .f* files are temporary, one per indexed field, and they should
be cleaned up at the end of each session. I surprised that they are
still around.
I'd still like to know how many fields you have. It would be useful
to know if the problem is that .f* files in particular aren't being
deleted, or that you have a lot of fields and it's whole segments
that aren't being deleted.
> I just realized I had code (which I found out Monday I didn't need) to
> maintain two indexes, and I was copying files back and forth, which
> (duh!)
> copied the deleted files back and forth. But then I discovered I
> didn't
> need to update a non-live index, since it safely updates the live
> index.
>
> So, rather than fixing my code, I'll just pull it and update the
> live index
> instead.
Glad you've found a fix.
Marvin Humphrey
Rectangular Research
http://www.rectangular.com/
_______________________________________________
KinoSearch mailing list
KinoSearch at rectangular.com
http://www.rectangular.com/mailman/listinfo/kinosearch
More information about the kinosearch
mailing list