[KinoSearch] HeatMap->hot_to_cold

[Marvin Humphrey]

On Wed, May 06, 2009 at 12:34:35PM -0700, webmasters at ctosonline.org wrote:

> BTW, what is ‘real-time indexing’? 

Making it possible for index updates to be visible almost immediately.  

The solution has two componenents.  First, making opening a Searcher cheap by
using mmap for accessing large data structures rather than reading lots of
stuff into process memory caches at Searcher startup.  Second, making it
possible to insert new records while merging/optimization proceeds
simultaneously in a background process.

> (One problem I’ve come across is that  
> I can’t modify a document once I’ve added it to the index within the  
> same indexing session [or can I?].)

That's a different problem.  It would be addressed by buffering deletions and
applying them only at the end of the indexing session.  Changing that behavior
isn't a high priority for me right now, though.

Marvin Humphrey