Re: solr index problem

On 18-Jul-07, at 2:58 PM, Yonik Seeley wrote:

> On 7/18/07, Mike Klaas <mike.klaasgmail.com> wrote:
>>
>> Could happen when doDeleting the pending docs too. 
James: try
>> sending commit every 500k docs or so.
>
> Hmmm, right... some of the memory usage will be related
to the treemap
> keeping track of deleted items, and some of it will be
related to the
> reader itself (the term index, and the norms).
>
> Perhaps we should have some sort of limit on the number
of deletions
> we cache so people don't have to worry about that
part.

I logged this in http://
issues.apache.org/jira/browse/SOLR-310

Perhaps a solrconfig.xml setting, <maxPendingDocs>?
Default to 100k?

I have experienced this from time to time... it is one of
the reasons  
I fastidiously wipe the index and restart solr before
reindexing.

-Mike