Lucene: Status=Open

4.3 hours ago 40 comments 0 votes 0 watches github-actions[bot], goankur, gsmiller, iprithv, jimczi, michaeljmarshall, mikemccand, navneet1v, neoremind, uschindler

Description The power-of-two back off in MemorySegmentIndexInput.prefetch() assumes consecutive ... This assumption works well for files that are already warm, but is too aggressive when files are ... The proposed solution makes two primary changes: 1.

neoremind 4.3 hours ago:	Thanks @goankur for the real-workload benchmarking! +1 on @gsmiller's neat and smart idea of starting consecutiveHits at N-1! A warm file just does one probe and goes directly to sampling mode without unnecessary ramp, a cold ...
goankur 19.3 hours ago:	@gsmiller I ran your N - 1 variant on f6b3392 next to start-at-N, same setup and same session: ... For reference, f6b3392 as is was −18% with 15 query types slower. N - 1 is as good as starting at N on hot data and a bit better on a cold start: it catches cold ...

#16849 PR: Make BitSetIterator#docIDRunEnd linear

5.4 hours ago 19 comments 0 votes 0 watches costin, github-actions[bot], jimczi, kkewwei

Since #16072, BitSetIteratordocIDRunEnd scans to the next clear bit on every call. This becomes a problem on long runs of bits which are rescanned on every window (e.g. DenseConjunctionBulkScore whenever the segment has deletions).

jimczi 13.1 hours ago:	LGTM
costin 1.2 days ago:	Thanks for the feedback folks; I've updated the code accordingly.

#16805 PR: Collector manager join

6.6 hours ago 25 comments 0 votes 0 watches github-actions[bot], javanna, mkhludnev, msokolov

I took another stab at cutting over the usage in the join package from Collector to CollectorManager ... It seems to pass all the tests, but I don't have a high degree of confidence - the testing in this ... I wonder if anyone who uses this stuff could try this out and give some idea of performance impact? ...

mkhludnev 6.6 hours ago:	@msokolov do you think it's worth to add join harness into benchmarks? I can make a try.
msokolov 4 days ago:	Let me summarize the changes here. The main idea is to cut over all the single-threaded Collectors used in the join module to use ... The join module is gathering join keys and scores across matching documents in order to generate a ...

#16851 PR: Use PriorityQueue#addAll instead of PriorityQueue#add.

17.7 hours ago 0 comments 0 votes 0 watches github-actions[bot], vsop-479

Description <!-- If this is your first contribution to Lucene, please make sure you have reviewed the ...

#16857 PR: Consolidate Sort pruning logic

1.2 days ago 1 comments 0 votes 0 watches github-actions[bot], romseygeek

Whether or not to use index-sort based early termination or index-value based sort pruning is ... This change consolidates these decisions into segment-level logic centred on FieldValueHitQueue, ... In addition, the deprecated methods on SortField that allow users to disable pruning are removed ...

romseygeek 1.2 days ago:

I ran benchmarks for this change and they showed no significant difference. This is mainly about making future changes easier: ` ┌──────────────────────────────────────── ...