0

I am trying to get all documents from Lucene Index (which is already not deleted ).

I heard that if I delete something from Lucene Index, Lucene will not delete immediately from file.

So I wanted to get the documents from Index file which is not deleted.

Politank-Z
  • 3,653
  • 3
  • 24
  • 28
Shankar
  • 8,529
  • 26
  • 90
  • 159
  • possible duplicate of [Is it possible to iterate through documents stored in Lucene Index?](http://stackoverflow.com/questions/2311845/is-it-possible-to-iterate-through-documents-stored-in-lucene-index) – Alexander Kuznetsov Jun 10 '15 at 08:08

2 Answers2

3

Lucene provides a bitset of all non-deleted documents, called liveDocs. You can get it by iterating over all LeafReaders (or using the SlowCompositeReaderWrapper) and calling the liveDocs method or by using the MultiFields class.

Once you have this bitset, you can iterator from 0 to IndexReader#maxDoc and consult the bitset to know whether a docid is representing a deleted document or a live one. You can access all stored fields of a deleted document just as you would from a live one.

However, once a segment gets merged, its deleted documents are permanently deleted and thus removed from the index.

knutwalker
  • 5,924
  • 2
  • 22
  • 29
  • Thanks @knutwalker.. merging the segments worked for me. – Shankar Jun 10 '15 at 12:34
  • These days (Lucene 8.x and later) the `MultiBits#getLiveDocs()` returns the bits that can be used to check whether doc ID belongs to a live doc. – Vlad Jan 11 '23 at 17:58
1

It's not possible. When you delete a document from Lucene index it is not immediately deleted because reconstruct all index is so expensive. This old document is flagged to be definitively removed on an index optimize. But it's not visible anymore. It's just visible internally to Lucene. If you remove a document and commit it never could be get anymore.

Bruno dos Santos
  • 1,361
  • 1
  • 12
  • 21