gnes.indexer.doc.leveldb module¶
-
class
gnes.indexer.doc.leveldb.
AsyncLVDBIndexer
(data_path, keep_na_doc=True, drop_raw_bytes=False, drop_chunk_blob=False, *args, **kwargs)[source]¶ Bases:
gnes.indexer.doc.leveldb.LVDBIndexer
-
add
(keys, docs, *args, **kwargs)[source]¶ adding new docs and their protobuf representation
Parameters: - keys (
List
[int
]) – list of doc_id - docs (
List
[Document
]) – list of protobuf Document objects
- keys (
-
train
(*args, **kwargs)¶ Train the model, need to be overrided
-
-
class
gnes.indexer.doc.leveldb.
LVDBIndexer
(data_path, keep_na_doc=True, drop_raw_bytes=False, drop_chunk_blob=False, *args, **kwargs)[source]¶ Bases:
gnes.indexer.base.BaseDocIndexer
-
add
(keys, docs, *args, **kwargs)[source]¶ adding new docs and their protobuf representation
Parameters: - keys (
List
[int
]) – list of doc_id - docs (
List
[Document
]) – list of protobuf Document objects
- keys (
-
train
(*args, **kwargs)¶ Train the model, need to be overrided
-