indexer: fix for term washing
13a42f102e95
Actions

Authored by Jan Aage Lavik <jan.age.lavik@cern.ch> on Mar 31 2015, 17:36.

Description

indexer: fix for term washing

FIX Avoids an exception from happening when passing a unicode string to the BibIndex engine washer. (closes #2981)

NOTE The lower_index_term() now returns the term as a Unicode string which can have an impact on custom tokenizers and regular indexing.

Co-authored-by: Eamonn Maguire <eamonn.maguire@cern.ch>
Signed-off-by: Jan Aage Lavik <jan.age.lavik@cern.ch>

Committed

Jan Aage Lavik <jan.age.lavik@cern.ch>

Apr 10 2015, 15:01

Parents

R3600:a56b10553cf9: global: unicode literal for admin views

Branches

Unknown

Tags

Unknown

Jan Aage Lavik <jan.age.lavik@cern.ch> committed R3600:13a42f102e95: indexer: fix for term washing (authored by Jan Aage Lavik <jan.age.lavik@cern.ch>).Apr 10 2015, 15:01

				Path
	M			invenio/legacy/bibindex/engine_washer.py
	A			invenio/modules/indexer/testsuite/test_indexer_engine_washer.py
	M			invenio/modules/indexer/tokenizers/BibIndexCJKTokenizer.py