Diffusion invenio-infoscience (master) History

R3600/modules/bibindex/lib/bibindex_engine.py
master722057b107e45c6e8249e8c…

Nov 4 2013

BibIndex: filetype and itemcount tokenizer fix
722057b107e4
·Grzegorz Szpura / Tibor Simko on Nov 4 2013, 11:06.

Oct 18 2013

BibIndex: new index 'filetype'
53f4d452135b
·Grzegorz Szpura / Tibor Simko on Oct 18 2013, 15:14.
BibIndex: new index 'itemcount'
fc4067d15b19
·Grzegorz Szpura / Tibor Simko on Oct 18 2013, 11:26.
BibIndex: tokenisation of authority records
1d8b7e2539d9
·Grzegorz Szpura / Tibor Simko on Oct 18 2013, 11:13.

Oct 14 2013

BibAuthority: initial release
f5969cf4bd6e
·Christopher Dickinson / Tibor Simko on Oct 14 2013, 18:09.

Oct 3 2013

BibIndex: pluginutils for tokenizers
ab532de38f71
·Grzegorz Szpura / Tibor Simko on Oct 3 2013, 23:08.
BibIndex: centralisation of tokenizers
b0a11546ca41
·Grzegorz Szpura / Tibor Simko on Oct 3 2013, 23:08.
BibIndex: centralisation of LaTeX/HTML treatment
0bf927bd7e2c
·Grzegorz Szpura / Tibor Simko on Oct 3 2013, 23:08.
BibIndex: centralisation of stopword treatment
0a0c87e59ed6
·Grzegorz Szpura / Tibor Simko on Oct 3 2013, 23:08.
BibIndex: centralisation of synonym treatment
b6c6a0d3dfc4
·Patrick Glauner / Tibor Simko on Oct 3 2013, 23:08.

Jul 11 2013

Merge branch 'maint-1.1'
04d0d0ca2c6f
·Tibor Simko on Jul 11 2013, 09:53.

Jul 9 2013

BibIndex: synonym indexing speed up
cb570a2cecd7
·Tibor Simko on Jul 9 2013, 19:30.

Apr 12 2013

Merge branch 'maint-1.1'
bed633b799f8
·Tibor Simko on Apr 12 2013, 15:14.

Apr 9 2013

BibIndex: use human friendly index name
84fd52accf36
·Jan Aage Lavik / Tibor Simko on Apr 9 2013, 16:02.

Jan 21 2013

BibIndex: fix for external fulltext indexing
00e6d86b236c
·Patrick Glauner / Tibor Simko on Jan 21 2013, 20:46.

Jan 16 2013

BibDocFile: new document data model
e8e870cf4b82
·Piotr Praczyk / Tibor Simko on Jan 16 2013, 13:28.

Nov 27 2012

BibIndex: rework of error handling
1ba4f5272463
·Alessio Deiana / Tibor Simko on Nov 27 2012, 16:07.

Nov 2 2012

BibIndex: move of text extraction to BibDocFile
fa22362723cd
·Patrick Glauner / Tibor Simko on Nov 2 2012, 14:49.

Oct 30 2012

BibRank: new Solr and Xapian ranking bridge
dcc0e171b733
·Patrick Glauner / Tibor Simko on Oct 30 2012, 15:12.

Sep 28 2012

Merge branch 'maint-1.0' into maint-1.1
fb11456762ec
·Tibor Simko on Sep 28 2012, 11:36.
global: removal of psyco
1795fd0ffa53
·Samuele Kaplun / Tibor Simko on Sep 28 2012, 11:27.

Sep 12 2012

BibIndex: faster Solr full-text indexing
792aeaccf40e
·Tibor Simko on Sep 12 2012, 14:49.
WebSearch: word pair index for phrase searches
d102ae65cf48
·Ludmila Marian / Tibor Simko on Sep 12 2012, 05:04.

Jun 25 2012

BibRank: citation indexer sanity checks and alerts
574c7a0ea16d
·Tibor Simko on Jun 25 2012, 19:24.
bibdocfile: improve file format policies tuning
a5322715d0e3
·Samuele Kaplun / Tibor Simko on Jun 25 2012, 17:06.

Jun 15 2012

BibIndex: more sleeping points in the indexer
b13622da1060
·Alessio Deiana / Tibor Simko on Jun 15 2012, 15:13.

Jun 6 2012

BibIndex: removes illegal characters for Solr
91be3ea3db18
·Jan Aage Lavik / Tibor Simko on Jun 6 2012, 13:45.

Mar 28 2012

BibIndex: plug optional Solr full-text indexing
5b23925d102a
·Tibor Simko on Mar 28 2012, 22:23.

Mar 13 2012

textutils: updates string-to-ascii functions
658661893b99
·Jan Aage Lavik / Tibor Simko on Mar 13 2012, 18:48.

Feb 24 2012

BibIndex: fix author:Campbell-Wilson word query
657c4701b98a
·Tibor Simko on Feb 24 2012, 09:41.

Feb 13 2012

Merge branch 'maint-0.99' into maint-1.0
db31e01cefa6
·Tibor Simko on Feb 13 2012, 13:11.

Jan 18 2012

WebSearch: new authorcount indexing and searching
b6152478eaf8
·Tibor Simko on Jan 18 2012, 23:17.

Nov 8 2011

BibAuthorID: major code refactor and fixes
aea9cf6fc293
·Samuele Carli / Tibor Simko on Nov 8 2011, 19:29.

Oct 10 2011

BibIndex: cleaner SQL statements
12636e5d74cd
·Patrick Glauner / Tibor Simko on Oct 10 2011, 17:29.

Sep 12 2011

Merge branch 'maint'
699ff0dd7f44
·Tibor Simko on Sep 12 2011, 21:41.
BibIndex: fix double-stemming upon indexing
4f37b87ffdd3
·Samuele Kaplun / Tibor Simko on Sep 12 2011, 21:34.

Aug 5 2011

bibdocfile: improvements of URL handling methods
b0e823e98438
·Benoit Thiell / Tibor Simko on Aug 5 2011, 14:28.

Jul 11 2011

WebSearch: get_fieldvalues() in search utils
fae0fcaa4a5d
·Benoit Thiell / Tibor Simko on Jul 11 2011, 09:40.

Jun 27 2011

BibIndex: call BibAuthorID for modified person IDs
ea93c7796238
·Tibor Simko on Jun 27 2011, 18:07.

May 30 2011

installation: new exactfirstauthor index
c262994127c4
·Tibor Simko on May 30 2011, 21:00.

Apr 12 2011

BibIndex: remove forgotten print statement
0d3bc713bdae
·Tibor Simko on Apr 12 2011, 14:45.

Apr 11 2011

WebSearch: index-time and search-time synonyms
e1ad97abfae1
·Tibor Simko on Apr 11 2011, 13:09.

Mar 31 2011

BibIndex: drop temporary table before reindexing
4ca75d715b96
·Samuele Kaplun on Mar 31 2011, 16:03.
BibIndex: improve indexing of splash pages
08ec50330b56
·Samuele Kaplun on Mar 31 2011, 16:03.

Mar 24 2011

BibIndex: handle non-BibAuthorID configurations
d3245c75a5b7
·Samuele Kaplun / Tibor Simko on Mar 24 2011, 13:48.

Mar 18 2011

BibIndex: add author canonical IDs to author index
8ad753c66168
·Tibor Simko on Mar 18 2011, 16:33.

Mar 17 2011

WebSearch: full-text search optionally via Solr
6f4d5f47e3e6
·Jan Iwaszkiewicz / Tibor Simko on Mar 17 2011, 13:46.

Feb 15 2011

BibIndex: fix author:Campbell-Wilson word query
429e9d459ca6
·Tibor Simko on Feb 15 2011, 18:14.

Jan 14 2011

global: fix ^H^H characters in copyright notices
bd6f70ff7c2d
·Tibor Simko on Jan 14 2011, 13:12.

Jan 13 2011

global: fix copyright notice years
9036d847ae65
·Tibor Simko on Jan 13 2011, 18:53.

Dec 13 2010

installation: new firstauthor index
a3ac0436fe79
·Tibor Simko on Dec 13 2010, 10:27.

Dec 9 2010

BibIndex: wash input phrases for UTF-8
3ee31c4d53bc
·Tibor Simko on Dec 9 2010, 10:17.

Dec 8 2010

BibIndex: special treatment for arXiv:NNNN.NNNN
ee2109cfe7ac
·Tibor Simko on Dec 8 2010, 22:31.
BibIndex: less verbose fulltext indexing
59ae79a35de9
·Samuele Kaplun / Tibor Simko on Dec 8 2010, 11:20.

Nov 19 2010

BibIndex: author index include/exclude first names
94b430fc3201
·Tibor Simko on Nov 19 2010, 13:40.

Nov 1 2010

global: update copyright years
8f0027eea7ee
·Tibor Simko on Nov 1 2010, 23:50.
global: CDS Invenio becomes Invenio
d30e56fa001a
·Tibor Simko on Nov 1 2010, 22:08.
BibIndex: fix wrong idxPAIR term washing
72ed66546076
·Samuele Kaplun / Tibor Simko on Nov 1 2010, 10:39.

Aug 17 2010

kwalitee: adapt disable-msg to new pylint
3c3dc2e7fcc5
·Tibor Simko on Aug 17 2010, 22:36.
Removal of unused imports
d277958c9e4d
·Benoit Thiell / Tibor Simko on Aug 17 2010, 19:25.

May 26 2010

BibIndex: raise meaningful exceptions
e2feb8f6e2ee
·Benoit Thiell / Tibor Simko on May 26 2010, 11:48.

May 25 2010

BibIndex: fix remote full-text file indexing
372bfd0ce949
·Samuele Kaplun / Tibor Simko on May 25 2010, 16:52.

May 17 2010

BibIndex: index files with unusual extensions
6c9e98b941e2
·Samuele Kaplun / Tibor Simko on May 17 2010, 10:25.

Apr 14 2010

BibIndex: quick hack to index hidden files
a5a8668bf77d
·Samuele Kaplun / Tibor Simko on Apr 14 2010, 19:38.

Apr 13 2010

BibIndex: added support for idxPAIR
d54e912fa70e
·Samuele Kaplun on Apr 13 2010, 09:26.
WebSubmit: new fulltext conversion tools
7b3804d29a49
·Samuele Kaplun on Apr 13 2010, 09:26.

Mar 28 2010

BibIndex: created exact and fuzzy author indexes
bdd48973620d
·Tibor Simko on Mar 28 2010, 19:04.

Mar 8 2010

BibIndex: new get_words_from_date_tag()
f4c91b2e7a13
·Tibor Simko on Mar 8 2010, 16:04.

Nov 30 2009

BibIndex: do not email exceptions when repairing
3a120cbd10ae
·Samuele Kaplun / Tibor Simko on Nov 30 2009, 22:07.

Aug 25 2009

BibIndex: more explicit messages during reindexing
98a733305a94
·Tibor Simko on Aug 25 2009, 21:35.

Jun 26 2009

htmlutils: new remove_html_markup() API function
1c3f5175204b
·Tibor Simko on Jun 26 2009, 17:23.

Jun 15 2009

Global move from javadoc to epydoc docstring style
40394efc1646
·Tibor Simko on Jun 15 2009, 18:02.

Jan 8 2009

Amended and merged branch sam/idxPHRASE-deployment
dfa81009a5b7
·Tibor Simko on Jan 8 2009, 17:31.

Dec 8 2008

Improved index corruption emergency help messages.
042fd85e1ace
·Tibor Simko on Dec 8 2008, 18:12.

Oct 31 2008

Disable phrase breaking algorithm.
e28cd2bc7cd5
·Samuele Kaplun on Oct 31 2008, 16:18.
Correctly checking for proper use of --reindex.
cc46dc12bf20
·Samuele Kaplun on Oct 31 2008, 16:18.
Fixed wrong call to wordTable.update_last_updated.
ac97c25cc183
·Samuele Kaplun on Oct 31 2008, 16:18.
Implemented reindexing via temporary table swapping.
2025e6af3243
·Samuele Kaplun on Oct 31 2008, 16:18.
Disabled stemming for idxPHRASE.
a40f144704d3
·Samuele Kaplun on Oct 31 2008, 16:16.
Plugged back idxPHRASE creation.
d60b499c3006
·Samuele Kaplun on Oct 31 2008, 16:16.

Oct 27 2008

Removed $Id$ from file preamble comments.
51bfbcb9fa42
·Tibor Simko on Oct 27 2008, 22:39.

Sep 9 2008

Fixing bug (reported by Devin Bougie) triggered when filename has no extension…
919c5c448915
·Samuele Kaplun on Sep 9 2008, 19:29.

Aug 12 2008

Escaped filenames. in get_words_from_fulltext
ac6d47d5fa26
·Samuele Kaplun on Aug 12 2008, 12:03.

Jun 17 2008

Catch exceptions of lower_index_term() and continue in spite of UTF-8 problems…
6c4510b06391
·Tibor Simko on Jun 17 2008, 16:34.

Jun 4 2008

Cosmetics of output messages for the stemming info.
c3b76be701ba
·Tibor Simko on Jun 4 2008, 19:46.

May 29 2008

Lower phrase-to-be-indexed in a Unicode-friendly manner.
62b87aa91c88
·Tibor Simko on May 29 2008, 23:54.

May 16 2008

First implementation of the intelligent 'journal' index. This is an index…
4dd00adc2995
·Tibor Simko on May 16 2008, 14:53.

May 14 2008

Better closed mkstemp-created files.
e12a89b824b5
·Samuele Kaplun on May 14 2008, 17:49.
Fixed mkstemp calls that leaved open files.
6d17ad8b673e
·Samuele Kaplun on May 14 2008, 16:42.

May 13 2008

Added debugging code WRT encoding, just as for the bibrank word indexer. Now…
a3b4bad725ec
·Tibor Simko on May 13 2008, 17:24.

May 12 2008

Trying to fixing select/update vs select/insert bug.
ffb2b3a00592
·Samuele Kaplun on May 12 2008, 22:00.

May 11 2008

get_word_tables now returns a list of tuples (index_id, index_tags) instead of…
8e489b9e2ffd
·Samuele Kaplun on May 11 2008, 17:35.

Apr 3 2008

Deployed task_sleep_now_if_required to bibindex.
02c67d5a4a19
·Samuele Kaplun on Apr 3 2008, 16:34.

Apr 1 2008

New cleaner signal handling. By using task_sleep_now_if_required(can_stop_too)…
cc5418ab136d
·Samuele Kaplun on Apr 1 2008, 18:59.
Fixed bibindex --reindex to work when no indexes are specified (it reindexes…
3d880f427bbe
·Samuele Kaplun on Apr 1 2008, 10:37.

Mar 31 2008

New bibsched_low_level_task_submission for enqueing tasks via API. (changes a…
0fb4ae583079
·Samuele Kaplun on Mar 31 2008, 19:08.

Mar 26 2008

Removed last spourious printed newline.
c47f7c426b8d
·Samuele Kaplun on Mar 26 2008, 17:45.
Clened fulltext indexing logging: if extraction method does not exist for a…
91c19744a9d8
·Samuele Kaplun on Mar 26 2008, 17:44.
Removed notImplemented get_words_from_local_fulltext: it will be anyway…
caec8e4f6e4e
·Samuele Kaplun on Mar 26 2008, 15:01.

Mar 25 2008

Fixed 175 cases of bad code indentation throughout the codebase. (Please set up…
67226ac65ffd
·Tibor Simko on Mar 25 2008, 21:53.