Diffusion invenio-infoscience (master) History

R3600/modules/bibindex/lib/bibindex_engine.py
master229092586df1d03bbcf7d6c…

Dec 7 2007

Fixed stemming applyed to all the indexes, by adding…
229092586df1
·Samuele Kaplun on Dec 7 2007, 18:41.

Dec 4 2007

Ported to bibdocfile, implemented -R,--reindex feature, directly reading of…
17c7f225d6e1
·Samuele Kaplun on Dec 4 2007, 10:36.

Nov 6 2007

Get rid of dbquery's escape_string() and cStringIO factory, escaping SQL…
1115e53b3879
·Tibor Simko on Nov 6 2007, 19:48.
Fixed truncation of 50+ bytes long index terms, respecting strictly UTF-8…
e72ca5f81610
·Tibor Simko on Nov 6 2007, 11:50.

Oct 18 2007

Fixed syntax error in the fulltext indexing branch.
3bbb7e469769
·Tibor Simko on Oct 18 2007, 14:56.

Oct 16 2007

Make HTM and HTML files also fulltext-indexable. This is needed for articles…
6048dd37581e
·Tibor Simko on Oct 16 2007, 16:39.

Aug 9 2007

New intbitset with universe support.
cfdd1ea34eed
·Samuele Kaplun on Aug 9 2007, 16:02.

Aug 7 2007

Correctly supporting -V flag in bibtasks.
602cc38d3271
·Samuele Kaplun on Aug 7 2007, 16:29.

Aug 3 2007

Friday commit: removed dependency to Numeric. Migrated HitSet & Co. to…
7a3572e4228f
·Samuele Kaplun on Aug 3 2007, 19:20.

Jun 8 2007

Refactored bibupload, bibindex and bibreformat tasks to new bibtask cleaned…
7b2f8868dcd2
·Samuele Kaplun on Jun 8 2007, 13:31.

Jun 6 2007

Ported to new BibTask class
c9303324e339
·Samuele Kaplun on Jun 6 2007, 19:53.

May 22 2007

Moved from the obsolete sre module to re.
9657e2ace771
·Samuele Kaplun on May 22 2007, 11:54.

May 15 2007

Clarified emergency output messages in case unrepairable errors were found…
db71f1e58654
·Tibor Simko on May 15 2007, 12:39.

Mar 27 2007

Handle UnicodeEncodeError related problems when printing messages in…
f5dd8d538885
·Tibor Simko on Mar 27 2007, 17:50.

Feb 14 2007

Updated copyright years (2007).
df75ba0b1feb
·Tibor Simko on Feb 14 2007, 19:31.

Nov 1 2006

When authentifying user-supplied email or nickname, use two SQL queries rather…
7cbd91d4ea9b
·Tibor Simko on Nov 1 2006, 15:38.

Sep 20 2006

Fixed config wildcard import everywhere. Fixed some randomly spotted import…
af4a85dac604
·Tibor Simko on Sep 20 2006, 19:27.

Sep 18 2006

Harmonized CFG_PATH_* and CFG_WEBSEARCH_* config variable names.
ec761f4dff4b
·Tibor Simko on Sep 18 2006, 12:15.

Sep 15 2006

Renamed cfg_bibindex_* config variables to follow the uppercase model.
770420bc2854
·Tibor Simko on Sep 15 2006, 11:57.

Sep 13 2006

Fixed the kwalitee problem of re-exposing some of the global config variables…
2311f7764a03
·Tibor Simko on Sep 13 2006, 16:55.
Fixed the kwalitee problem of re-exposure of some of the global config…
0674ca3c5a30
·Tibor Simko on Sep 13 2006, 16:30.

Aug 29 2006

Used urllib2 instead of urllib, mkstemp() instead of mktemp(), and removed some…
dbc8be0c4e5d
·Tibor Simko on Aug 29 2006, 21:38.
Updated every BibSched task to follow the BibTaskEx example of handling task…
536257883e68
·Tibor Simko on Aug 29 2006, 11:26.

Aug 9 2006

Fixed a bug relating to the indexation of fulltexts: When the contents of a PDF…
31f485a1e848
·Nicholas Robinson on Aug 9 2006, 15:26.

Jun 29 2006

BibSched task authentication now accepts nicknames as usernames too. Modified…
5aac7386e47f
·Tibor Simko on Jun 29 2006, 09:51.

Jun 20 2006

Changed database access code in order not to depend on MySQLdb but rather on…
1fe7d8836f40
·Tibor Simko on Jun 20 2006, 11:19.

May 4 2006

Implemented name change CDSware to CDS Invenio. Also, introduced new configure…
18b100fe8575
·Tibor Simko on May 4 2006, 16:34.

May 2 2006

Updated copyright years.
d5b36a574e3c
·Tibor Simko on May 2 2006, 14:54.

Dec 20 2005

Python imports are now done in an absolute way (from cdsware.foo import bar)…
6b1700acdd20
·Tibor Simko on Dec 20 2005, 16:39.

Dec 5 2005

Quick fix in order to be able to fulltext-index Indico URLs that do not contain…
561825a6b79f
·Tibor Simko on Dec 5 2005, 14:49.

May 12 2005

Getting rid of WML.
d41001de533e
·Tibor Simko on May 12 2005, 18:09.

Mar 29 2005

Fixed add_recIDs_by_date() in case user wants to index records based on…
e694f41220b7
·Tibor Simko on Mar 29 2005, 18:10.

Jan 6 2005

Updated copyright years.
84b18f1b27c5
·Tibor Simko on Jan 6 2005, 17:41.
Fixed a bug when calculating index id from tablename for indexes greater than…
b2dc486ac9ea
·Tibor Simko on Jan 6 2005, 10:33.

Dec 16 2004

Changes due to the move of cfg_* variables into the general config file.
89932a344b16
·Tibor Simko on Dec 16 2004, 17:30.

Dec 15 2004

Changed logic when applying stemming (first) and stopword check (second).
5689d701af1c
·Tibor Simko on Dec 15 2004, 19:45.
Fixed regexp for HTML removal.
25b3ea26e6b4
·Tibor Simko on Dec 15 2004, 17:03.
Precompile all major regexps to speed up the execution. (About 10% faster…
5f3193cec995
·Tibor Simko on Dec 15 2004, 12:10.

Nov 19 2004

Added stemming/stopword functionality. Check /lib/bibindex_engine_config.py for…
ceb6867786d0
·Trond Aksel Myklebust on Nov 19 2004, 12:20.

Sep 27 2004

Activate our fancy non-interactive URL opener for fail-safe fulltext-indexing…
bc726da81963
·Tibor Simko on Sep 27 2004, 09:52.

Sep 23 2004

Modified error messages when not authorized
220b909f90a4
·Trond Aksel Myklebust on Sep 23 2004, 14:15.

Sep 8 2004

Eliminated excessive write_message() function. Reduced serialize/deserialize…
e8185fb0dfaf
·Tibor Simko on Sep 8 2004, 17:30.

Jul 7 2004

Added option to fulltext-index local files only, i.e. remote URLs are skipped…
87ea8a9e07df
·Tibor Simko on Jul 7 2004, 11:27.

Jun 15 2004

BibIndex monolithic bin file split into a small bin file and large lib engine…
5df73cfb8570
·Tibor Simko on Jun 15 2004, 18:22.