Diffusion invenio-infoscience (master) History

bibindex
master036203538091b7170d5ff9c…

Jun 17 2008

Catch exceptions of lower_index_term() and continue in spite of UTF-8 problems…
6c4510b06391
·Tibor Simko on Jun 17 2008, 16:34.

Jun 4 2008

Cosmetics of output messages for the stemming info.
c3b76be701ba
·Tibor Simko on Jun 4 2008, 19:46.

May 29 2008

Lower phrase-to-be-indexed in a Unicode-friendly manner.
62b87aa91c88
·Tibor Simko on May 29 2008, 23:54.

May 27 2008

Added French to the stemming dictionary.
45754e8ba6bc
·Samuele Kaplun on May 27 2008, 14:26.

May 16 2008

First implementation of the intelligent 'journal' index. This is an index…
4dd00adc2995
·Tibor Simko on May 16 2008, 14:53.

May 14 2008

Better closed mkstemp-created files.
e12a89b824b5
·Samuele Kaplun on May 14 2008, 17:49.
Fixed mkstemp calls that leaved open files.
6d17ad8b673e
·Samuele Kaplun on May 14 2008, 16:42.

May 13 2008

Added debugging code WRT encoding, just as for the bibrank word indexer. Now…
a3b4bad725ec
·Tibor Simko on May 13 2008, 17:24.

May 12 2008

Trying to fixing select/update vs select/insert bug.
ffb2b3a00592
·Samuele Kaplun on May 12 2008, 22:00.

May 11 2008

get_word_tables now returns a list of tuples (index_id, index_tags) instead of…
8e489b9e2ffd
·Samuele Kaplun on May 11 2008, 17:35.

Apr 3 2008

Deployed task_sleep_now_if_required to bibindex.
02c67d5a4a19
·Samuele Kaplun on Apr 3 2008, 16:34.

Apr 2 2008

Added C# and C++ to the stemmer testsuite.
52406fde46bb
·Samuele Kaplun on Apr 2 2008, 12:30.

Apr 1 2008

New cleaner signal handling. By using task_sleep_now_if_required(can_stop_too)…
cc5418ab136d
·Samuele Kaplun on Apr 1 2008, 18:59.
Fixed bibindex --reindex to work when no indexes are specified (it reindexes…
3d880f427bbe
·Samuele Kaplun on Apr 1 2008, 10:37.

Mar 31 2008

New bibsched_low_level_task_submission for enqueing tasks via API. (changes a…
0fb4ae583079
·Samuele Kaplun on Mar 31 2008, 19:08.

Mar 26 2008

Removed last spourious printed newline.
c47f7c426b8d
·Samuele Kaplun on Mar 26 2008, 17:45.
Clened fulltext indexing logging: if extraction method does not exist for a…
91c19744a9d8
·Samuele Kaplun on Mar 26 2008, 17:44.
Removed notImplemented get_words_from_local_fulltext: it will be anyway…
caec8e4f6e4e
·Samuele Kaplun on Mar 26 2008, 15:01.
Deleted trailing whitespace in all Python files.
4bc4c73928de
·Tibor Simko on Mar 26 2008, 09:25.

Mar 25 2008

Fixed 175 cases of bad code indentation throughout the codebase. (Please set up…
67226ac65ffd
·Tibor Simko on Mar 25 2008, 21:53.
Adapted Makefiles to the new standard webdoc source directory…
e5cf1e00e21a
·Tibor Simko on Mar 25 2008, 16:09.

Mar 23 2008

Standardized unit and regression test suite building and running techniques.
3d7e61d5dbcb
·Tibor Simko on Mar 23 2008, 17:15.

Mar 12 2008

Updated codebase to use CFG_SITE_URL instead of weburl everywhere. Updated…
2b99705c3821
·Tibor Simko on Mar 12 2008, 17:47.
Hopefully fixed "[must be sys.stdout or sys.stderr] spurious messages.
a0235b21a588
·Samuele Kaplun on Mar 12 2008, 14:32.

Mar 11 2008

Fixed verbosity of some necessary output messages.
8b53ea007afc
·Tibor Simko on Mar 11 2008, 22:37.
Updated codebase to use CFG_SITE_SUPPORT_EMAIL instead of supportemail…
002dd06d18ec
·Tibor Simko on Mar 11 2008, 18:17.
Different small fixes after pylint.
b6d3dcd69474
·Samuele Kaplun on Mar 11 2008, 17:48.
Fixed indentation.
999451f5b5b7
·Tibor Simko on Mar 11 2008, 17:25.
Updated codebase to use CFG_SITE_LANG and CFG_SITE_LANGS instead of cdslang and…
7768546ebf94
·Tibor Simko on Mar 11 2008, 16:08.
Fixed a bunch of XHTML errors.
e457a05883f1
·Samuele Kaplun on Mar 11 2008, 15:31.
Updated codebase to use CFG_SITE_NAME and CFG_SITE_NAME_INTL instead of cdsname…
ca990a4e2355
·Tibor Simko on Mar 11 2008, 12:30.

Mar 10 2008

Updated conf files. Replaced old style variable names (e.g. WEBURL) with new…
6dc20e3ca587
·Tibor Simko on Mar 10 2008, 20:32.

Mar 5 2008

Corrected SELECT * queries.
508c8a5892de
·Samuele Kaplun on Mar 5 2008, 12:26.

Feb 28 2008

Fixed bug about last_update_time of an index no more updated.
0035392b57e0
·Samuele Kaplun on Feb 28 2008, 10:25.

Feb 8 2008

Better checking of admin guides availability.
ca75cb18bbaf
·Jerome Caffaro on Feb 8 2008, 08:44.

Feb 7 2008

Added unit tests for wash_index_term(). Cleaned the other test.
a95669a34b71
·Tibor Simko on Feb 7 2008, 19:27.
Fixed regression tests to check for new webdoc pages.
c782c5bb2544
·Jerome Caffaro on Feb 7 2008, 08:16.

Feb 5 2008

Disabled idxPHRASE indexing until websearch will exploit it.
abe7f722fb22
·Samuele Kaplun on Feb 5 2008, 14:53.

Feb 4 2008

Updated copyright years.
eceb995a1b50
·Tibor Simko on Feb 4 2008, 18:38.

Jan 18 2008

Made washing of terms configurable. idxPHRASEs should infact not wash terms (i.
c555c383303e
·Samuele Kaplun on Jan 18 2008, 11:41.
Removed UNIQUE key to idxPHRASE term inkdex.
38ea82c85b9c
·Samuele Kaplun on Jan 18 2008, 11:40.

Jan 16 2008

Removed unnecessary bibindex migration kit.
b8e1a9748c1f
·Tibor Simko on Jan 16 2008, 12:12.

Jan 15 2008

Implemented idxPHRASE indexes that should help when searching for exact phrases…
22223b2f9e3d
·Samuele Kaplun on Jan 15 2008, 18:14.

Jan 10 2008

Moved stemming support from static index config variable structure to column…
0affefbcb29c
·Samuele Kaplun on Jan 10 2008, 17:47.
Clarified the section on reindexing (fixed wrong use of idxINDEX, rephrased…
2b12930494aa
·Tibor Simko on Jan 10 2008, 15:21.

Jan 8 2008

Fixed logical fields column in Overview of indexes panel. Previously it wrongly…
7023be194b69
·Samuele Kaplun on Jan 8 2008, 18:12.
Reverted configuration of stemming to two-letter iso639-2 codes for identifying…
8a8eab22376a
·Samuele Kaplun on Jan 8 2008, 16:36.

Dec 20 2007

Cosmetic megacommit to standardize whitespaces in WebDoc tags ("<!-- WebDoc-Foo…
29dd5c456425
·Tibor Simko on Dec 20 2007, 14:52.
Removed WebDoc-Page-Navbar-Name and WebDoc-Page-Navbar-Select.
ec8821f104b9
·Jerome Caffaro on Dec 20 2007, 13:24.

Dec 13 2007

Fixed navtrail links to respect the new /help/{admin,hacking}/foo style.
bf158564e785
·Tibor Simko on Dec 13 2007, 18:46.

Dec 12 2007

Phased out BibIndex Admin static intro page.
8d3952c4f752
·Tibor Simko on Dec 12 2007, 18:41.

Dec 7 2007

Still to be find a better place for this adderrorbox, but at least now things…
252561a6ed6f
·Samuele Kaplun on Dec 7 2007, 19:31.
Fixed stemming applyed to all the indexes, by adding…
229092586df1
·Samuele Kaplun on Dec 7 2007, 18:41.
Verified and fixed webdoc files, removed WML files.
a40e83798f69
·Tibor Simko on Dec 7 2007, 14:09.

Dec 4 2007

Ported to bibdocfile, implemented -R,--reindex feature, directly reading of…
17c7f225d6e1
·Samuele Kaplun on Dec 4 2007, 10:36.

Nov 14 2007

WebDocified admin guide.
9031d72450c8
·Jerome Caffaro on Nov 14 2007, 12:41.

Nov 8 2007

Replaced escape_string() occurrences.
11ff313db7ff
·Tibor Simko on Nov 8 2007, 16:36.

Nov 6 2007

Get rid of dbquery's escape_string() and cStringIO factory, escaping SQL…
1115e53b3879
·Tibor Simko on Nov 6 2007, 19:48.
Fixed truncation of 50+ bytes long index terms, respecting strictly UTF-8…
e72ca5f81610
·Tibor Simko on Nov 6 2007, 11:50.

Oct 18 2007

Fixed syntax error in the fulltext indexing branch.
3bbb7e469769
·Tibor Simko on Oct 18 2007, 14:56.

Oct 16 2007

Make HTM and HTML files also fulltext-indexable. This is needed for articles…
6048dd37581e
·Tibor Simko on Oct 16 2007, 16:39.
Make HTM and HTML files also fulltext-indexable. This is needed for articles…
0070ba5dbef6
·Tibor Simko on Oct 16 2007, 16:33.

Sep 21 2007

Improved section on reindexing with information on how to truncate custom…
aaee5ecf4408
·Tibor Simko on Sep 21 2007, 17:02.

Aug 10 2007

Removed not needed anymore config parameter CFG_MAX_RECID.
53a96fd8f9bb
·Samuele Kaplun on Aug 10 2007, 12:05.

Aug 9 2007

New intbitset with universe support.
cfdd1ea34eed
·Samuele Kaplun on Aug 9 2007, 16:02.

Aug 7 2007

Correctly supporting -V flag in bibtasks.
602cc38d3271
·Samuele Kaplun on Aug 7 2007, 16:29.
stem() now uses full langugage names in the Snowball-like format, e.g.
323799c6c85c
·Tibor Simko on Aug 7 2007, 12:01.

Aug 6 2007

Fixed definition order of the PorterStemmer code branch in case Snowball…
59faff2caf00
·Tibor Simko on Aug 6 2007, 11:00.

Aug 3 2007

Friday commit: removed dependency to Numeric. Migrated HitSet & Co. to…
7a3572e4228f
·Samuele Kaplun on Aug 3 2007, 19:20.
Cleaned sources to support Snowball PyStemmer.
e7219f68ed92
·Samuele Kaplun on Aug 3 2007, 18:30.

Jul 24 2007

Added support for C library SnowBall PyStemmer (http://snowball.tartarus.org)…
56de16b36051
·Samuele Kaplun on Jul 24 2007, 12:40.

Jun 8 2007

Refactored bibupload, bibindex and bibreformat tasks to new bibtask cleaned…
7b2f8868dcd2
·Samuele Kaplun on Jun 8 2007, 13:31.

Jun 6 2007

Ported to new BibTask class
c9303324e339
·Samuele Kaplun on Jun 6 2007, 19:53.

May 25 2007

Used cdsname(intl) everywhere in place of "CDS( Invenio)"
b98d3870e673
·Samuele Kaplun on May 25 2007, 16:02.

May 22 2007

Moved from the obsolete sre module to re.
9657e2ace771
·Samuele Kaplun on May 22 2007, 11:54.

May 15 2007

Many changes, including: * Implementation of a firewall like role definition…
ceaf067fa2cd
·Samuele Kaplun on May 15 2007, 19:35.
Adapted to the new stemmer.
b1a58ccbe074
·Tibor Simko on May 15 2007, 16:02.
Adapted and enriched test cases for the English stemmer.
41edafa40e4f
·Tibor Simko on May 15 2007, 15:52.
Use PorterStemmer Pythonic implementation of the Martin Porter Stemming…
1901c69b2aa2
·Tibor Simko on May 15 2007, 15:51.
Clarified emergency output messages in case unrepairable errors were found…
db71f1e58654
·Tibor Simko on May 15 2007, 12:39.

Mar 27 2007

Handle UnicodeEncodeError related problems when printing messages in…
f5dd8d538885
·Tibor Simko on Mar 27 2007, 17:50.

Feb 14 2007

Updated copyright years (2007).
df75ba0b1feb
·Tibor Simko on Feb 14 2007, 19:31.

Feb 12 2007

Added section on the fulltext indexing.
792a21d62db7
·Tibor Simko on Feb 12 2007, 19:34.

Jan 26 2007

Fixed   typos, thanks to Ferran Jorba.
4723496fab5a
·Tibor Simko on Jan 26 2007, 15:13.

Dec 7 2006

Removed not-very-expressive "This is the gate..." welcome messages on those…
aeabbc8013e5
·Tibor Simko on Dec 7 2006, 19:31.

Dec 6 2006

Fixed bad indentation.
2218e5ef55e1
·Tibor Simko on Dec 6 2006, 14:16.

Dec 4 2006

Fixed free variable problems (extra, fldID).
2bfebc745d97
·Tibor Simko on Dec 4 2006, 14:22.

Dec 1 2006

Fixed free variable problems (verbose, ln, cdsname).
774b71fb3b50
·Tibor Simko on Dec 1 2006, 12:19.

Nov 1 2006

When authentifying user-supplied email or nickname, use two SQL queries rather…
7cbd91d4ea9b
·Tibor Simko on Nov 1 2006, 15:38.

Sep 20 2006

Fixed config wildcard import everywhere. Fixed some randomly spotted import…
af4a85dac604
·Tibor Simko on Sep 20 2006, 19:27.

Sep 18 2006

Harmonized CFG_PATH_* and CFG_WEBSEARCH_* config variable names.
ec761f4dff4b
·Tibor Simko on Sep 18 2006, 12:15.

Sep 15 2006

Renamed cfg_bibindex_* config variables to follow the uppercase model.
770420bc2854
·Tibor Simko on Sep 15 2006, 11:57.

Sep 13 2006

Removed __version__ in profit of __revision__.
fcef3232f08d
·Tibor Simko on Sep 13 2006, 20:32.
Fixed the kwalitee problem of re-exposing some of the global config variables…
2311f7764a03
·Tibor Simko on Sep 13 2006, 16:55.
Fixed the kwalitee problem of re-exposure of some of the global config…
0674ca3c5a30
·Tibor Simko on Sep 13 2006, 16:30.

Sep 11 2006

Make use of get_table_status_info() rather than invoking SHOW TABLE STATUS…
1fab59ce1f32
·Tibor Simko on Sep 11 2006, 16:36.
Make use of get_table_status_info() rather than invoking SHOW TABLE STATUS…
415d530f4475
·Tibor Simko on Sep 11 2006, 16:34.

Sep 8 2006

Fixed away the most obvious pylint warnings.
75928c3cd4e1
·Tibor Simko on Sep 8 2006, 15:14.

Sep 7 2006

Added *.pyc.
b45beba5c79c
·Tibor Simko on Sep 7 2006, 23:19.

Aug 29 2006

Used urllib2 instead of urllib, mkstemp() instead of mktemp(), and removed some…
dbc8be0c4e5d
·Tibor Simko on Aug 29 2006, 21:38.

R3600/modules/bibindexmaster036203538091b7170d5ff9c…

Jun 17 2008

Jun 4 2008

May 29 2008

May 27 2008

May 16 2008

May 14 2008

May 13 2008

May 12 2008

May 11 2008

Apr 3 2008

Apr 2 2008

Apr 1 2008

Mar 31 2008

Mar 26 2008

Mar 25 2008

Mar 23 2008

Mar 12 2008

Mar 11 2008

Mar 10 2008

Mar 5 2008

Feb 28 2008

Feb 8 2008

Feb 7 2008

Feb 5 2008

Feb 4 2008

Jan 18 2008

Jan 16 2008

Jan 15 2008

Jan 10 2008

Jan 8 2008

Dec 20 2007

Dec 13 2007

Dec 12 2007

Dec 7 2007

Dec 4 2007

Nov 14 2007

Nov 8 2007

Nov 6 2007

Oct 18 2007

Oct 16 2007

Sep 21 2007

Aug 10 2007

Aug 9 2007

Aug 7 2007

Aug 6 2007

Aug 3 2007

Jul 24 2007

Jun 8 2007

Jun 6 2007

May 25 2007

May 22 2007

May 15 2007

Mar 27 2007

Feb 14 2007

Feb 12 2007

Jan 26 2007

Dec 7 2006

Dec 6 2006

Dec 4 2006

Dec 1 2006

Nov 1 2006

Sep 20 2006

Sep 18 2006

Sep 15 2006

Sep 13 2006

Sep 11 2006

Sep 8 2006

Sep 7 2006

Aug 29 2006

R3600/modules/bibindex
master036203538091b7170d5ff9c…