Diffusion invenio-infoscience (master) History

bibindex
master15d778abe7ce2899d38b9dd…

Jan 8 2009

Amended and merged branch sam/idxPHRASE-deployment
dfa81009a5b7
·Tibor Simko on Jan 8 2009, 17:31.

Dec 8 2008

Improved index corruption emergency help messages.
042fd85e1ace
·Tibor Simko on Dec 8 2008, 18:12.

Nov 24 2008

Deleted unnecessary cvsignore files.
f80152df3863
·Tibor Simko on Nov 24 2008, 17:08.

Oct 31 2008

Disable phrase breaking algorithm.
e28cd2bc7cd5
·Samuele Kaplun on Oct 31 2008, 16:18.
Correctly checking for proper use of --reindex.
cc46dc12bf20
·Samuele Kaplun on Oct 31 2008, 16:18.
Fixed wrong call to wordTable.update_last_updated.
ac97c25cc183
·Samuele Kaplun on Oct 31 2008, 16:18.
Implemented reindexing via temporary table swapping.
2025e6af3243
·Samuele Kaplun on Oct 31 2008, 16:18.
Disabled stemming for idxPHRASE.
a40f144704d3
·Samuele Kaplun on Oct 31 2008, 16:16.
Plugged back idxPHRASE creation.
d60b499c3006
·Samuele Kaplun on Oct 31 2008, 16:16.

Oct 30 2008

Fixed index not existing error.
9bb5a2cc734d
·Samuele Kaplun on Oct 30 2008, 13:44.
Fixed integer usage in SQL query.
068d69b1e798
·Samuele Kaplun on Oct 30 2008, 13:35.
Escaping run_sql calls in bibindex and websearch
f6a59649096a
·Samuele Kaplun on Oct 30 2008, 10:25.

Oct 27 2008

Removed $Id$ from file preamble comments.
51bfbcb9fa42
·Tibor Simko on Oct 27 2008, 22:39.

Oct 22 2008

Tried to clean Makefile.am files WRT CLEANFILES variable.
e1842fade1fa
·Samuele Kaplun on Oct 22 2008, 14:47.

Sep 9 2008

Fixing bug (reported by Devin Bougie) triggered when filename has no extension…
919c5c448915
·Samuele Kaplun on Sep 9 2008, 19:29.

Aug 12 2008

Escaped filenames. in get_words_from_fulltext
ac6d47d5fa26
·Samuele Kaplun on Aug 12 2008, 12:03.

Aug 11 2008

Added stenWords method and back compatibility for PyStemmer-1.0.1
ce9ac13658ca
·Samuele Kaplun on Aug 11 2008, 09:38.
Added hungarian, romanian, turkish, supported by PyStemmer 1.0.2 (that has…
b859ba7d6fb9
·Samuele Kaplun on Aug 11 2008, 09:31.

Jul 31 2008

key error problem finally found here
448568f31e1f
·Marko Niinimaki on Jul 31 2008, 12:32.

Jul 28 2008

Cleaned links in WebInterface
34bf83a6a43d
·Samuele Kaplun on Jul 28 2008, 12:23.

Jun 17 2008

Catch exceptions of lower_index_term() and continue in spite of UTF-8 problems…
6c4510b06391
·Tibor Simko on Jun 17 2008, 16:34.

Jun 4 2008

Cosmetics of output messages for the stemming info.
c3b76be701ba
·Tibor Simko on Jun 4 2008, 19:46.

May 29 2008

Lower phrase-to-be-indexed in a Unicode-friendly manner.
62b87aa91c88
·Tibor Simko on May 29 2008, 23:54.

May 27 2008

Added French to the stemming dictionary.
45754e8ba6bc
·Samuele Kaplun on May 27 2008, 14:26.

May 16 2008

First implementation of the intelligent 'journal' index. This is an index…
4dd00adc2995
·Tibor Simko on May 16 2008, 14:53.

May 14 2008

Better closed mkstemp-created files.
e12a89b824b5
·Samuele Kaplun on May 14 2008, 17:49.
Fixed mkstemp calls that leaved open files.
6d17ad8b673e
·Samuele Kaplun on May 14 2008, 16:42.

May 13 2008

Added debugging code WRT encoding, just as for the bibrank word indexer. Now…
a3b4bad725ec
·Tibor Simko on May 13 2008, 17:24.

May 12 2008

Trying to fixing select/update vs select/insert bug.
ffb2b3a00592
·Samuele Kaplun on May 12 2008, 22:00.

May 11 2008

get_word_tables now returns a list of tuples (index_id, index_tags) instead of…
8e489b9e2ffd
·Samuele Kaplun on May 11 2008, 17:35.

Apr 3 2008

Deployed task_sleep_now_if_required to bibindex.
02c67d5a4a19
·Samuele Kaplun on Apr 3 2008, 16:34.

Apr 2 2008

Added C# and C++ to the stemmer testsuite.
52406fde46bb
·Samuele Kaplun on Apr 2 2008, 12:30.

Apr 1 2008

New cleaner signal handling. By using task_sleep_now_if_required(can_stop_too)…
cc5418ab136d
·Samuele Kaplun on Apr 1 2008, 18:59.
Fixed bibindex --reindex to work when no indexes are specified (it reindexes…
3d880f427bbe
·Samuele Kaplun on Apr 1 2008, 10:37.

Mar 31 2008

New bibsched_low_level_task_submission for enqueing tasks via API. (changes a…
0fb4ae583079
·Samuele Kaplun on Mar 31 2008, 19:08.

Mar 26 2008

Removed last spourious printed newline.
c47f7c426b8d
·Samuele Kaplun on Mar 26 2008, 17:45.
Clened fulltext indexing logging: if extraction method does not exist for a…
91c19744a9d8
·Samuele Kaplun on Mar 26 2008, 17:44.
Removed notImplemented get_words_from_local_fulltext: it will be anyway…
caec8e4f6e4e
·Samuele Kaplun on Mar 26 2008, 15:01.
Deleted trailing whitespace in all Python files.
4bc4c73928de
·Tibor Simko on Mar 26 2008, 09:25.

Mar 25 2008

Fixed 175 cases of bad code indentation throughout the codebase. (Please set up…
67226ac65ffd
·Tibor Simko on Mar 25 2008, 21:53.
Adapted Makefiles to the new standard webdoc source directory…
e5cf1e00e21a
·Tibor Simko on Mar 25 2008, 16:09.

Mar 23 2008

Standardized unit and regression test suite building and running techniques.
3d7e61d5dbcb
·Tibor Simko on Mar 23 2008, 17:15.

Mar 12 2008

Updated codebase to use CFG_SITE_URL instead of weburl everywhere. Updated…
2b99705c3821
·Tibor Simko on Mar 12 2008, 17:47.
Hopefully fixed "[must be sys.stdout or sys.stderr] spurious messages.
a0235b21a588
·Samuele Kaplun on Mar 12 2008, 14:32.

Mar 11 2008

Fixed verbosity of some necessary output messages.
8b53ea007afc
·Tibor Simko on Mar 11 2008, 22:37.
Updated codebase to use CFG_SITE_SUPPORT_EMAIL instead of supportemail…
002dd06d18ec
·Tibor Simko on Mar 11 2008, 18:17.
Different small fixes after pylint.
b6d3dcd69474
·Samuele Kaplun on Mar 11 2008, 17:48.
Fixed indentation.
999451f5b5b7
·Tibor Simko on Mar 11 2008, 17:25.
Updated codebase to use CFG_SITE_LANG and CFG_SITE_LANGS instead of cdslang and…
7768546ebf94
·Tibor Simko on Mar 11 2008, 16:08.
Fixed a bunch of XHTML errors.
e457a05883f1
·Samuele Kaplun on Mar 11 2008, 15:31.
Updated codebase to use CFG_SITE_NAME and CFG_SITE_NAME_INTL instead of cdsname…
ca990a4e2355
·Tibor Simko on Mar 11 2008, 12:30.

Mar 10 2008

Updated conf files. Replaced old style variable names (e.g. WEBURL) with new…
6dc20e3ca587
·Tibor Simko on Mar 10 2008, 20:32.

Mar 5 2008

Corrected SELECT * queries.
508c8a5892de
·Samuele Kaplun on Mar 5 2008, 12:26.

Feb 28 2008

Fixed bug about last_update_time of an index no more updated.
0035392b57e0
·Samuele Kaplun on Feb 28 2008, 10:25.

Feb 8 2008

Better checking of admin guides availability.
ca75cb18bbaf
·Jerome Caffaro on Feb 8 2008, 08:44.

Feb 7 2008

Added unit tests for wash_index_term(). Cleaned the other test.
a95669a34b71
·Tibor Simko on Feb 7 2008, 19:27.
Fixed regression tests to check for new webdoc pages.
c782c5bb2544
·Jerome Caffaro on Feb 7 2008, 08:16.

Feb 5 2008

Disabled idxPHRASE indexing until websearch will exploit it.
abe7f722fb22
·Samuele Kaplun on Feb 5 2008, 14:53.

Feb 4 2008

Updated copyright years.
eceb995a1b50
·Tibor Simko on Feb 4 2008, 18:38.

Jan 18 2008

Made washing of terms configurable. idxPHRASEs should infact not wash terms (i.
c555c383303e
·Samuele Kaplun on Jan 18 2008, 11:41.
Removed UNIQUE key to idxPHRASE term inkdex.
38ea82c85b9c
·Samuele Kaplun on Jan 18 2008, 11:40.

Jan 16 2008

Removed unnecessary bibindex migration kit.
b8e1a9748c1f
·Tibor Simko on Jan 16 2008, 12:12.

Jan 15 2008

Implemented idxPHRASE indexes that should help when searching for exact phrases…
22223b2f9e3d
·Samuele Kaplun on Jan 15 2008, 18:14.

Jan 10 2008

Moved stemming support from static index config variable structure to column…
0affefbcb29c
·Samuele Kaplun on Jan 10 2008, 17:47.
Clarified the section on reindexing (fixed wrong use of idxINDEX, rephrased…
2b12930494aa
·Tibor Simko on Jan 10 2008, 15:21.

Jan 8 2008

Fixed logical fields column in Overview of indexes panel. Previously it wrongly…
7023be194b69
·Samuele Kaplun on Jan 8 2008, 18:12.
Reverted configuration of stemming to two-letter iso639-2 codes for identifying…
8a8eab22376a
·Samuele Kaplun on Jan 8 2008, 16:36.

Dec 20 2007

Cosmetic megacommit to standardize whitespaces in WebDoc tags ("<!-- WebDoc-Foo…
29dd5c456425
·Tibor Simko on Dec 20 2007, 14:52.
Removed WebDoc-Page-Navbar-Name and WebDoc-Page-Navbar-Select.
ec8821f104b9
·Jerome Caffaro on Dec 20 2007, 13:24.

Dec 13 2007

Fixed navtrail links to respect the new /help/{admin,hacking}/foo style.
bf158564e785
·Tibor Simko on Dec 13 2007, 18:46.

Dec 12 2007

Phased out BibIndex Admin static intro page.
8d3952c4f752
·Tibor Simko on Dec 12 2007, 18:41.

Dec 7 2007

Still to be find a better place for this adderrorbox, but at least now things…
252561a6ed6f
·Samuele Kaplun on Dec 7 2007, 19:31.
Fixed stemming applyed to all the indexes, by adding…
229092586df1
·Samuele Kaplun on Dec 7 2007, 18:41.
Verified and fixed webdoc files, removed WML files.
a40e83798f69
·Tibor Simko on Dec 7 2007, 14:09.

Dec 4 2007

Ported to bibdocfile, implemented -R,--reindex feature, directly reading of…
17c7f225d6e1
·Samuele Kaplun on Dec 4 2007, 10:36.

Nov 14 2007

WebDocified admin guide.
9031d72450c8
·Jerome Caffaro on Nov 14 2007, 12:41.

Nov 8 2007

Replaced escape_string() occurrences.
11ff313db7ff
·Tibor Simko on Nov 8 2007, 16:36.

Nov 6 2007

Get rid of dbquery's escape_string() and cStringIO factory, escaping SQL…
1115e53b3879
·Tibor Simko on Nov 6 2007, 19:48.
Fixed truncation of 50+ bytes long index terms, respecting strictly UTF-8…
e72ca5f81610
·Tibor Simko on Nov 6 2007, 11:50.

Oct 18 2007

Fixed syntax error in the fulltext indexing branch.
3bbb7e469769
·Tibor Simko on Oct 18 2007, 14:56.

Oct 16 2007

Make HTM and HTML files also fulltext-indexable. This is needed for articles…
6048dd37581e
·Tibor Simko on Oct 16 2007, 16:39.
Make HTM and HTML files also fulltext-indexable. This is needed for articles…
0070ba5dbef6
·Tibor Simko on Oct 16 2007, 16:33.

Sep 21 2007

Improved section on reindexing with information on how to truncate custom…
aaee5ecf4408
·Tibor Simko on Sep 21 2007, 17:02.

Aug 10 2007

Removed not needed anymore config parameter CFG_MAX_RECID.
53a96fd8f9bb
·Samuele Kaplun on Aug 10 2007, 12:05.

Aug 9 2007

New intbitset with universe support.
cfdd1ea34eed
·Samuele Kaplun on Aug 9 2007, 16:02.

Aug 7 2007

Correctly supporting -V flag in bibtasks.
602cc38d3271
·Samuele Kaplun on Aug 7 2007, 16:29.
stem() now uses full langugage names in the Snowball-like format, e.g.
323799c6c85c
·Tibor Simko on Aug 7 2007, 12:01.

Aug 6 2007

Fixed definition order of the PorterStemmer code branch in case Snowball…
59faff2caf00
·Tibor Simko on Aug 6 2007, 11:00.

Aug 3 2007

Friday commit: removed dependency to Numeric. Migrated HitSet & Co. to…
7a3572e4228f
·Samuele Kaplun on Aug 3 2007, 19:20.
Cleaned sources to support Snowball PyStemmer.
e7219f68ed92
·Samuele Kaplun on Aug 3 2007, 18:30.

Jul 24 2007

Added support for C library SnowBall PyStemmer (http://snowball.tartarus.org)…
56de16b36051
·Samuele Kaplun on Jul 24 2007, 12:40.

Jun 8 2007

Refactored bibupload, bibindex and bibreformat tasks to new bibtask cleaned…
7b2f8868dcd2
·Samuele Kaplun on Jun 8 2007, 13:31.

Jun 6 2007

Ported to new BibTask class
c9303324e339
·Samuele Kaplun on Jun 6 2007, 19:53.

May 25 2007

Used cdsname(intl) everywhere in place of "CDS( Invenio)"
b98d3870e673
·Samuele Kaplun on May 25 2007, 16:02.

May 22 2007

Moved from the obsolete sre module to re.
9657e2ace771
·Samuele Kaplun on May 22 2007, 11:54.

May 15 2007

Many changes, including: * Implementation of a firewall like role definition…
ceaf067fa2cd
·Samuele Kaplun on May 15 2007, 19:35.
Adapted to the new stemmer.
b1a58ccbe074
·Tibor Simko on May 15 2007, 16:02.
Adapted and enriched test cases for the English stemmer.
41edafa40e4f
·Tibor Simko on May 15 2007, 15:52.
Use PorterStemmer Pythonic implementation of the Martin Porter Stemming…
1901c69b2aa2
·Tibor Simko on May 15 2007, 15:51.
Clarified emergency output messages in case unrepairable errors were found…
db71f1e58654
·Tibor Simko on May 15 2007, 12:39.

R3600/modules/bibindexmaster15d778abe7ce2899d38b9dd…

Jan 8 2009

Dec 8 2008

Nov 24 2008

Oct 31 2008

Oct 30 2008

Oct 27 2008

Oct 22 2008

Sep 9 2008

Aug 12 2008

Aug 11 2008

Jul 31 2008

Jul 28 2008

Jun 17 2008

Jun 4 2008

May 29 2008

May 27 2008

May 16 2008

May 14 2008

May 13 2008

May 12 2008

May 11 2008

Apr 3 2008

Apr 2 2008

Apr 1 2008

Mar 31 2008

Mar 26 2008

Mar 25 2008

Mar 23 2008

Mar 12 2008

Mar 11 2008

Mar 10 2008

Mar 5 2008

Feb 28 2008

Feb 8 2008

Feb 7 2008

Feb 5 2008

Feb 4 2008

Jan 18 2008

Jan 16 2008

Jan 15 2008

Jan 10 2008

Jan 8 2008

Dec 20 2007

Dec 13 2007

Dec 12 2007

Dec 7 2007

Dec 4 2007

Nov 14 2007

Nov 8 2007

Nov 6 2007

Oct 18 2007

Oct 16 2007

Sep 21 2007

Aug 10 2007

Aug 9 2007

Aug 7 2007

Aug 6 2007

Aug 3 2007

Jul 24 2007

Jun 8 2007

Jun 6 2007

May 25 2007

May 22 2007

May 15 2007

R3600/modules/bibindex
master15d778abe7ce2899d38b9dd…