Diffusion invenio-infoscience (master) History

bibharvest
master7a3572e4228f2f018e99f2c…

Aug 3 2007

Friday commit: removed dependency to Numeric. Migrated HitSet & Co. to…
7a3572e4228f
·Samuele Kaplun on Aug 3 2007, 19:20.

Jun 21 2007

Converted oaiarchive to new BibTask code.
dbb88cc83e12
·Samuele Kaplun on Jun 21 2007, 14:33.
OaiHarvest converted to new Bibtask code.
c6b5e3f6184e
·Samuele Kaplun on Jun 21 2007, 11:20.
Fixed comment.
0011da5cbe2c
·Samuele Kaplun on Jun 21 2007, 10:18.
Moved bibharvest code to lib, with the usual trick, and cleaned the code.
95a7da56c00d
·Samuele Kaplun on Jun 21 2007, 10:16.

Jun 18 2007

Clarified comments and test on value.
bea9e7afbf17
·Jerome Caffaro on Jun 18 2007, 08:41.

Jun 14 2007

Generates normalized empty indicators for OAI datafields ("_" replaced by " ").
61f6d90e0b8b
·Jerome Caffaro on Jun 14 2007, 11:30.

Jun 13 2007

Alternate row background-color in admin web interface.
66e38325f0bc
·Jerome Caffaro on Jun 13 2007, 09:36.

Jun 12 2007

XHTML valid output.
ffb6c2776865
·Jerome Caffaro on Jun 12 2007, 14:43.
Added possibility to choose your operator (instead of default 'AND') when…
8b3005c1aad0
·Jerome Caffaro on Jun 12 2007, 12:37.

Jun 6 2007

Moved business code from bin/oaiarchive.in to lib/oaiarchive_engine.py.
54dcaa095fc5
·Jerome Caffaro on Jun 6 2007, 09:11.

May 31 2007

Fixed problem with retrieval of collections in setspec. Implemented new 'clean'…
13fdcb7409dd
·Jerome Caffaro on May 31 2007, 11:15.

May 22 2007

Moved from the obsolete sre module to re.
9657e2ace771
·Samuele Kaplun on May 22 2007, 11:54.

May 16 2007

Improved resumptionToken matching to take into account newlines. Thanks to Kam…
6c48a4e7bcfd
·Tibor Simko on May 16 2007, 10:21.

May 15 2007

Many changes, including: * Implementation of a firewall like role definition…
ceaf067fa2cd
·Samuele Kaplun on May 15 2007, 19:35.

May 3 2007

Handling of InvalidURL exception.
4b9d95b4bf22
·Jerome Caffaro on May 3 2007, 08:54.

Apr 23 2007

Added statistics on the number of records in harvested, converted, and filtered…
4a1ec9741b3f
·Tibor Simko on Apr 23 2007, 15:09.
Safer OAI resumption token matching. Trailing spaces removed. Warning printed…
71aff726323b
·Tibor Simko on Apr 23 2007, 15:08.
Fixed sql query. Bug reported by Kam-ming Ku.
ed7c677150c2
·Jerome Caffaro on Apr 23 2007, 13:33.

Apr 2 2007

Fixed exit status code for call_bibupload().
fd0c36b240ce
·Tibor Simko on Apr 2 2007, 15:05.
Added support for h-c-f-u mode (harvest, convert, filter, upload), both to the…
3e019b6e7ecb
·Tibor Simko on Apr 2 2007, 13:46.
Removed deprecated stuff.
b0cf639821e5
·Tibor Simko on Apr 2 2007, 13:42.

Mar 30 2007

Removed documentation about non-existing option from oaiarchive help and guide.
b9872681b12e
·Jerome Caffaro on Mar 30 2007, 09:17.

Mar 27 2007

Handle UnicodeEncodeError related problems when printing messages in…
f5dd8d538885
·Tibor Simko on Mar 27 2007, 17:50.

Feb 27 2007

Improved handling of non-standard OAI responses from OAI sources (possibility…
08c313146223
·Jerome Caffaro on Feb 27 2007, 10:33.

Feb 23 2007

Fixed bug in web interface that would not correctly recognize selected sets to…
71c578509bd0
·Jerome Caffaro on Feb 23 2007, 10:31.
Fixed a bug that could prevent adding records to the OAI repository if they had…
83c76c589490
·Jerome Caffaro on Feb 23 2007, 07:58.

Feb 22 2007

Made use of XSL template for OAI DC output instead of hardcoded python.
48a13ad607ee
·Jerome Caffaro on Feb 22 2007, 08:58.

Feb 14 2007

Updated copyright years (2007).
df75ba0b1feb
·Tibor Simko on Feb 14 2007, 19:31.
Split one test.
df4d85de20bd
·Jerome Caffaro on Feb 14 2007, 15:11.

Feb 13 2007

Added performance test for serving speed of OAI repository.
cebcdb1be377
·Jerome Caffaro on Feb 13 2007, 14:20.
Reversed order of additional authors for DC output, in order to match other…
241afb4addb8
·Jerome Caffaro on Feb 13 2007, 11:13.

Feb 12 2007

Improved transformation of marcxml retrieved from database for oaimarcxml…
54fbac1d569d
·Jerome Caffaro on Feb 12 2007, 15:57.
Improved speed for OAI harvesting with verb=ListRecords&metadataPrefix=marcxml.
f634c6df34cf
·Jerome Caffaro on Feb 12 2007, 15:35.
Fixed a wrong regular expression used to retrieve resumptionToken. Thanks to…
05abfcb9f688
·Jerome Caffaro on Feb 12 2007, 08:24.

Feb 9 2007

Improved speed.
8943b041e627
·Jerome Caffaro on Feb 9 2007, 15:11.

Feb 6 2007

Eliminated duplicate sets in OAI-PMH 'ListSets' response. Eliminated duplicates…
b5c8693f96cf
·Jerome Caffaro on Feb 6 2007, 15:33.
Corrected link to guide in the admin pages.
12749fbe911d
·Jerome Caffaro on Feb 6 2007, 15:29.

Jan 26 2007

Fixed   typos, thanks to Ferran Jorba.
4723496fab5a
·Tibor Simko on Jan 26 2007, 15:13.

Jan 12 2007

More detailed status returned by validate() function when validating OAI source.
1840a1f79955
·Jerome Caffaro on Jan 12 2007, 09:54.

Dec 21 2006

Do not output values for records having no id in CFG_OAI_ID_FIELD field.
91bcd564ae37
·Jerome Caffaro on Dec 21 2006, 12:21.
Moved test for unnecessary call to bibupload where it does not break oaiarchive…
4333e7ef9370
·Jerome Caffaro on Dec 21 2006, 10:04.
Do not call bibupload when there is no record to upload.
f3b21369500d
·Jerome Caffaro on Dec 21 2006, 08:47.
Added notice of the need to run oaiarchive utility for the settings in 'OAI…
d8908f8baffe
·Jerome Caffaro on Dec 21 2006, 07:46.
Fixed possible traceback which would occur when table 'oaiARCHIVE' has non…
bb41d3bcc44d
·Jerome Caffaro on Dec 21 2006, 07:31.

Dec 20 2006

Reverted back to the use of column 'setDefinition' in table 'oaiARCHIVE'…
061e2c28e246
·Jerome Caffaro on Dec 20 2006, 08:58.

Dec 7 2006

Removed not-very-expressive "This is the gate..." welcome messages on those…
aeabbc8013e5
·Tibor Simko on Dec 7 2006, 19:31.

Dec 5 2006

Fixed wrong arguments in call to BibUpload from OAIHarvestlib.
12175fb165af
·Jerome Caffaro on Dec 5 2006, 17:02.

Dec 4 2006

Fixed free variable problems (extra).
3964b5563652
·Tibor Simko on Dec 4 2006, 14:15.

Nov 28 2006

When comparing to None, do not use "== None" or "!= None", but rather "is None"…
5dda83af3d76
·Tibor Simko on Nov 28 2006, 18:46.
Added '-r' arg to call to BibUpload.
aab79bef5b4c
·Jerome Caffaro on Nov 28 2006, 17:06.
Added references to new 'sets' feature.
b6c2502ac1ea
·Jerome Caffaro on Nov 28 2006, 15:38.
Added support for selective harvesting with multiple sets (command-line and web…
c0b4a26845d1
·Jerome Caffaro on Nov 28 2006, 12:33.

Nov 22 2006

Removed unnecessary parts in "if X and X" boolean tests, thanks to Guido Pelzer.
40e9470157ce
·Tibor Simko on Nov 22 2006, 21:45.

Nov 13 2006

OAI-compliant repository regarding deleted records.
f987ed8ad8e4
·Jerome Caffaro on Nov 13 2006, 10:33.
Some code reformatted nicely
e72cf50f7a93
·Jerome Caffaro on Nov 13 2006, 10:32.

Nov 1 2006

When authentifying user-supplied email or nickname, use two SQL queries rather…
7cbd91d4ea9b
·Tibor Simko on Nov 1 2006, 15:38.

Oct 11 2006

For temporary directory, use tmpdir instead of /tmp.
073bc52f1935
·Tibor Simko on Oct 11 2006, 12:05.
Fixed escaping problem in "Edit OAI Set" pages.
fd0d96919dbb
·Tibor Simko on Oct 11 2006, 11:54.

Oct 10 2006

Added tests for OAI sets `edit' and `delete' pages.
3b71648f9144
·Tibor Simko on Oct 10 2006, 10:34.

Sep 25 2006

Added clarifications on exposing all (public) records via OAI.
b4f2bb814003
·Tibor Simko on Sep 25 2006, 18:19.

Sep 20 2006

Fixed config wildcard import everywhere. Fixed some randomly spotted import…
af4a85dac604
·Tibor Simko on Sep 20 2006, 19:27.

Sep 15 2006

Renamed cfg_oai_* config variables to follow the uppercase model. Fixed the…
8fc23841490f
·Tibor Simko on Sep 15 2006, 12:10.

Sep 14 2006

Added __revision__ for all Python files that did not have it.
bdaa3eafc82c
·Tibor Simko on Sep 14 2006, 15:08.

Sep 13 2006

Remove unused __lastupdated__.
6e2a5e664ac3
·Tibor Simko on Sep 13 2006, 20:46.
Import missing cfg_oai_sleep.
2de35d24cedb
·Tibor Simko on Sep 13 2006, 20:36.
Removed __version__ in profit of __revision__.
fcef3232f08d
·Tibor Simko on Sep 13 2006, 20:32.
Fixed the kwalitee problem of re-exposing OAI config variables that are already…
84561a472a99
·Tibor Simko on Sep 13 2006, 18:56.

Sep 8 2006

Disable W0611 warning, as the imported config variables are exposed to the…
964125fd5871
·Tibor Simko on Sep 8 2006, 15:10.

Sep 4 2006

Invoke @PYTHON@ instead of (hardcoded) python2.3.
c41113594813
·Tibor Simko on Sep 4 2006, 14:58.

Aug 31 2006

Remove unnecessary import (import sys)
f9fa2d88d1ed
·Alberto Pepe on Aug 31 2006, 14:47.
Removed unnecessary import (from mod_python import apache)
0d6fe6ceea7b
·Alberto Pepe on Aug 31 2006, 14:46.

Aug 30 2006

Added *.pyc.
231cea77809e
·Tibor Simko on Aug 30 2006, 12:41.

Aug 29 2006

Updated every BibSched task to follow the BibTaskEx example of handling task…
536257883e68
·Tibor Simko on Aug 29 2006, 11:26.

Aug 22 2006

Reflect the fact that Identify and ListMetadataFormats does not require to…
f71f2fd488e3
·Tibor Simko on Aug 22 2006, 19:32.
Put back argument checking code bits of revision 1.9 that were reverted by…
919d3df83416
·Tibor Simko on Aug 22 2006, 19:22.
Fixed erroneous elif typo.
c78e76b1219c
·Alberto Pepe on Aug 22 2006, 19:04.
Fixed two typos in a couple of greater-than tests.
db74daca9c06
·Alberto Pepe on Aug 22 2006, 18:58.
Fixed a typo in a greater-than test.
b2341304a9b5
·Alberto Pepe on Aug 22 2006, 18:57.
Added a comment on the fact that Identify and ListMetadataFormats requests are…
062f39c88146
·Alberto Pepe on Aug 22 2006, 18:56.
Added extra condition when checking for availability: if the requested verb is…
21429f4fc48e
·Alberto Pepe on Aug 22 2006, 18:24.
Added a template function to handle HTTP errors.
9daafb56980f
·Alberto Pepe on Aug 22 2006, 18:21.
Solved some problems linked to the new mechanism of availability checking…
cc15d0926fb0
·Alberto Pepe on Aug 22 2006, 18:20.

Aug 17 2006

Removed dependency on (unimported) error_page(). Added default arguments to…
08f651f27dac
·Tibor Simko on Aug 17 2006, 15:43.
Done a very simple argument sanity treatment to fulfill the page availability…
6e388555aa73
·Tibor Simko on Aug 17 2006, 15:42.
Reflect deletion of modifysource URL in the page availability tests.
7e1d94a587df
·Tibor Simko on Aug 17 2006, 15:18.
Done a very simple argument sanity treatment to fulfill the page availability…
f85c5ac0bc53
·Tibor Simko on Aug 17 2006, 15:18.
Removed dependency on (unimported) error_page(). Added default arguments to…
9c7adb3d36d1
·Tibor Simko on Aug 17 2006, 15:16.

Jul 23 2006

Removing unused, empty RTdata file.
9aa5ad276469
·Tibor Simko on Jul 23 2006, 14:15.

Jul 21 2006

Started massive deployment of the regression test suite. Added basic tests for…
3bef264c2cdd
·Tibor Simko on Jul 21 2006, 12:46.

Jul 18 2006

Updated strings for better internationalizability.
868101673e22
·Gregory Favre on Jul 18 2006, 14:19.
Continued in the process of making the output messages better translatable.
cfe08d23e15d
·Tibor Simko on Jul 18 2006, 10:00.

Jun 29 2006

BibSched task authentication now accepts nicknames as usernames too. Modified…
5aac7386e47f
·Tibor Simko on Jun 29 2006, 09:51.

Jun 28 2006

BibHarvest Admin Guide update.
8073aaeb886c
·Martin Vesely on Jun 28 2006, 21:07.
BibHarvest OAI repository and archive admin update (2/2).
3ea30f2d7577
·Martin Vesely on Jun 28 2006, 20:09.
BibHarvest OAI repository and archive admin update (1/2).
3f38a4553040
·Martin Vesely on Jun 28 2006, 10:21.

Jun 27 2006

Handle possibly-invalid OAI provider's Retry-After response by retrying in 10…
64b680d98589
·Tibor Simko on Jun 27 2006, 09:26.

Jun 20 2006

Changed database access code in order not to depend on MySQLdb but rather on…
1fe7d8836f40
·Tibor Simko on Jun 20 2006, 11:19.

Jun 15 2006

Unification of OAI configuration variables naming.
a058c0e2f837
·Martin Vesely on Jun 15 2006, 17:29.
BibHarvest module (OAI repository application) is now using the new URL style.
de421172d3a5
·Tibor Simko on Jun 15 2006, 15:08.

R3600/modules/bibharvestmaster7a3572e4228f2f018e99f2c…

Aug 3 2007

Jun 21 2007

Jun 18 2007

Jun 14 2007

Jun 13 2007

Jun 12 2007

Jun 6 2007

May 31 2007

May 22 2007

May 16 2007

May 15 2007

May 3 2007

Apr 23 2007

Apr 2 2007

Mar 30 2007

Mar 27 2007

Feb 27 2007

Feb 23 2007

Feb 22 2007

Feb 14 2007

Feb 13 2007

Feb 12 2007

Feb 9 2007

Feb 6 2007

Jan 26 2007

Jan 12 2007

Dec 21 2006

Dec 20 2006

Dec 7 2006

Dec 5 2006

Dec 4 2006

Nov 28 2006

Nov 22 2006

Nov 13 2006

Nov 1 2006

Oct 11 2006

Oct 10 2006

Sep 25 2006

Sep 20 2006

Sep 15 2006

Sep 14 2006

Sep 13 2006

Sep 8 2006

Sep 4 2006

Aug 31 2006

Aug 30 2006

Aug 29 2006

Aug 22 2006

Aug 17 2006

Jul 23 2006

Jul 21 2006

Jul 18 2006

Jun 29 2006

Jun 28 2006

Jun 27 2006

Jun 20 2006

Jun 15 2006

R3600/modules/bibharvest
master7a3572e4228f2f018e99f2c…