Diffusion invenio-infoscience (master) History

bibharvest
masterf7b1a27188ea3cd962d774d…

Dec 6 2007

Verified webdoc files, removed WML files.
4261338e0953
·Tibor Simko on Dec 6 2007, 16:53.

Nov 14 2007

WebDocified admin guide.
f7428c40b854
·Jerome Caffaro on Nov 14 2007, 09:13.

Nov 9 2007

Fixed potentially dangerous SQL INSERT statement.
d712478ef3bc
·Tibor Simko on Nov 9 2007, 12:23.

Nov 8 2007

Replaced escape_string() occurrences.
0719bbf46078
·Tibor Simko on Nov 8 2007, 16:27.
Replaced escape_string() occurrences.
889389e10533
·Tibor Simko on Nov 8 2007, 16:21.

Oct 17 2007

Fixed timezone problem with 'from' and 'until' argument in OAI requests.
43d610347f22
·Jerome Caffaro on Oct 17 2007, 14:17.

Sep 11 2007

Fixed -r mode.
ad86ea0a5563
·Jerome Caffaro on Sep 11 2007, 11:25.
Improved task progress status feedback. Filter out whitespaces from -o --oaiset…
79931c8c9a2b
·Jerome Caffaro on Sep 11 2007, 10:04.

Sep 10 2007

Added support for processing several sets definitions in one row (-o --oaiset…
ca656401522e
·Jerome Caffaro on Sep 10 2007, 15:31.

Aug 14 2007

Fixed analysis of harvested data, that would trigger a warning when verb was…
fcc543cb6359
·Jerome Caffaro on Aug 14 2007, 15:05.
Fixed verb=ListIdentifiers and verb=ListRecords, when used with selective…
94727ee71418
·Jerome Caffaro on Aug 14 2007, 09:57.

Aug 10 2007

Fixed typo in code.
ce732596939e
·Jerome Caffaro on Aug 10 2007, 15:14.

Aug 7 2007

Correctly supporting -V flag in bibtasks.
602cc38d3271
·Samuele Kaplun on Aug 7 2007, 16:29.

Aug 3 2007

Friday commit: removed dependency to Numeric. Migrated HitSet & Co. to…
7a3572e4228f
·Samuele Kaplun on Aug 3 2007, 19:20.

Jun 21 2007

Converted oaiarchive to new BibTask code.
dbb88cc83e12
·Samuele Kaplun on Jun 21 2007, 14:33.
OaiHarvest converted to new Bibtask code.
c6b5e3f6184e
·Samuele Kaplun on Jun 21 2007, 11:20.
Fixed comment.
0011da5cbe2c
·Samuele Kaplun on Jun 21 2007, 10:18.
Moved bibharvest code to lib, with the usual trick, and cleaned the code.
95a7da56c00d
·Samuele Kaplun on Jun 21 2007, 10:16.

Jun 18 2007

Clarified comments and test on value.
bea9e7afbf17
·Jerome Caffaro on Jun 18 2007, 08:41.

Jun 14 2007

Generates normalized empty indicators for OAI datafields ("_" replaced by " ").
61f6d90e0b8b
·Jerome Caffaro on Jun 14 2007, 11:30.

Jun 13 2007

Alternate row background-color in admin web interface.
66e38325f0bc
·Jerome Caffaro on Jun 13 2007, 09:36.

Jun 12 2007

XHTML valid output.
ffb6c2776865
·Jerome Caffaro on Jun 12 2007, 14:43.
Added possibility to choose your operator (instead of default 'AND') when…
8b3005c1aad0
·Jerome Caffaro on Jun 12 2007, 12:37.

Jun 6 2007

Moved business code from bin/oaiarchive.in to lib/oaiarchive_engine.py.
54dcaa095fc5
·Jerome Caffaro on Jun 6 2007, 09:11.

May 31 2007

Fixed problem with retrieval of collections in setspec. Implemented new 'clean'…
13fdcb7409dd
·Jerome Caffaro on May 31 2007, 11:15.

May 22 2007

Moved from the obsolete sre module to re.
9657e2ace771
·Samuele Kaplun on May 22 2007, 11:54.

May 16 2007

Improved resumptionToken matching to take into account newlines. Thanks to Kam…
6c48a4e7bcfd
·Tibor Simko on May 16 2007, 10:21.

May 15 2007

Many changes, including: * Implementation of a firewall like role definition…
ceaf067fa2cd
·Samuele Kaplun on May 15 2007, 19:35.

May 3 2007

Handling of InvalidURL exception.
4b9d95b4bf22
·Jerome Caffaro on May 3 2007, 08:54.

Apr 23 2007

Added statistics on the number of records in harvested, converted, and filtered…
4a1ec9741b3f
·Tibor Simko on Apr 23 2007, 15:09.
Safer OAI resumption token matching. Trailing spaces removed. Warning printed…
71aff726323b
·Tibor Simko on Apr 23 2007, 15:08.
Fixed sql query. Bug reported by Kam-ming Ku.
ed7c677150c2
·Jerome Caffaro on Apr 23 2007, 13:33.

Apr 2 2007

Fixed exit status code for call_bibupload().
fd0c36b240ce
·Tibor Simko on Apr 2 2007, 15:05.
Added support for h-c-f-u mode (harvest, convert, filter, upload), both to the…
3e019b6e7ecb
·Tibor Simko on Apr 2 2007, 13:46.
Removed deprecated stuff.
b0cf639821e5
·Tibor Simko on Apr 2 2007, 13:42.

Mar 30 2007

Removed documentation about non-existing option from oaiarchive help and guide.
b9872681b12e
·Jerome Caffaro on Mar 30 2007, 09:17.

Mar 27 2007

Handle UnicodeEncodeError related problems when printing messages in…
f5dd8d538885
·Tibor Simko on Mar 27 2007, 17:50.

Feb 27 2007

Improved handling of non-standard OAI responses from OAI sources (possibility…
08c313146223
·Jerome Caffaro on Feb 27 2007, 10:33.

Feb 23 2007

Fixed bug in web interface that would not correctly recognize selected sets to…
71c578509bd0
·Jerome Caffaro on Feb 23 2007, 10:31.
Fixed a bug that could prevent adding records to the OAI repository if they had…
83c76c589490
·Jerome Caffaro on Feb 23 2007, 07:58.

Feb 22 2007

Made use of XSL template for OAI DC output instead of hardcoded python.
48a13ad607ee
·Jerome Caffaro on Feb 22 2007, 08:58.

Feb 14 2007

Updated copyright years (2007).
df75ba0b1feb
·Tibor Simko on Feb 14 2007, 19:31.
Split one test.
df4d85de20bd
·Jerome Caffaro on Feb 14 2007, 15:11.

Feb 13 2007

Added performance test for serving speed of OAI repository.
cebcdb1be377
·Jerome Caffaro on Feb 13 2007, 14:20.
Reversed order of additional authors for DC output, in order to match other…
241afb4addb8
·Jerome Caffaro on Feb 13 2007, 11:13.

Feb 12 2007

Improved transformation of marcxml retrieved from database for oaimarcxml…
54fbac1d569d
·Jerome Caffaro on Feb 12 2007, 15:57.
Improved speed for OAI harvesting with verb=ListRecords&metadataPrefix=marcxml.
f634c6df34cf
·Jerome Caffaro on Feb 12 2007, 15:35.
Fixed a wrong regular expression used to retrieve resumptionToken. Thanks to…
05abfcb9f688
·Jerome Caffaro on Feb 12 2007, 08:24.

Feb 9 2007

Improved speed.
8943b041e627
·Jerome Caffaro on Feb 9 2007, 15:11.

Feb 6 2007

Eliminated duplicate sets in OAI-PMH 'ListSets' response. Eliminated duplicates…
b5c8693f96cf
·Jerome Caffaro on Feb 6 2007, 15:33.
Corrected link to guide in the admin pages.
12749fbe911d
·Jerome Caffaro on Feb 6 2007, 15:29.

Jan 26 2007

Fixed   typos, thanks to Ferran Jorba.
4723496fab5a
·Tibor Simko on Jan 26 2007, 15:13.

Jan 12 2007

More detailed status returned by validate() function when validating OAI source.
1840a1f79955
·Jerome Caffaro on Jan 12 2007, 09:54.

Dec 21 2006

Do not output values for records having no id in CFG_OAI_ID_FIELD field.
91bcd564ae37
·Jerome Caffaro on Dec 21 2006, 12:21.
Moved test for unnecessary call to bibupload where it does not break oaiarchive…
4333e7ef9370
·Jerome Caffaro on Dec 21 2006, 10:04.
Do not call bibupload when there is no record to upload.
f3b21369500d
·Jerome Caffaro on Dec 21 2006, 08:47.
Added notice of the need to run oaiarchive utility for the settings in 'OAI…
d8908f8baffe
·Jerome Caffaro on Dec 21 2006, 07:46.
Fixed possible traceback which would occur when table 'oaiARCHIVE' has non…
bb41d3bcc44d
·Jerome Caffaro on Dec 21 2006, 07:31.

Dec 20 2006

Reverted back to the use of column 'setDefinition' in table 'oaiARCHIVE'…
061e2c28e246
·Jerome Caffaro on Dec 20 2006, 08:58.

Dec 7 2006

Removed not-very-expressive "This is the gate..." welcome messages on those…
aeabbc8013e5
·Tibor Simko on Dec 7 2006, 19:31.

Dec 5 2006

Fixed wrong arguments in call to BibUpload from OAIHarvestlib.
12175fb165af
·Jerome Caffaro on Dec 5 2006, 17:02.

Dec 4 2006

Fixed free variable problems (extra).
3964b5563652
·Tibor Simko on Dec 4 2006, 14:15.

Nov 28 2006

When comparing to None, do not use "== None" or "!= None", but rather "is None"…
5dda83af3d76
·Tibor Simko on Nov 28 2006, 18:46.
Added '-r' arg to call to BibUpload.
aab79bef5b4c
·Jerome Caffaro on Nov 28 2006, 17:06.
Added references to new 'sets' feature.
b6c2502ac1ea
·Jerome Caffaro on Nov 28 2006, 15:38.
Added support for selective harvesting with multiple sets (command-line and web…
c0b4a26845d1
·Jerome Caffaro on Nov 28 2006, 12:33.

Nov 22 2006

Removed unnecessary parts in "if X and X" boolean tests, thanks to Guido Pelzer.
40e9470157ce
·Tibor Simko on Nov 22 2006, 21:45.

Nov 13 2006

OAI-compliant repository regarding deleted records.
f987ed8ad8e4
·Jerome Caffaro on Nov 13 2006, 10:33.
Some code reformatted nicely
e72cf50f7a93
·Jerome Caffaro on Nov 13 2006, 10:32.

Nov 1 2006

When authentifying user-supplied email or nickname, use two SQL queries rather…
7cbd91d4ea9b
·Tibor Simko on Nov 1 2006, 15:38.

Oct 11 2006

For temporary directory, use tmpdir instead of /tmp.
073bc52f1935
·Tibor Simko on Oct 11 2006, 12:05.
Fixed escaping problem in "Edit OAI Set" pages.
fd0d96919dbb
·Tibor Simko on Oct 11 2006, 11:54.

Oct 10 2006

Added tests for OAI sets `edit' and `delete' pages.
3b71648f9144
·Tibor Simko on Oct 10 2006, 10:34.

Sep 25 2006

Added clarifications on exposing all (public) records via OAI.
b4f2bb814003
·Tibor Simko on Sep 25 2006, 18:19.

Sep 20 2006

Fixed config wildcard import everywhere. Fixed some randomly spotted import…
af4a85dac604
·Tibor Simko on Sep 20 2006, 19:27.

Sep 15 2006

Renamed cfg_oai_* config variables to follow the uppercase model. Fixed the…
8fc23841490f
·Tibor Simko on Sep 15 2006, 12:10.

Sep 14 2006

Added __revision__ for all Python files that did not have it.
bdaa3eafc82c
·Tibor Simko on Sep 14 2006, 15:08.

Sep 13 2006

Remove unused __lastupdated__.
6e2a5e664ac3
·Tibor Simko on Sep 13 2006, 20:46.
Import missing cfg_oai_sleep.
2de35d24cedb
·Tibor Simko on Sep 13 2006, 20:36.
Removed __version__ in profit of __revision__.
fcef3232f08d
·Tibor Simko on Sep 13 2006, 20:32.
Fixed the kwalitee problem of re-exposing OAI config variables that are already…
84561a472a99
·Tibor Simko on Sep 13 2006, 18:56.

Sep 8 2006

Disable W0611 warning, as the imported config variables are exposed to the…
964125fd5871
·Tibor Simko on Sep 8 2006, 15:10.

Sep 4 2006

Invoke @PYTHON@ instead of (hardcoded) python2.3.
c41113594813
·Tibor Simko on Sep 4 2006, 14:58.

Aug 31 2006

Remove unnecessary import (import sys)
f9fa2d88d1ed
·Alberto Pepe on Aug 31 2006, 14:47.
Removed unnecessary import (from mod_python import apache)
0d6fe6ceea7b
·Alberto Pepe on Aug 31 2006, 14:46.

Aug 30 2006

Added *.pyc.
231cea77809e
·Tibor Simko on Aug 30 2006, 12:41.

Aug 29 2006

Updated every BibSched task to follow the BibTaskEx example of handling task…
536257883e68
·Tibor Simko on Aug 29 2006, 11:26.

Aug 22 2006

Reflect the fact that Identify and ListMetadataFormats does not require to…
f71f2fd488e3
·Tibor Simko on Aug 22 2006, 19:32.
Put back argument checking code bits of revision 1.9 that were reverted by…
919d3df83416
·Tibor Simko on Aug 22 2006, 19:22.
Fixed erroneous elif typo.
c78e76b1219c
·Alberto Pepe on Aug 22 2006, 19:04.
Fixed two typos in a couple of greater-than tests.
db74daca9c06
·Alberto Pepe on Aug 22 2006, 18:58.
Fixed a typo in a greater-than test.
b2341304a9b5
·Alberto Pepe on Aug 22 2006, 18:57.
Added a comment on the fact that Identify and ListMetadataFormats requests are…
062f39c88146
·Alberto Pepe on Aug 22 2006, 18:56.
Added extra condition when checking for availability: if the requested verb is…
21429f4fc48e
·Alberto Pepe on Aug 22 2006, 18:24.
Added a template function to handle HTTP errors.
9daafb56980f
·Alberto Pepe on Aug 22 2006, 18:21.
Solved some problems linked to the new mechanism of availability checking…
cc15d0926fb0
·Alberto Pepe on Aug 22 2006, 18:20.

Aug 17 2006

Removed dependency on (unimported) error_page(). Added default arguments to…
08f651f27dac
·Tibor Simko on Aug 17 2006, 15:43.
Done a very simple argument sanity treatment to fulfill the page availability…
6e388555aa73
·Tibor Simko on Aug 17 2006, 15:42.
Reflect deletion of modifysource URL in the page availability tests.
7e1d94a587df
·Tibor Simko on Aug 17 2006, 15:18.
Done a very simple argument sanity treatment to fulfill the page availability…
f85c5ac0bc53
·Tibor Simko on Aug 17 2006, 15:18.

R3600/modules/bibharvestmasterf7b1a27188ea3cd962d774d…

Dec 6 2007

Nov 14 2007

Nov 9 2007

Nov 8 2007

Oct 17 2007

Sep 11 2007

Sep 10 2007

Aug 14 2007

Aug 10 2007

Aug 7 2007

Aug 3 2007

Jun 21 2007

Jun 18 2007

Jun 14 2007

Jun 13 2007

Jun 12 2007

Jun 6 2007

May 31 2007

May 22 2007

May 16 2007

May 15 2007

May 3 2007

Apr 23 2007

Apr 2 2007

Mar 30 2007

Mar 27 2007

Feb 27 2007

Feb 23 2007

Feb 22 2007

Feb 14 2007

Feb 13 2007

Feb 12 2007

Feb 9 2007

Feb 6 2007

Jan 26 2007

Jan 12 2007

Dec 21 2006

Dec 20 2006

Dec 7 2006

Dec 5 2006

Dec 4 2006

Nov 28 2006

Nov 22 2006

Nov 13 2006

Nov 1 2006

Oct 11 2006

Oct 10 2006

Sep 25 2006

Sep 20 2006

Sep 15 2006

Sep 14 2006

Sep 13 2006

Sep 8 2006

Sep 4 2006

Aug 31 2006

Aug 30 2006

Aug 29 2006

Aug 22 2006

Aug 17 2006

R3600/modules/bibharvest
masterf7b1a27188ea3cd962d774d…