Diffusion invenio-infoscience (master) History

bibharvest
master071fcd057c5d0a25604ba29…

Apr 15 2008

Initial release of web test for inserting OAI sources.
071fcd057c5d
·Jerome Caffaro on Apr 15 2008, 09:24.

Apr 7 2008

Updating BibSched task progress.
971e8551bfc8
·Jerome Caffaro on Apr 7 2008, 14:05.
Fixed issue with retrieval of cli parameter '--repository'. Do not bibupload…
830c36a1c797
·Jerome Caffaro on Apr 7 2008, 09:50.

Apr 4 2008

Fixed an SQL INSERT statement.
f7bc986ed738
·Jerome Caffaro on Apr 4 2008, 15:32.
Deployed task_sleep_now_if_required to bibharvest suite.
4c475a4f0a85
·Samuele Kaplun on Apr 4 2008, 11:02.

Mar 31 2008

New bibsched_low_level_task_submission for enqueing tasks via API. (changes a…
0fb4ae583079
·Samuele Kaplun on Mar 31 2008, 19:08.

Mar 26 2008

Don't automatically add 'ln' parameter to URIs specified in…
adfe82ceeee4
·Jerome Caffaro on Mar 26 2008, 13:45.
Deleted trailing whitespace in all Python files.
4bc4c73928de
·Tibor Simko on Mar 26 2008, 09:25.

Mar 25 2008

Adapted Makefiles to the new standard webdoc source directory…
e5cf1e00e21a
·Tibor Simko on Mar 25 2008, 16:09.
Raise a 'badArgument' error when the request includes repeated arguments…
dafb9c022092
·Jerome Caffaro on Mar 25 2008, 10:32.

Mar 23 2008

Standardized unit and regression test suite building and running techniques.
3d7e61d5dbcb
·Tibor Simko on Mar 23 2008, 17:15.

Mar 12 2008

Updated codebase to use CFG_SITE_URL instead of weburl everywhere. Updated…
2b99705c3821
·Tibor Simko on Mar 12 2008, 17:47.

Mar 11 2008

Updated codebase to use CFG_SITE_SUPPORT_EMAIL instead of supportemail…
002dd06d18ec
·Tibor Simko on Mar 11 2008, 18:17.
Updated codebase to use CFG_SITE_ADMIN_EMAIL instead of adminemail everywhere.
72c35da585a5
·Tibor Simko on Mar 11 2008, 17:36.
Updated codebase to use CFG_SITE_LANG and CFG_SITE_LANGS instead of cdslang and…
7768546ebf94
·Tibor Simko on Mar 11 2008, 16:08.
Fixed a bunch of XHTML errors.
e457a05883f1
·Samuele Kaplun on Mar 11 2008, 15:31.
Updated codebase to use CFG_SITE_NAME and CFG_SITE_NAME_INTL instead of cdsname…
ca990a4e2355
·Tibor Simko on Mar 11 2008, 12:30.

Mar 10 2008

Updated conf files. Replaced old style variable names (e.g. WEBURL) with new…
6dc20e3ca587
·Tibor Simko on Mar 10 2008, 20:32.

Mar 5 2008

Removed fragile SQL code. Thanks to Gregory Favre (EPFL).
e06bba2c3c05
·Jerome Caffaro on Mar 5 2008, 07:21.

Feb 8 2008

Better checking of admin guides availability.
ca75cb18bbaf
·Jerome Caffaro on Feb 8 2008, 08:44.

Feb 7 2008

Fixed regression tests to check for new webdoc pages.
c782c5bb2544
·Jerome Caffaro on Feb 7 2008, 08:16.

Feb 4 2008

Updated copyright years.
eceb995a1b50
·Tibor Simko on Feb 4 2008, 18:38.

Jan 31 2008

Replaced config.wml with invenio.conf.
6de5f9d0e033
·Tibor Simko on Jan 31 2008, 14:05.

Jan 11 2008

Made a clearer distinction between BibHarvest and OAIRepository. Added…
5335f14bc43e
·Jerome Caffaro on Jan 11 2008, 16:25.

Jan 9 2008

Better checking of input parameters. Fixed related test cases. Fixed bug that…
98f5faed61fb
·Jerome Caffaro on Jan 9 2008, 08:18.

Dec 20 2007

Cosmetic megacommit to standardize whitespaces in WebDoc tags ("<!-- WebDoc-Foo…
29dd5c456425
·Tibor Simko on Dec 20 2007, 14:52.
Removed WebDoc-Page-Navbar-Name and WebDoc-Page-Navbar-Select.
ec8821f104b9
·Jerome Caffaro on Dec 20 2007, 13:24.

Dec 19 2007

Adapted tests for default records of Atlantis.
ff386dbd802f
·Jerome Caffaro on Dec 19 2007, 15:43.

Dec 17 2007

Retrieve repository size using "exact phrase" mode.
26ccb9411d6c
·Jerome Caffaro on Dec 17 2007, 14:35.
Fixed response header of 'GetRecord' verb. Selective harvesting now use…
4801840da61b
·Jerome Caffaro on Dec 17 2007, 14:32.
Alternative Patterns mode off.
095b6dbc4e9e
·Jerome Caffaro on Dec 17 2007, 13:28.
Fixed typo.
410a53801c45
·Jerome Caffaro on Dec 17 2007, 09:21.
Added tests for selective harvesting ('from', 'until' and 'set' parameters).
6ecd3e20e72f
·Jerome Caffaro on Dec 17 2007, 09:17.

Dec 13 2007

Fixed navtrail links to respect the new /help/{admin,hacking}/foo style.
bf158564e785
·Tibor Simko on Dec 13 2007, 18:46.
Fixed problems with timezones and short ISO 8601 dates in 'from' and 'until'…
10676a48ebef
·Jerome Caffaro on Dec 13 2007, 12:01.
Removed unnecessary 'from mod_python import apache' statement.
0c182e7e08a0
·Jerome Caffaro on Dec 13 2007, 12:00.

Dec 12 2007

Phased out BibHarvest Admin static intro page.
ecdebf131fc0
·Tibor Simko on Dec 12 2007, 19:03.

Dec 7 2007

Still to be find a better place for this adderrorbox, but at least now things…
252561a6ed6f
·Samuele Kaplun on Dec 7 2007, 19:31.

Dec 6 2007

Verified webdoc files, removed WML files.
4261338e0953
·Tibor Simko on Dec 6 2007, 16:53.

Nov 14 2007

WebDocified admin guide.
f7428c40b854
·Jerome Caffaro on Nov 14 2007, 09:13.

Nov 9 2007

Fixed potentially dangerous SQL INSERT statement.
d712478ef3bc
·Tibor Simko on Nov 9 2007, 12:23.

Nov 8 2007

Replaced escape_string() occurrences.
0719bbf46078
·Tibor Simko on Nov 8 2007, 16:27.
Replaced escape_string() occurrences.
889389e10533
·Tibor Simko on Nov 8 2007, 16:21.

Oct 17 2007

Fixed timezone problem with 'from' and 'until' argument in OAI requests.
43d610347f22
·Jerome Caffaro on Oct 17 2007, 14:17.

Sep 11 2007

Fixed -r mode.
ad86ea0a5563
·Jerome Caffaro on Sep 11 2007, 11:25.
Improved task progress status feedback. Filter out whitespaces from -o --oaiset…
79931c8c9a2b
·Jerome Caffaro on Sep 11 2007, 10:04.

Sep 10 2007

Added support for processing several sets definitions in one row (-o --oaiset…
ca656401522e
·Jerome Caffaro on Sep 10 2007, 15:31.

Aug 14 2007

Fixed analysis of harvested data, that would trigger a warning when verb was…
fcc543cb6359
·Jerome Caffaro on Aug 14 2007, 15:05.
Fixed verb=ListIdentifiers and verb=ListRecords, when used with selective…
94727ee71418
·Jerome Caffaro on Aug 14 2007, 09:57.

Aug 10 2007

Fixed typo in code.
ce732596939e
·Jerome Caffaro on Aug 10 2007, 15:14.

Aug 7 2007

Correctly supporting -V flag in bibtasks.
602cc38d3271
·Samuele Kaplun on Aug 7 2007, 16:29.

Aug 3 2007

Friday commit: removed dependency to Numeric. Migrated HitSet & Co. to…
7a3572e4228f
·Samuele Kaplun on Aug 3 2007, 19:20.

Jun 21 2007

Converted oaiarchive to new BibTask code.
dbb88cc83e12
·Samuele Kaplun on Jun 21 2007, 14:33.
OaiHarvest converted to new Bibtask code.
c6b5e3f6184e
·Samuele Kaplun on Jun 21 2007, 11:20.
Fixed comment.
0011da5cbe2c
·Samuele Kaplun on Jun 21 2007, 10:18.
Moved bibharvest code to lib, with the usual trick, and cleaned the code.
95a7da56c00d
·Samuele Kaplun on Jun 21 2007, 10:16.

Jun 18 2007

Clarified comments and test on value.
bea9e7afbf17
·Jerome Caffaro on Jun 18 2007, 08:41.

Jun 14 2007

Generates normalized empty indicators for OAI datafields ("_" replaced by " ").
61f6d90e0b8b
·Jerome Caffaro on Jun 14 2007, 11:30.

Jun 13 2007

Alternate row background-color in admin web interface.
66e38325f0bc
·Jerome Caffaro on Jun 13 2007, 09:36.

Jun 12 2007

XHTML valid output.
ffb6c2776865
·Jerome Caffaro on Jun 12 2007, 14:43.
Added possibility to choose your operator (instead of default 'AND') when…
8b3005c1aad0
·Jerome Caffaro on Jun 12 2007, 12:37.

Jun 6 2007

Moved business code from bin/oaiarchive.in to lib/oaiarchive_engine.py.
54dcaa095fc5
·Jerome Caffaro on Jun 6 2007, 09:11.

May 31 2007

Fixed problem with retrieval of collections in setspec. Implemented new 'clean'…
13fdcb7409dd
·Jerome Caffaro on May 31 2007, 11:15.

May 22 2007

Moved from the obsolete sre module to re.
9657e2ace771
·Samuele Kaplun on May 22 2007, 11:54.

May 16 2007

Improved resumptionToken matching to take into account newlines. Thanks to Kam…
6c48a4e7bcfd
·Tibor Simko on May 16 2007, 10:21.

May 15 2007

Many changes, including: * Implementation of a firewall like role definition…
ceaf067fa2cd
·Samuele Kaplun on May 15 2007, 19:35.

May 3 2007

Handling of InvalidURL exception.
4b9d95b4bf22
·Jerome Caffaro on May 3 2007, 08:54.

Apr 23 2007

Added statistics on the number of records in harvested, converted, and filtered…
4a1ec9741b3f
·Tibor Simko on Apr 23 2007, 15:09.
Safer OAI resumption token matching. Trailing spaces removed. Warning printed…
71aff726323b
·Tibor Simko on Apr 23 2007, 15:08.
Fixed sql query. Bug reported by Kam-ming Ku.
ed7c677150c2
·Jerome Caffaro on Apr 23 2007, 13:33.

Apr 2 2007

Fixed exit status code for call_bibupload().
fd0c36b240ce
·Tibor Simko on Apr 2 2007, 15:05.
Added support for h-c-f-u mode (harvest, convert, filter, upload), both to the…
3e019b6e7ecb
·Tibor Simko on Apr 2 2007, 13:46.
Removed deprecated stuff.
b0cf639821e5
·Tibor Simko on Apr 2 2007, 13:42.

Mar 30 2007

Removed documentation about non-existing option from oaiarchive help and guide.
b9872681b12e
·Jerome Caffaro on Mar 30 2007, 09:17.

Mar 27 2007

Handle UnicodeEncodeError related problems when printing messages in…
f5dd8d538885
·Tibor Simko on Mar 27 2007, 17:50.

Feb 27 2007

Improved handling of non-standard OAI responses from OAI sources (possibility…
08c313146223
·Jerome Caffaro on Feb 27 2007, 10:33.

Feb 23 2007

Fixed bug in web interface that would not correctly recognize selected sets to…
71c578509bd0
·Jerome Caffaro on Feb 23 2007, 10:31.
Fixed a bug that could prevent adding records to the OAI repository if they had…
83c76c589490
·Jerome Caffaro on Feb 23 2007, 07:58.

Feb 22 2007

Made use of XSL template for OAI DC output instead of hardcoded python.
48a13ad607ee
·Jerome Caffaro on Feb 22 2007, 08:58.

Feb 14 2007

Updated copyright years (2007).
df75ba0b1feb
·Tibor Simko on Feb 14 2007, 19:31.
Split one test.
df4d85de20bd
·Jerome Caffaro on Feb 14 2007, 15:11.

Feb 13 2007

Added performance test for serving speed of OAI repository.
cebcdb1be377
·Jerome Caffaro on Feb 13 2007, 14:20.
Reversed order of additional authors for DC output, in order to match other…
241afb4addb8
·Jerome Caffaro on Feb 13 2007, 11:13.

Feb 12 2007

Improved transformation of marcxml retrieved from database for oaimarcxml…
54fbac1d569d
·Jerome Caffaro on Feb 12 2007, 15:57.
Improved speed for OAI harvesting with verb=ListRecords&metadataPrefix=marcxml.
f634c6df34cf
·Jerome Caffaro on Feb 12 2007, 15:35.
Fixed a wrong regular expression used to retrieve resumptionToken. Thanks to…
05abfcb9f688
·Jerome Caffaro on Feb 12 2007, 08:24.

Feb 9 2007

Improved speed.
8943b041e627
·Jerome Caffaro on Feb 9 2007, 15:11.

Feb 6 2007

Eliminated duplicate sets in OAI-PMH 'ListSets' response. Eliminated duplicates…
b5c8693f96cf
·Jerome Caffaro on Feb 6 2007, 15:33.
Corrected link to guide in the admin pages.
12749fbe911d
·Jerome Caffaro on Feb 6 2007, 15:29.

Jan 26 2007

Fixed   typos, thanks to Ferran Jorba.
4723496fab5a
·Tibor Simko on Jan 26 2007, 15:13.

Jan 12 2007

More detailed status returned by validate() function when validating OAI source.
1840a1f79955
·Jerome Caffaro on Jan 12 2007, 09:54.

Dec 21 2006

Do not output values for records having no id in CFG_OAI_ID_FIELD field.
91bcd564ae37
·Jerome Caffaro on Dec 21 2006, 12:21.
Moved test for unnecessary call to bibupload where it does not break oaiarchive…
4333e7ef9370
·Jerome Caffaro on Dec 21 2006, 10:04.
Do not call bibupload when there is no record to upload.
f3b21369500d
·Jerome Caffaro on Dec 21 2006, 08:47.
Added notice of the need to run oaiarchive utility for the settings in 'OAI…
d8908f8baffe
·Jerome Caffaro on Dec 21 2006, 07:46.
Fixed possible traceback which would occur when table 'oaiARCHIVE' has non…
bb41d3bcc44d
·Jerome Caffaro on Dec 21 2006, 07:31.

Dec 20 2006

Reverted back to the use of column 'setDefinition' in table 'oaiARCHIVE'…
061e2c28e246
·Jerome Caffaro on Dec 20 2006, 08:58.

Dec 7 2006

Removed not-very-expressive "This is the gate..." welcome messages on those…
aeabbc8013e5
·Tibor Simko on Dec 7 2006, 19:31.

Dec 5 2006

Fixed wrong arguments in call to BibUpload from OAIHarvestlib.
12175fb165af
·Jerome Caffaro on Dec 5 2006, 17:02.

Dec 4 2006

Fixed free variable problems (extra).
3964b5563652
·Tibor Simko on Dec 4 2006, 14:15.

R3600/modules/bibharvestmaster071fcd057c5d0a25604ba29…

Apr 15 2008

Apr 7 2008

Apr 4 2008

Mar 31 2008

Mar 26 2008

Mar 25 2008

Mar 23 2008

Mar 12 2008

Mar 11 2008

Mar 10 2008

Mar 5 2008

Feb 8 2008

Feb 7 2008

Feb 4 2008

Jan 31 2008

Jan 11 2008

Jan 9 2008

Dec 20 2007

Dec 19 2007

Dec 17 2007

Dec 13 2007

Dec 12 2007

Dec 7 2007

Dec 6 2007

Nov 14 2007

Nov 9 2007

Nov 8 2007

Oct 17 2007

Sep 11 2007

Sep 10 2007

Aug 14 2007

Aug 10 2007

Aug 7 2007

Aug 3 2007

Jun 21 2007

Jun 18 2007

Jun 14 2007

Jun 13 2007

Jun 12 2007

Jun 6 2007

May 31 2007

May 22 2007

May 16 2007

May 15 2007

May 3 2007

Apr 23 2007

Apr 2 2007

Mar 30 2007

Mar 27 2007

Feb 27 2007

Feb 23 2007

Feb 22 2007

Feb 14 2007

Feb 13 2007

Feb 12 2007

Feb 9 2007

Feb 6 2007

Jan 26 2007

Jan 12 2007

Dec 21 2006

Dec 20 2006

Dec 7 2006

Dec 5 2006

Dec 4 2006

R3600/modules/bibharvest
master071fcd057c5d0a25604ba29…