Diffusion invenio-infoscience (master) History

R3600/modules/bibharvest
masterv1.0.3

Sep 7 2012

BibHarvest: OAI harvesting via HTTP proxy
c990b4a2ce95
·Stefan Hesselbach / Tibor Simko on Sep 7 2012, 14:38.

Feb 29 2012

BibHarvest: optional JSON dependency
df2a1ec0aee6
·Tibor Simko on Feb 29 2012, 14:45.

Feb 15 2012

BibHarvest: check for empty resumptionToken
d27b7f3de128
·Jerome Caffaro / Tibor Simko on Feb 15 2012, 16:00.
BibHarvest: fix MARCXML creation in OAI updater
382bd1377cbf
·Jerome Caffaro / Tibor Simko on Feb 15 2012, 16:00.
BibHarvest: fix MARCXML creation in OAI updater
55e10c4f0263
·Jerome Caffaro / Tibor Simko on Feb 15 2012, 16:00.

Dec 9 2010

BibHarvest: sort remote OAI set names in admin UI
7e864937746e
·Ferran Jorba / Tibor Simko on Dec 9 2010, 13:28.

Dec 8 2010

BibHarvest: fix broken marcxml_filter_out_tags
051f07dd765e
·Samuele Kaplun / Tibor Simko on Dec 8 2010, 11:43.

Dec 6 2010

BibHarvest: add append-mode to upload step
32a1b12f4ff6
·Jan Aage Lavik / Tibor Simko on Dec 6 2010, 10:48.
BibHarvest: plotextractor in harvesting workflow
37970bc2a05a
·Jan Aage Lavik / Tibor Simko on Dec 6 2010, 10:48.

Nov 1 2010

global: update copyright years
8f0027eea7ee
·Tibor Simko on Nov 1 2010, 23:50.
global: CDS Invenio becomes Invenio
d30e56fa001a
·Tibor Simko on Nov 1 2010, 22:08.

Aug 25 2010

xmlmarc2textmarc: rename lib file
bfcf7007a960
·Tibor Simko on Aug 25 2010, 14:48.

Aug 17 2010

kwalitee: adapt disable-msg to new pylint
3c3dc2e7fcc5
·Tibor Simko on Aug 17 2010, 22:36.
BibHarvest: Simple bug fix
ccaad1b67b93
·Benoit Thiell / Tibor Simko on Aug 17 2010, 19:27.
Removal of unused imports
d277958c9e4d
·Benoit Thiell / Tibor Simko on Aug 17 2010, 19:25.

May 17 2010

WebStyle: new handle_file_post API
3a5f96efc511
·Samuele Kaplun / Tibor Simko on May 17 2010, 19:06.

Apr 19 2010

BibHarvest: updated for new BibRecord APIs
1610645b114a
·Jerome Caffaro / Tibor Simko on Apr 19 2010, 13:56.

Feb 26 2010

BibEdit: holding pen integration and interface
8111fa8c1b91
·Tibor Simko on Feb 26 2010, 09:55.

Jan 13 2010

BibHarvest: better harvest daemon argument check
41a9f344c56f
·Jerome Caffaro / Tibor Simko on Jan 13 2010, 14:32.

Sep 29 2009

WebStyle: WSGI web interface handler
052735ae7b68
·Samuele Kaplun / Tibor Simko on Sep 29 2009, 18:31.

Jul 17 2009

BibHarvest: cleaner OAI harvester vs repository
fe19901820d8
·Jerome Caffaro / Tibor Simko on Jul 17 2009, 11:02.

Jul 15 2009

Unified use of md5.md5 vs hashlib.md5
de3d4b5c1275
·Samuele Kaplun / Tibor Simko on Jul 15 2009, 11:10.
Unified use of set vs sets.Set
f6754cfcaebd
·Samuele Kaplun / Tibor Simko on Jul 15 2009, 11:10.

Jun 26 2009

htmlutils: new remove_html_markup() API function
1c3f5175204b
·Tibor Simko on Jun 26 2009, 17:23.

Jun 15 2009

Global move from javadoc to epydoc docstring style
40394efc1646
·Tibor Simko on Jun 15 2009, 18:02.

Apr 20 2009

BibHarvest: fixed undefined variable cases
33f6ce0a7007
·Tibor Simko on Apr 20 2009, 18:17.

Mar 5 2009

textutils: centralized encode_for_xml() function
c3a322f0eaf6
·Benoit Thiell / Tibor Simko on Mar 5 2009, 10:01.

Feb 11 2009

BibHarvest: timestamp harvesting test case fixed
34c9896da7a0
·Jerome Caffaro / Tibor Simko on Feb 11 2009, 11:57.

Dec 2 2008

Fix usage of tabs in code.
7ab0dcd8ea47
·Samuele Kaplun / Tibor Simko on Dec 2 2008, 16:19.

Nov 27 2008

Correctly escaping run_sql() in oai_repository.
ede559aedb86
·Samuele Kaplun / Tibor Simko on Nov 27 2008, 14:47.

Nov 24 2008

Deleted unnecessary cvsignore files.
f80152df3863
·Tibor Simko on Nov 24 2008, 17:08.

Nov 4 2008

New search_engine.get_record function.
9dc22287761b
·Samuele Kaplun on Nov 4 2008, 17:58.

Oct 29 2008

Refactored oaiarchive and simplified usage.
469c776c6f42
·Jerome Caffaro on Oct 29 2008, 08:55.

Oct 28 2008

Merge commit 'jerome/fix-oairepository-admin-interface'
d96a95c30e63
·Tibor Simko on Oct 28 2008, 11:32.
More helpful help.
08d639a715fe
·Jerome Caffaro on Oct 28 2008, 10:38.
Added some tips within the interface.
71eb8c69e8d0
·Jerome Caffaro on Oct 28 2008, 10:36.
Renamed "setCollection" to "collection" to remove ambiguity.
f9f073419dd4
·Jerome Caffaro on Oct 28 2008, 09:00.
Removed unused (?) oaitable(..) function.
18c3e4f8bea0
·Jerome Caffaro on Oct 28 2008, 08:56.
Fixed addition and modifications of settings.
7a8eb43801d6
·Jerome Caffaro on Oct 28 2008, 08:48.

Oct 27 2008

Removed $Id$ from file preamble comments.
51bfbcb9fa42
·Tibor Simko on Oct 27 2008, 22:39.

Oct 24 2008

Merge commit 'sam/cleaning-Makefiles'
d58352e277f8
·Tibor Simko on Oct 24 2008, 15:10.

Oct 23 2008

Merge commit 'jerome/oai-https-harvesting'
f0f6ee3eaf07
·Tibor Simko on Oct 23 2008, 15:19.
Fixed broken link to admin interface.
bd644be57105
·Jerome Caffaro on Oct 23 2008, 11:49.
Added support for HTTPS and authentication
24445ad36851
·Jerome Caffaro on Oct 23 2008, 11:18.

Oct 22 2008

Tried to clean Makefile.am files WRT CLEANFILES variable.
e1842fade1fa
·Samuele Kaplun on Oct 22 2008, 14:47.

Sep 26 2008

Merged task_low_level_submission and task_low_level_submission_tuple.
9a5eb5d174c1
·Samuele Kaplun on Sep 26 2008, 12:14.

Sep 9 2008

Fixed bug that would prevent harvesting of multiple repositories at once (file…
50a211189b9f
·Jerome Caffaro on Sep 9 2008, 08:05.

Aug 29 2008

Holding pen prototype
f34700ca03ee
·Piotr Praczyk on Aug 29 2008, 17:32.

Aug 22 2008

New page for viewing the bibupload logs (.err and .log files in the logs…
e1ccbf8648dd
·Piotr Praczyk on Aug 22 2008, 14:16.

Aug 21 2008

New page for viewing the individual record harvesting history
e43ee67de005
·Piotr Praczyk on Aug 21 2008, 18:57.
The web interface displays all the logged information now
6a349a656c35
·Piotr Praczyk on Aug 21 2008, 16:28.
Added logging when harvesting record and later (when inserting into teh…
2bd13ab78c6e
·Piotr Praczyk on Aug 21 2008, 11:52.

Aug 19 2008

New documentation sections Menu at the top of pages Bug fixes: - Little…
0d119a739a0f
·Piotr Praczyk on Aug 19 2008, 17:31.

Aug 18 2008

New page for displaying daily harvesting logs - displaying the results in…
991b5b87b3fa
·Piotr Praczyk on Aug 18 2008, 19:03.

Aug 15 2008

When testing harvesting source, record should be treated as not existing in the…
7e0be2e93271
·Piotr Praczyk on Aug 15 2008, 16:12.
Little changes in SQL tables connected with logging
349d2e584685
·Piotr Praczyk on Aug 15 2008, 13:59.

Aug 11 2008

New interface for viewing the harvesting history ( splited into months/days ...
6a21a6e38585
·Piotr Praczyk on Aug 11 2008, 18:06.

Aug 8 2008

When checking input dates, check for complete string matching, not only…
6c4fca06bb07
·Jerome Caffaro on Aug 8 2008, 13:39.

Aug 7 2008

Logging of harvested records ( new parameter for bibupload indicating the id of…
ea500c914561
·Piotr Praczyk on Aug 7 2008, 17:32.

Aug 4 2008

Do not raise an exception when trying to clean cache but file is removed in…
826eb1ff1b8b
·Jerome Caffaro on Aug 4 2008, 13:42.

Jul 25 2008

Seed of viewing the harvesting history for a given source
6d5437d0aed1
·Piotr Praczyk on Jul 25 2008, 14:13.

Jul 8 2008

Added example to help.
8c9f14c99796
·Jerome Caffaro on Jul 8 2008, 08:08.
Added a note about bibharvest CLI.
fc532198a32d
·Jerome Caffaro on Jul 8 2008, 08:01.

Jul 4 2008

/tmp/cvs5L0Yky
21985bd499a8
·Piotr Praczyk on Jul 4 2008, 16:14.

Jun 27 2008

Do not insert new source if it is missing some mandatory settings.
06cbd97af879
·Jerome Caffaro on Jun 27 2008, 15:26.

Jun 20 2008

Clarified guide: better differentation of the harvest/export parts, and removed…
b732450aefa5
·Jerome Caffaro on Jun 20 2008, 09:34.

Jun 10 2008

Updated links to BibConvert admin guide.
802973da762e
·Jerome Caffaro on Jun 10 2008, 20:41.

Jun 6 2008

Use new URL of the Invenio demo site.
d5d48f9cbc88
·Tibor Simko on Jun 6 2008, 18:37.
Updated status returned by task. Improved error checking.
469cbafea71f
·Jerome Caffaro on Jun 6 2008, 11:53.

Jun 4 2008

Fixed web test case by adding explicit login and logout actions as prologue and…
ad7649bfe166
·Tibor Simko on Jun 4 2008, 23:23.

May 23 2008

Added -u oaiharvest to bibupload calls.
f9806449bad3
·Samuele Kaplun on May 23 2008, 18:22.

May 19 2008

Display example of input value for "Collection(s)" field.
56b720d53005
·Jerome Caffaro on May 19 2008, 08:00.

May 15 2008

oaiarchive to specify user oaiarchive when launching bibupload.
9b80885fc295
·Samuele Kaplun on May 15 2008, 00:11.

May 12 2008

Remove ln parameter from input form in any case (webinterface_handler is adding…
4541618d8ac2
·Jerome Caffaro on May 12 2008, 15:54.

Apr 15 2008

Initial release of web test for inserting OAI sources.
071fcd057c5d
·Jerome Caffaro on Apr 15 2008, 09:24.

Apr 7 2008

Updating BibSched task progress.
971e8551bfc8
·Jerome Caffaro on Apr 7 2008, 14:05.
Fixed issue with retrieval of cli parameter '--repository'. Do not bibupload…
830c36a1c797
·Jerome Caffaro on Apr 7 2008, 09:50.

Apr 4 2008

Fixed an SQL INSERT statement.
f7bc986ed738
·Jerome Caffaro on Apr 4 2008, 15:32.
Deployed task_sleep_now_if_required to bibharvest suite.
4c475a4f0a85
·Samuele Kaplun on Apr 4 2008, 11:02.

Mar 31 2008

New bibsched_low_level_task_submission for enqueing tasks via API. (changes a…
0fb4ae583079
·Samuele Kaplun on Mar 31 2008, 19:08.

Mar 26 2008

Don't automatically add 'ln' parameter to URIs specified in…
adfe82ceeee4
·Jerome Caffaro on Mar 26 2008, 13:45.
Deleted trailing whitespace in all Python files.
4bc4c73928de
·Tibor Simko on Mar 26 2008, 09:25.

Mar 25 2008

Adapted Makefiles to the new standard webdoc source directory…
e5cf1e00e21a
·Tibor Simko on Mar 25 2008, 16:09.
Raise a 'badArgument' error when the request includes repeated arguments…
dafb9c022092
·Jerome Caffaro on Mar 25 2008, 10:32.

Mar 23 2008

Standardized unit and regression test suite building and running techniques.
3d7e61d5dbcb
·Tibor Simko on Mar 23 2008, 17:15.

Mar 12 2008

Updated codebase to use CFG_SITE_URL instead of weburl everywhere. Updated…
2b99705c3821
·Tibor Simko on Mar 12 2008, 17:47.

Mar 11 2008

Updated codebase to use CFG_SITE_SUPPORT_EMAIL instead of supportemail…
002dd06d18ec
·Tibor Simko on Mar 11 2008, 18:17.
Updated codebase to use CFG_SITE_ADMIN_EMAIL instead of adminemail everywhere.
72c35da585a5
·Tibor Simko on Mar 11 2008, 17:36.
Updated codebase to use CFG_SITE_LANG and CFG_SITE_LANGS instead of cdslang and…
7768546ebf94
·Tibor Simko on Mar 11 2008, 16:08.
Fixed a bunch of XHTML errors.
e457a05883f1
·Samuele Kaplun on Mar 11 2008, 15:31.
Updated codebase to use CFG_SITE_NAME and CFG_SITE_NAME_INTL instead of cdsname…
ca990a4e2355
·Tibor Simko on Mar 11 2008, 12:30.

Mar 10 2008

Updated conf files. Replaced old style variable names (e.g. WEBURL) with new…
6dc20e3ca587
·Tibor Simko on Mar 10 2008, 20:32.

Mar 5 2008

Removed fragile SQL code. Thanks to Gregory Favre (EPFL).
e06bba2c3c05
·Jerome Caffaro on Mar 5 2008, 07:21.

Feb 8 2008

Better checking of admin guides availability.
ca75cb18bbaf
·Jerome Caffaro on Feb 8 2008, 08:44.

Feb 7 2008

Fixed regression tests to check for new webdoc pages.
c782c5bb2544
·Jerome Caffaro on Feb 7 2008, 08:16.

Feb 4 2008

Updated copyright years.
eceb995a1b50
·Tibor Simko on Feb 4 2008, 18:38.

Jan 31 2008

Replaced config.wml with invenio.conf.
6de5f9d0e033
·Tibor Simko on Jan 31 2008, 14:05.

Jan 11 2008

Made a clearer distinction between BibHarvest and OAIRepository. Added…
5335f14bc43e
·Jerome Caffaro on Jan 11 2008, 16:25.

Jan 9 2008

Better checking of input parameters. Fixed related test cases. Fixed bug that…
98f5faed61fb
·Jerome Caffaro on Jan 9 2008, 08:18.

Dec 20 2007

Cosmetic megacommit to standardize whitespaces in WebDoc tags ("<!-- WebDoc-Foo…
29dd5c456425
·Tibor Simko on Dec 20 2007, 14:52.