Diffusion invenio-infoscience (master) History

R3600/modules/bibupload
master28be91be51e5e1ec3afcc95…

Jul 15 2009

Unified use of md5.md5 vs hashlib.md5
de3d4b5c1275
·Samuele Kaplun / Tibor Simko on Jul 15 2009, 11:10.

Jun 18 2009

BibRecord: wider use of glob/loc field positions
400cb8fa70f7
·Benoit Thiell / Tibor Simko on Jun 18 2009, 18:57.

Jun 2 2009

BibUpload: append mode does not duplicates sysnos
531ec73aaca7
·Samuele Kaplun / Tibor Simko on Jun 2 2009, 16:15.
BibUpload: delete mode correctly updates bibxxx
357168a12e2b
·Samuele Kaplun / Tibor Simko on Jun 2 2009, 16:08.

Apr 29 2009

BibUpload: improve --correct documentation
3247a02eb2e0
·Ferran Jorba / Tibor Simko on Apr 29 2009, 11:23.

Apr 28 2009

BibUpload: new --delete mode
bbd312365602
·Samuele Kaplun / Tibor Simko on Apr 28 2009, 23:14.
BibUpload: smarter 8564_ tag merging
e1089a5b77dd
·Samuele Kaplun / Tibor Simko on Apr 28 2009, 14:30.

Apr 8 2009

BibRecord: global/local field positions
3cc7fbd32687
·Benoit Thiell / Tibor Simko on Apr 8 2009, 13:28.

Mar 24 2009

BibUpload: os.path.realpath to os.path.abspath
15d778abe7ce
·Samuele Kaplun / Tibor Simko on Mar 24 2009, 15:30.

Mar 17 2009

BibUpload: FFT -c now appends unexisting docnames
ace2587e7c73
·Samuele Kaplun / Tibor Simko on Mar 17 2009, 17:50.

Feb 23 2009

BibUpload: fixed status updating
704e90f868e5
·Samuele Kaplun / Tibor Simko on Feb 23 2009, 16:14.

Feb 9 2009

BibUpload: fixed task status updating
171b1ce5988c
·Samuele Kaplun / Tibor Simko on Feb 9 2009, 18:15.

Nov 24 2008

Deleted unnecessary cvsignore files.
f80152df3863
·Tibor Simko on Nov 24 2008, 17:08.
BibUpload FIX-MARC not to erase comments/description/icons.
ac5b7d39980d
·Samuele Kaplun / Tibor Simko on Nov 24 2008, 14:40.

Nov 20 2008

Fixed decompose_bibdocfile_url to support CFG_SITE_URL/record/123 URLs
05d992af1e99
·Samuele Kaplun / Tibor Simko on Nov 20 2008, 15:39.

Nov 5 2008

Merged commit 'sam/get_record'
65e03a4d258e
·Tibor Simko on Nov 5 2008, 15:58.
Improved getfile.py old URL support.
eb46c29edd51
·Samuele Kaplun on Nov 5 2008, 11:47.

Nov 4 2008

New search_engine.get_record function.
9dc22287761b
·Samuele Kaplun on Nov 4 2008, 17:58.
DEMOART SBI to exploit FFT in place of Move_Files_to_Storage.
792b897df0a8
·Samuele Kaplun on Nov 4 2008, 15:57.

Nov 3 2008

Fixed keyword MARC tag (6531).
e5a8ed1362dc
·Tibor Simko on Nov 3 2008, 14:56.
Amended and merged commit 'sam/bibupload-protect'
3a15587a90d2
·Tibor Simko on Nov 3 2008, 14:43.

Oct 31 2008

New support for protected tags in bibupload correct.
f231186fbf70
·Samuele Kaplun on Oct 31 2008, 16:27.

Oct 27 2008

Removed $Id$ from file preamble comments.
51bfbcb9fa42
·Tibor Simko on Oct 27 2008, 22:39.

Oct 13 2008

Cleaned implementation of find_records_from_extoaiid WRT extoaisrc.
c3bf13a090f4
·Samuele Kaplun on Oct 13 2008, 14:43.

Sep 10 2008

Added 8564 bibdoc synchronization trigger based on existence of bibdocs.
a0987f79df48
·Samuele Kaplun on Sep 10 2008, 10:57.

Sep 8 2008

Changed prints into write_message(..., verbose=3)
9be906879fa9
·Samuele Kaplun on Sep 8 2008, 11:38.

Aug 29 2008

Holding pen prototype
f34700ca03ee
·Piotr Praczyk on Aug 29 2008, 17:32.

Aug 21 2008

Added logging when harvesting record and later (when inserting into teh…
2bd13ab78c6e
·Piotr Praczyk on Aug 21 2008, 11:52.

Aug 20 2008

Added missing import.
8bad55a7fd5d
·Samuele Kaplun on Aug 20 2008, 14:54.
Improved checking of OAI PROVENANCE subfield (if not specified it behaves like…
8d9a7d7d1219
·Samuele Kaplun on Aug 20 2008, 14:47.
Fixed wrong test (was checking for existence of a wrong URL but because HEAD…
e0698ab285fb
·Samuele Kaplun on Aug 20 2008, 14:45.

Aug 19 2008

New documentation sections Menu at the top of pages Bug fixes: - Little…
0d119a739a0f
·Piotr Praczyk on Aug 19 2008, 17:31.

Aug 18 2008

New page for displaying daily harvesting logs - displaying the results in…
991b5b87b3fa
·Piotr Praczyk on Aug 18 2008, 19:03.
Added support for CFG_BIBUPLOAD_EXTERNAL_OAIID_PROVENANCE_TAG (i.e. support for…
2fb7275849e8
·Samuele Kaplun on Aug 18 2008, 16:20.

Aug 15 2008

Putting back the original record (if it was deleted as part of the bibupload)…
15cc92778b06
·Samuele Kaplun on Aug 15 2008, 19:03.
Little changes in SQL tables connected with logging
349d2e584685
·Piotr Praczyk on Aug 15 2008, 13:59.

Aug 11 2008

Removed logging when oai source identifier is not provided
1a8b0e6a93f6
·Piotr Praczyk on Aug 11 2008, 16:16.

Aug 7 2008

Logging of harvested records ( new parameter for bibupload indicating the id of…
ea500c914561
·Piotr Praczyk on Aug 7 2008, 17:32.

Jul 30 2008

BibUpload not to fails when FFT is empty.
8a8715496f42
·Samuele Kaplun on Jul 30 2008, 17:44.

Jul 29 2008

Better cleaning after text execution (in order not to conflict with bibformat…
573d9b251166
·Samuele Kaplun on Jul 29 2008, 19:22.

Jul 28 2008

New bibupload_pending_recids to automatically discover which recids are…
721c8971094e
·Samuele Kaplun on Jul 28 2008, 14:47.

Jun 30 2008

8564s MARC will be synchronized after bibdocfile tables only if FFT is used or…
8ae591036592
·Samuele Kaplun on Jun 30 2008, 16:39.
Added checks for md5sum in ./configure scripts. bibdoc.touch() to not touch…
1c399a45fe93
·Samuele Kaplun on Jun 30 2008, 12:22.

Jun 27 2008

Clarified documentation with respect to 8564/FFT. Also, reformatted some…
8ab55d60325a
·Tibor Simko on Jun 27 2008, 10:26.

Jun 26 2008

Plugged 8564 synchronization only when 8564 or FFT exists.
036203538091
·Samuele Kaplun on Jun 26 2008, 19:48.
Added note about 8564 to be managed only via FFT.
f555f6bdc461
·Samuele Kaplun on Jun 26 2008, 19:36.
Calling synchronize 8564 for each upload. Fixed FMT regression test that used a…
45dcbab513ac
·Samuele Kaplun on Jun 26 2008, 19:25.

Jun 23 2008

BibDocFile+FFT to correctly support URL encoding (for spaces etc.)
170f2ea119d9
·Samuele Kaplun on Jun 23 2008, 14:28.

Jun 20 2008

New FIX-MARC (+ FIX as become FIX-ALL) directive to bibdocfilecli and FFT, used…
c7ca1047c5ad
·Samuele Kaplun on Jun 20 2008, 12:32.

Jun 19 2008

Improved FFT documentation by adding DELETE-FILE directive and some requirement…
26625dd8cfd4
·Samuele Kaplun on Jun 19 2008, 08:58.
Completed support for DELETE-FILE FFT directive.
28752c24a040
·Samuele Kaplun on Jun 19 2008, 08:53.

Jun 18 2008

When using FFT to rename a docname, take care of renaming the corresponding…
01710b6bb530
·Samuele Kaplun on Jun 18 2008, 18:05.

May 15 2008

Fixed fix call.
1e74a99408ee
·Samuele Kaplun on May 15 2008, 10:16.

May 13 2008

Changed socket default timeout from 10s to 40s. This could maybe help in…
2c9671cc8f33
·Samuele Kaplun on May 13 2008, 23:21.

Apr 16 2008

When FFT revising, if restriction/comment/description/icon is not specified, it…
b4895deb2d5b
·Samuele Kaplun on Apr 16 2008, 13:46.

Apr 15 2008

Mega commit that includes: Added support for keeping comments and descriptions…
9840677d2f4a
·Samuele Kaplun on Apr 15 2008, 16:02.
Corrected bad indentation previously committed due to misconfiguration of…
e7f7419ef6b2
·Samuele Kaplun on Apr 15 2008, 11:09.
Deployed fix_argv_paths to fix relative path issues on the command line.
8cc3b43a8385
·Samuele Kaplun on Apr 15 2008, 10:39.

Apr 7 2008

Moved some key functions out to bibdocfile. Implemented failing recid on first…
17044e7b5b7b
·Samuele Kaplun on Apr 7 2008, 17:39.
Moved CFG_BIBUPLOAD_FFT_ALLOWED_LOCAL_PATHS from bibupload_config to invenio.
c5e789cc70a2
·Samuele Kaplun on Apr 7 2008, 17:20.

Apr 3 2008

Added timeout to socket operations (e.g. urlopen) in order not to possibly hang…
614dabc993b4
·Samuele Kaplun on Apr 3 2008, 16:56.
Deployed task_sleep_now_if_required in bibupload.
c7a2cb2becc8
·Samuele Kaplun on Apr 3 2008, 13:45.

Mar 31 2008

Fixed _options & _task_params not declared.
bb8b59146af7
·Samuele Kaplun on Mar 31 2008, 21:15.
New bibsched_low_level_task_submission for enqueing tasks via API. (changes a…
0fb4ae583079
·Samuele Kaplun on Mar 31 2008, 19:08.

Mar 27 2008

Moved globally interesting CFG variables from local foo_config.py files into…
b00299effbda
·Tibor Simko on Mar 27 2008, 00:26.

Mar 25 2008

Adapted Makefiles to the new standard webdoc source directory…
e5cf1e00e21a
·Tibor Simko on Mar 25 2008, 16:09.

Mar 23 2008

Standardized unit and regression test suite building and running techniques.
3d7e61d5dbcb
·Tibor Simko on Mar 23 2008, 17:15.

Mar 20 2008

Strengthened FFT error checking. Improved regression tests.
91d7d8661bc9
·Samuele Kaplun on Mar 20 2008, 12:30.
Moved (-s, --stage) option to (-S --stage) because of clashing with (-s…
f98123ae167b
·Samuele Kaplun on Mar 20 2008, 10:23.
Added regression test to test for FFT writing rights and made regression tests…
994daaa6d7b9
·Samuele Kaplun on Mar 20 2008, 09:47.

Mar 14 2008

Restored original behaviour of storing current time as last_update time when…
86a7c9bdabe1
·Samuele Kaplun on Mar 14 2008, 19:21.
Completed bibupload support for $d in FMT, plugged check in a test case.
c118ff633251
·Samuele Kaplun on Mar 14 2008, 15:37.
Added d field to FMT tag to provide modification_date to bibupload.
a16b57aed69d
·Samuele Kaplun on Mar 14 2008, 15:10.

Mar 12 2008

Updated codebase to use CFG_SITE_URL instead of weburl everywhere. Updated…
2b99705c3821
·Tibor Simko on Mar 12 2008, 17:47.

Mar 11 2008

Phased out legacy variables 'accessurl', 'urlpath', 'images', 'htdocsurl' used…
fe3f00b1b042
·Tibor Simko on Mar 11 2008, 19:33.
Fixed <br> in *.webdoc.
f594d24fc1bb
·Samuele Kaplun on Mar 11 2008, 16:30.

Mar 10 2008

Updated conf files. Replaced old style variable names (e.g. WEBURL) with new…
6dc20e3ca587
·Tibor Simko on Mar 10 2008, 20:32.

Mar 7 2008

Fixed lowering of format bug. Now a file with extension .ps.Z can be happily…
ceb60d4f9bd2
·Samuele Kaplun on Mar 7 2008, 13:36.
Fixed bug that prevented to correctly append documents via FFT.
f5d952728470
·Samuele Kaplun on Mar 7 2008, 11:08.

Feb 14 2008

Fixed doc concerning REVERT functionality.
f69eed335c44
·Tibor Simko on Feb 14 2008, 18:36.
Formalized __str__() method of BibRecDocs, BibDoc, BibDocFile. Fixed sorting of…
6538e4e25bad
·Samuele Kaplun on Feb 14 2008, 16:01.

Feb 13 2008

Added by mistake to repository. Now removed.
6921f71419b0
·Samuele Kaplun on Feb 13 2008, 19:21.
Changed behaviour of Bibupload WRT FFT when --replace is used. It now behaves…
013cf6ac8e3f
·Samuele Kaplun on Feb 13 2008, 19:21.

Feb 4 2008

Updated copyright years.
eceb995a1b50
·Tibor Simko on Feb 4 2008, 18:38.

Jan 17 2008

Fixed archive_marcxml_for_history() for cases when the upload is being done not…
ecdbd413672d
·Tibor Simko on Jan 17 2008, 12:28.

Jan 16 2008

Fixed couple of typos in FFT guide.
699457aed413
·Samuele Kaplun on Jan 16 2008, 15:23.

Jan 9 2008

Activated writing of MARCXML versions to hstRECORD.
b544aae8d91b
·Tibor Simko on Jan 9 2008, 18:17.

Dec 20 2007

Cosmetic megacommit to standardize whitespaces in WebDoc tags ("<!-- WebDoc-Foo…
29dd5c456425
·Tibor Simko on Dec 20 2007, 14:52.
Removed WebDoc-Page-Navbar-Name and WebDoc-Page-Navbar-Select.
9ead20fd440e
·Jerome Caffaro on Dec 20 2007, 13:43.

Dec 13 2007

Phased out BibUpload Admin static intro page.
7ffbb0873cf4
·Tibor Simko on Dec 13 2007, 12:00.

Dec 7 2007

Beautified variable names.
351c7f61401f
·Samuele Kaplun on Dec 7 2007, 18:36.

Dec 6 2007

New bibdocfile library for handling fulltextes, to be used in place of file.py.
1b0dac2bf837
·Samuele Kaplun on Dec 6 2007, 17:33.
Verified webdoc files, removed WML files.
f7ea1d7731c0
·Tibor Simko on Dec 6 2007, 09:35.

Nov 30 2007

1) Bibupload FFT to support bibdocfile, 2) bibupload FFT to support icon…
3d8dbbfdba21
·Samuele Kaplun on Nov 30 2007, 17:47.

Nov 14 2007

WebDocified admin guide.
8827cfb6b2d4
·Jerome Caffaro on Nov 14 2007, 14:15.

Nov 13 2007

New bunch of regression tests for FFT.
c388f0ba6cab
·Samuele Kaplun on Nov 13 2007, 18:49.
Small bug-fixes for FFT and added verbose mode.
60b52cc20f11
·Samuele Kaplun on Nov 13 2007, 18:49.

Nov 12 2007

Added new FFT regression tests.
d77bfbec6c35
·Samuele Kaplun on Nov 12 2007, 18:07.
Trying to fix some bugs with FFTs and added support for wiping out all linked…
7da63e726510
·Samuele Kaplun on Nov 12 2007, 18:06.

Nov 8 2007

Deleted unused find_record_bibfmt(). Removed unused MySQLdb import. The file…
8d8837afe404
·Tibor Simko on Nov 8 2007, 14:58.