Diffusion invenio-infoscience (master) History

bibdocfile.py
master65e03a4d258e11abd928150…

Nov 5 2008

Merged commit 'sam/get_record'
65e03a4d258e
·Tibor Simko on Nov 5 2008, 15:58.
Merged commit 'sam/bibdocfile-hidden-flag'
32cf6c19a7ce
·Tibor Simko on Nov 5 2008, 14:58.
New hidden flag for bibdocmoreinfo.
ca50075fdc45
·Samuele Kaplun on Nov 5 2008, 11:47.
Improved getfile.py old URL support.
eb46c29edd51
·Samuele Kaplun on Nov 5 2008, 11:47.

Nov 4 2008

New search_engine.get_record function.
9dc22287761b
·Samuele Kaplun on Nov 4 2008, 17:58.
DEMOART SBI to exploit FFT in place of Move_Files_to_Storage.
792b897df0a8
·Samuele Kaplun on Nov 4 2008, 15:57.

Oct 3 2008

Support for magic library in bibdocfile.
136f37daa5e5
·Samuele Kaplun on Oct 3 2008, 11:35.

Oct 2 2008

Many fixes and improvements.
863925b33704
·Samuele Kaplun on Oct 2 2008, 18:46.
New checking+fixing algorithms for docname issues.
6459ff5e9be0
·Samuele Kaplun on Oct 2 2008, 18:46.

Sep 23 2008

Fixed typo bug.
147856eadb24
·Samuele Kaplun on Sep 23 2008, 19:11.

Sep 19 2008

New method to merge two bibdocs. 1st tentative of fix_format algorithm (still…
276c03b40cd3
·Samuele Kaplun on Sep 19 2008, 19:17.

Sep 15 2008

Oops!
c450dd4ac2a1
·Samuele Kaplun on Sep 15 2008, 16:06.
Correctly generating extension list (custom extension not specifing the initial…
b64541ac47f9
·Samuele Kaplun on Sep 15 2008, 15:54.
Disabled fix_format
935fbcd043b9
·Samuele Kaplun on Sep 15 2008, 07:15.
Protected range header parsing.
9d734994a314
·Samuele Kaplun on Sep 15 2008, 07:13.

Aug 21 2008

Found ultimate bug in multipart/byteranges support. The error was due only to…
b91e25b05291
·Samuele Kaplun on Aug 21 2008, 10:49.

Aug 20 2008

Finally(?) fixed support for multirange...
008f78ac7242
·Samuele Kaplun on Aug 20 2008, 18:31.

Aug 19 2008

Deployed complete support for HTTP HEAD with semantic correctness (tm). i.e.
93b6e9ed5653
·Samuele Kaplun on Aug 19 2008, 18:13.
Commented out support for ranges, until mod_python support chunked encoding.
d1a44433a9f2
·Samuele Kaplun on Aug 19 2008, 11:18.
Improved/completed support for HEAD requests.
d904599c2fb7
·Samuele Kaplun on Aug 19 2008, 10:35.
Fixed paramters used to call BibDoc.add_file_new_format() from BibRecDocs.
e193dd8e4bf4
·Jerome Caffaro on Aug 19 2008, 09:35.

Aug 14 2008

Refactored stream_file function.
11f5142c6707
·Samuele Kaplun on Aug 14 2008, 18:04.
Removed experimental row.
4ce515cb732a
·Samuele Kaplun on Aug 14 2008, 11:13.

Aug 13 2008

New support for Content-Location.
4ae988271013
·Samuele Kaplun on Aug 13 2008, 17:06.

Aug 11 2008

Fixed support for date in IE6
1b855ca419fb
·Samuele Kaplun on Aug 11 2008, 15:02.

Aug 8 2008

Corrected range.
cdd72f47420e
·Samuele Kaplun on Aug 8 2008, 11:33.

Aug 7 2008

Cleaning
e29e32894ab1
·Samuele Kaplun on Aug 7 2008, 19:19.
Using binascii for checksum calculation for compatibility with Python 2.3
9cbac4dc2581
·Samuele Kaplun on Aug 7 2008, 16:33.
Enhanced support for range.
fec195eacad3
·Samuele Kaplun on Aug 7 2008, 15:48.

Aug 6 2008

Correct support for Content-MD5, If-Match, If-Range in stream_file.
d20faa0e0c24
·Samuele Kaplun on Aug 6 2008, 20:06.

Aug 4 2008

Supporting HEAD
5d269b9e6ec6
·Samuele Kaplun on Aug 4 2008, 18:09.
Added support for partial streaming of a file and for MD5 header.
90975085f9cd
·Samuele Kaplun on Aug 4 2008, 17:46.
Fixed back the return
2e1c1ca76a28
·Samuele Kaplun on Aug 4 2008, 15:20.
Aadded complete support for if-modified-since and if-none-match HTTP headers in…
811cc2a78daf
·Samuele Kaplun on Aug 4 2008, 15:15.
Added HTTP ETag suppor.
5cc61c453aeb
·Samuele Kaplun on Aug 4 2008, 14:13.

Jul 31 2008

New safe_mkstemp function that generates random temporary names without '.'…
a941bfc1d7e3
·Samuele Kaplun on Jul 31 2008, 19:20.

Jul 30 2008

Decompose_file to exploit os.path.basename to accept ':' in names.
c143bff7eec0
·Samuele Kaplun on Jul 30 2008, 17:24.
Fixed bugs in download_url
0ac99c648bd3
·Samuele Kaplun on Jul 30 2008, 15:26.

Jul 29 2008

Fixed missing parameter in calling of stream_file in stream_restricted_req.
380dac9d22f6
·Samuele Kaplun on Jul 29 2008, 18:13.
Added support for setting user and password when downloading via download_url.
02a654b97b3a
·Samuele Kaplun on Jul 29 2008, 17:42.

Jul 28 2008

New generic stream_file function.
c2bc5145e780
·Samuele Kaplun on Jul 28 2008, 15:06.
When streaming a file, the checksum is verified only with a probability of 1/4…
995c9a7dd306
·Samuele Kaplun on Jul 28 2008, 11:29.
Improved streaming header.
1bc3ce2f4843
·Samuele Kaplun on Jul 28 2008, 11:25.

Jul 18 2008

Added propose_next_docname handy function. bibdoc.delete to use microseconds…
78e6ae3a7d4c
·Samuele Kaplun on Jul 18 2008, 15:41.

Jul 17 2008

Added support for description/comment to bibrecdocs.add_new_file.
3260dc07cee3
·Samuele Kaplun on Jul 17 2008, 18:18.

Jul 15 2008

Plugged checks for empty files. Empty files should not be stored in a digital…
7ca96c4817c1
·Samuele Kaplun on Jul 15 2008, 15:46.
Expunge to really expunge any traces of a bibdoc.
81fd483ddd8f
·Samuele Kaplun on Jul 15 2008, 14:48.

Jul 14 2008

new format_already_exists_p API function for BibDoc object. download_url to use…
67029bc7a610
·Samuele Kaplun on Jul 14 2008, 18:41.

Jun 30 2008

Added checks for md5sum in ./configure scripts. bibdoc.touch() to not touch…
1c399a45fe93
·Samuele Kaplun on Jun 30 2008, 12:22.

Jun 29 2008

Use detected CFG_PATH_WGET.
cec1b35b48fe
·Tibor Simko on Jun 29 2008, 23:15.

Jun 27 2008

Wget with timeout.
e48586fd1998
·Samuele Kaplun on Jun 27 2008, 19:12.
download_url to use wget because urllib/socket are influenced by signals(!?)
a69e1c37926f
·Samuele Kaplun on Jun 27 2008, 18:45.
Try to download twice a file before giving up in case of error.
dff066e77296
·Samuele Kaplun on Jun 27 2008, 15:12.
Added sleeping before download option.
0719798c5b37
·Samuele Kaplun on Jun 27 2008, 10:49.
Addedd missing import
076d90462409
·Samuele Kaplun on Jun 27 2008, 10:17.

Jun 26 2008

Fixed wrong mkstemp implementation in download_url, that always left opened…
1ccaf6e5adbc
·Samuele Kaplun on Jun 26 2008, 17:23.

Jun 23 2008

BibDocFile+FFT to correctly support URL encoding (for spaces etc.)
170f2ea119d9
·Samuele Kaplun on Jun 23 2008, 14:28.

Jun 17 2008

Creation of bibdoc folder is done automatically when it does not exist (e.g.
1194ebe3e1c4
·Samuele Kaplun on Jun 17 2008, 18:20.
Handling of invalid file name (e.g. "foo.bar", "foo.bar;baz", where the correct…
e4fafa0ad29d
·Samuele Kaplun on Jun 17 2008, 16:37.

May 23 2008

Improved a bit the autorecognition of docnames.
066bb38b1c8d
·Samuele Kaplun on May 23 2008, 11:59.

May 14 2008

Better closed mkstemp-created files.
e12a89b824b5
·Samuele Kaplun on May 14 2008, 17:49.
Fixed mkstemp calls that leaved open files.
6d17ad8b673e
·Samuele Kaplun on May 14 2008, 16:42.

May 13 2008

Changed socket default timeout from 10s to 40s. This could maybe help in…
2c9671cc8f33
·Samuele Kaplun on May 13 2008, 23:21.

May 11 2008

Reimplemented readfile with the old behaviour of silently returning empty…
78a7271f977c
·Samuele Kaplun on May 11 2008, 19:51.
Restored old behaviour of register_download: upper case extension without dot.
01253cbec882
·Samuele Kaplun on May 11 2008, 16:33.

May 10 2008

Added few new methods that are useful for the future bibdocfilecli.
86ddc493371f
·Samuele Kaplun on May 10 2008, 10:50.

Apr 22 2008

Fixed small bug introduced after uniformizing date handling in BibDocFile.
3759dbd0c008
·Samuele Kaplun on Apr 22 2008, 17:11.
Pylinted "file" -> "afile" Missing import fixed. Fix algorithm to import…
52c3e2cd2004
·Samuele Kaplun on Apr 22 2008, 15:52.
Fixed bibdocfile handling of comments/descriptions not working on old versions…
e1557aa24136
·Samuele Kaplun on Apr 22 2008, 14:07.

Apr 18 2008

Fixed small bugs.
7a7fab013c82
·Samuele Kaplun on Apr 18 2008, 18:21.
* get_xml_8564 to return all the 8564 tags of the record. The local one, built…
1c92801728b1
·Samuele Kaplun on Apr 18 2008, 18:10.

Apr 15 2008

Addedd --revise option.
a8d688c70a48
·Samuele Kaplun on Apr 15 2008, 18:59.
If bibdoc.set_status('KEEP-OLD-VALUE'), don't touch the status. BibRecDocs to…
30aa277693f0
·Samuele Kaplun on Apr 15 2008, 18:10.
Mega commit that includes: Added support for keeping comments and descriptions…
9840677d2f4a
·Samuele Kaplun on Apr 15 2008, 16:02.

Apr 7 2008

Added version information to bibdoc url. Added get_docname_from_url…
a157e454dbb2
·Samuele Kaplun on Apr 7 2008, 17:34.

Apr 4 2008

New functions added to bibdocfile to ease querying the BibDocs. New bibdocfile…
6ee3cdaf9860
·Samuele Kaplun on Apr 4 2008, 18:53.

Apr 3 2008

Added timeout to socket operations (e.g. urlopen) in order not to possibly hang…
614dabc993b4
·Samuele Kaplun on Apr 3 2008, 16:56.

Mar 18 2008

Added CFG_WEBSUBMIT_ADDITIONAL_KNOWN_FILE_EXTENSIONS.
e5cda21214b1
·Samuele Kaplun on Mar 18 2008, 14:46.

Mar 12 2008

Updated codebase to use CFG_SITE_URL instead of weburl everywhere. Updated…
2b99705c3821
·Tibor Simko on Mar 12 2008, 17:47.
Updated codebase to use CFG_SITE_SECURE_URL instead of sweburl everywhere. The…
e2e54b3a1d85
·Tibor Simko on Mar 12 2008, 14:37.
Fixed a template argument name (imagepath->imageurl).
2f0c1d0a4233
·Tibor Simko on Mar 12 2008, 12:29.

Mar 11 2008

Phased out legacy variables 'accessurl', 'urlpath', 'images', 'htdocsurl' used…
fe3f00b1b042
·Tibor Simko on Mar 11 2008, 19:33.
Fixed code WRT pylint errors.
334a51e2dee4
·Samuele Kaplun on Mar 11 2008, 16:16.
Updated codebase to use CFG_SITE_LANG and CFG_SITE_LANGS instead of cdslang and…
7768546ebf94
·Tibor Simko on Mar 11 2008, 16:08.

Mar 10 2008

Updated conf files. Replaced old style variable names (e.g. WEBURL) with new…
6dc20e3ca587
·Tibor Simko on Mar 10 2008, 20:32.

Mar 7 2008

Added check for existence of md5sum (e.g. it doesn't exist on MacOS X).
e460d6be09cb
·Samuele Kaplun on Mar 7 2008, 15:41.
Fixed bug that prevented recognizing .ps.Z as a valid format file.
c5df153feee0
·Samuele Kaplun on Mar 7 2008, 11:07.

Feb 22 2008

Fixed typo in touch() last commit. Addeded very detailed logging to the…
95760f506c45
·Samuele Kaplun on Feb 22 2008, 16:09.
Update bibrec modification time when bibdoc is modified. NOTE: are there any…
2ea4f397f86a
·Samuele Kaplun on Feb 22 2008, 10:15.

Feb 14 2008

Formalized __str__() method of BibRecDocs, BibDoc, BibDocFile. Fixed sorting of…
6538e4e25bad
·Samuele Kaplun on Feb 14 2008, 16:01.

Feb 4 2008

Updated copyright years.
eceb995a1b50
·Tibor Simko on Feb 4 2008, 18:38.

Jan 23 2008

Improved security handling WRT collections. Fixed security flaw in which users…
f15c39142b66
·Samuele Kaplun on Jan 23 2008, 17:12.

Jan 17 2008

Removed normalization for filenames and format. Added __str__ & __repr__…
e5c17167f352
·Samuele Kaplun on Jan 17 2008, 18:35.

Jan 16 2008

Updated normalize format to transform '.jpg' into '.jpeg'. Does anybody of any…
b25f65e86b18
·Samuele Kaplun on Jan 16 2008, 15:12.

Jan 15 2008

Renamed dontcare variables to dummy variable (to follow Pylint standard).
bb0c9708ee72
·Samuele Kaplun on Jan 15 2008, 17:15.

Dec 7 2007

Fixed zero_version_bug (versions start from 1, fulltext_files_migration_kit…
5bc48a03bbc9
·Samuele Kaplun on Dec 7 2007, 14:35.

Dec 6 2007

Strengthened readfile function (raise nice exception.)
b421dd74ad5b
·Samuele Kaplun on Dec 6 2007, 18:50.
New bibdocfile library for handling fulltextes, to be used in place of file.py.
1b0dac2bf837
·Samuele Kaplun on Dec 6 2007, 17:33.

Dec 5 2007

Temporarily disactivated _log_action function.
d6e0e150b174
·Samuele Kaplun on Dec 5 2007, 16:41.

Dec 4 2007

First proposal for implementing logging on database of bibdocfile library…
d48d96c94d07
·Samuele Kaplun on Dec 4 2007, 12:52.

R3600/modules/websubmit/lib/bibdocfile.pymaster65e03a4d258e11abd928150…

Nov 5 2008

Nov 4 2008

Oct 3 2008

Oct 2 2008

Sep 23 2008

Sep 19 2008

Sep 15 2008

Aug 21 2008

Aug 20 2008

Aug 19 2008

Aug 14 2008

Aug 13 2008

Aug 11 2008

Aug 8 2008

Aug 7 2008

Aug 6 2008

Aug 4 2008

Jul 31 2008

Jul 30 2008

Jul 29 2008

Jul 28 2008

Jul 18 2008

Jul 17 2008

Jul 15 2008

Jul 14 2008

Jun 30 2008

Jun 29 2008

Jun 27 2008

Jun 26 2008

Jun 23 2008

Jun 17 2008

May 23 2008

May 14 2008

May 13 2008

May 11 2008

May 10 2008

Apr 22 2008

Apr 18 2008

Apr 15 2008

Apr 7 2008

Apr 4 2008

Apr 3 2008

Mar 18 2008

Mar 12 2008

Mar 11 2008

Mar 10 2008

Mar 7 2008

Feb 22 2008

Feb 14 2008

Feb 4 2008

Jan 23 2008

Jan 17 2008

Jan 16 2008

Jan 15 2008

Dec 7 2007

Dec 6 2007

Dec 5 2007

Dec 4 2007

R3600/modules/websubmit/lib/bibdocfile.py
master65e03a4d258e11abd928150…