Homec4science

plotextractor: configurable sleep timer

Authored by Jan Aage Lavik <jan.age.lavik@cern.ch> on Jul 7 2011, 17:08.

Description

plotextractor: configurable sleep timer

  • Adds a new configuration parameter that allows control over the timeout period between file harvests of remote sites.
  • The download() function (and consequently harvest_single()) will no longer enforce any timeout period, as it is only applicable in batch download use cases, leaving any flow-control resposibilities to the caller of these functions when used in such a way.

    Consequently, the plotextractor 'batch-jobs' are now enhanced with simple flow-control, alongside any harvesting tasks in BibHarvest using the plotextractor API. They all will use the above timeout parameter.
  • Specific parameters meant to be configurable for the plotextractor module is now moved to invenio.conf, away from plotextractor_config.

Details

Committed
Tibor Simko <tibor.simko@cern.ch>Aug 5 2011, 17:55
Parents
R3600:f1fd3dccbd19: WebSearch: reinstate the plots tab
Branches
Unknown
Tags
Unknown

Event Timeline

Tibor Simko <tibor.simko@cern.ch> committed R3600:1cf8d1bdcf88: plotextractor: configurable sleep timer (authored by Jan Aage Lavik <jan.age.lavik@cern.ch>).Aug 5 2011, 17:55