Diffusion invenio-infoscience (master) History

R3600/modules/bibsched/lib/bibsched.py
master18394890d1898819e40d713…

Dec 11 2008

Improved sleeping technique in BibSched.
18394890d189
·Samuele Kaplun / Tibor Simko on Dec 11 2008, 16:02.

Nov 24 2008

Improved inveniocfg --reset-recstruct-cache algorithm.
42ab3172c600
·Samuele Kaplun on Nov 24 2008, 17:07.

Nov 20 2008

Some fixes to bibsched.
ee40ec555ad1
·Samuele Kaplun / Tibor Simko on Nov 20 2008, 15:39.

Nov 14 2008

Small fixes to bibsched.
922c08a14e97
·Samuele Kaplun on Nov 14 2008, 14:19.
Much lighter and fast algorithm for bibsched.
0f32846354e5
·Samuele Kaplun on Nov 14 2008, 14:04.
Smarter BibSched bibupload handling.
cc726a5c16a1
·Samuele Kaplun on Nov 14 2008, 11:23.

Nov 13 2008

Switching bibsched to manual mode = bibsched halt.
3c329d7292e2
·Samuele Kaplun on Nov 13 2008, 18:19.

Nov 12 2008

Dropped signal usage in bibsched/bibtasks.
795252c39cda
·Samuele Kaplun on Nov 12 2008, 16:47.

Nov 3 2008

BibSched to set env BIBSCHED_MODE.
f630d75326d6
·Samuele Kaplun / Tibor Simko on Nov 3 2008, 17:13.
Amended and merged commit 'sam/bibsched-stop'
adf97774e151
·Tibor Simko on Nov 3 2008, 11:04.
stop->halt graceful->stop restart=halt+start
f0d9cbbf1cd7
·Samuele Kaplun on Nov 3 2008, 08:44.

Oct 31 2008

New --runtime-limit BibTasks CLI parameter.
3e858acdd4e8
·Samuele Kaplun on Oct 31 2008, 17:24.
BibSched graceful stop and new uniformize_bibupload_priorities.
f7fba82d56d2
·Samuele Kaplun on Oct 31 2008, 16:18.

Oct 27 2008

Removed $Id$ from file preamble comments.
51bfbcb9fa42
·Tibor Simko on Oct 27 2008, 22:39.

Oct 24 2008

Merge commit 'sam/bibtask-log-creation'
3bd81c18e163
·Tibor Simko on Oct 24 2008, 15:59.
Improved bibsched/bibtask process user checking.
7c117878a1aa
·Tibor Simko on Oct 24 2008, 12:17.
BibSched/BibTasks to run only with Apache user credentials.
ef3350a2eaff
·Samuele Kaplun on Oct 24 2008, 11:11.

Oct 23 2008

New bibtask log handler.
4980821c1ce0
·Samuele Kaplun on Oct 23 2008, 17:45.

Sep 12 2008

Fixed bad typo bug.
9b0bfca022ee
·Samuele Kaplun on Sep 12 2008, 16:32.

Sep 11 2008

Skip tasks with priority less than 0
21d163e0aabb
·Samuele Kaplun on Sep 11 2008, 15:25.

Jul 30 2008

New register_emergency feature that sends sms to…
5bf0e947cf8d
·Samuele Kaplun on Jul 30 2008, 15:29.

Jul 14 2008

bibupload_in_the_queue reads the real current status of the tasks, while…
13a588ef4863
·Samuele Kaplun on Jul 14 2008, 17:04.
When a task terminates it will send a SIGUSR2 to bibsched in order to make it…
302c57e74379
·Samuele Kaplun on Jul 14 2008, 16:56.

Jun 30 2008

Correct support for stopping the queue when a task finishes with 'DONE WITH…
1d6ffa478e4c
·Samuele Kaplun on Jun 30 2008, 17:48.
It is happening sometimes that a task stays in the status 'SCHEDULED' forever…
55af5de58014
·Samuele Kaplun on Jun 30 2008, 17:10.

Jun 24 2008

Fixed Acknowledge, fixed purge task, shortened and cleaned footers, reversed…
eb271d5bad3c
·Samuele Kaplun on Jun 24 2008, 12:00.

Jun 23 2008

Removed a deadlock WRT bibupload enforced ordering.
ec6f7ec58f86
·Samuele Kaplun on Jun 23 2008, 16:51.

Jun 20 2008

Fixed crash when bibsched queue is empty and we turn on bibsched daemon from…
0f0a0d569e91
·Samuele Kaplun on Jun 20 2008, 09:31.

Jun 19 2008

Fixed code typo (Time to go bed :-S)
037090260200
·Samuele Kaplun on Jun 19 2008, 17:22.
Fixed message string.
614cf61529d6
·Samuele Kaplun on Jun 19 2008, 17:21.
Stop the bibsched queue when a task ends with status "DONE WITH ERRORS".
4b4a34fced72
·Samuele Kaplun on Jun 19 2008, 17:19.

May 27 2008

Added check for analysing tasks in the queue in the past + tasks possibly…
34ac34a48fd9
·Samuele Kaplun on May 27 2008, 16:13.
Trying to fix deadlocks. When a task actively changes status (it is scheduled…
e92b96d66df9
·Samuele Kaplun on May 27 2008, 11:11.

May 23 2008

Bibupload should never run concurrently.
6edcc9561b68
·Samuele Kaplun on May 23 2008, 18:06.
Cleaned logs.
339d23cf3419
·Samuele Kaplun on May 23 2008, 16:42.
Special treatement for bibupload and corrected handling of scheduled task_id.
17f55558a556
·Samuele Kaplun on May 23 2008, 16:28.
Added missing self variable.
893ffca3ec0b
·Samuele Kaplun on May 23 2008, 16:00.

May 18 2008

Clarified some output messages.
1b8409a99096
·Tibor Simko on May 18 2008, 02:20.
Fixed delete action in BibSched Manager (was enabled for exactly the wrong…
1524a2c3d257
·Samuele Kaplun on May 18 2008, 00:46.

May 17 2008

Fixed syntax error.
aeed913c083a
·Tibor Simko on May 17 2008, 23:24.
Many many improvements in appearence, security, concurrency. Added Aknowledge…
658b2e28ba13
·Samuele Kaplun on May 17 2008, 17:54.

May 14 2008

Improved the log file. If lowercase l is pressed then realtime .log file is…
3e8eca087784
·Samuele Kaplun on May 14 2008, 18:39.

May 9 2008

New cleaner scheduler implementation. Should have less bugs and race conditions…
3f438c1f9bc6
·Samuele Kaplun on May 9 2008, 23:07.
After viewing a log, require to press ENTER before returning. Fixed a bug when…
6438136a3f80
·Samuele Kaplun on May 9 2008, 15:32.

Apr 30 2008

Some performance improval, some bugfixes, alerting of admin via email when…
1874e69a9779
·Samuele Kaplun on Apr 30 2008, 16:46.

Apr 29 2008

Enhanced bibsched: * Support for tasks priorities. * Concurrent task execution.
25914cf5719f
·Samuele Kaplun on Apr 29 2008, 18:19.

Apr 25 2008

Priority support in BibSched/BibTasks. Tasks have gained new -P/--priority…
f7f206a04438
·Samuele Kaplun on Apr 25 2008, 18:17.

Apr 18 2008

Fixed get_task_pid algorithm to ping a bibtask for being alive. It now sends…
012c46783997
·Samuele Kaplun on Apr 18 2008, 18:01.

Apr 7 2008

Removed spurious print.
2b6157f5ca69
·Samuele Kaplun on Apr 7 2008, 17:21.

Apr 2 2008

Implemented Third Display Type with archived tasks. Fixed small bugs here and…
621e32812dd0
·Samuele Kaplun on Apr 2 2008, 19:30.
New BibSched purging of BibTask implementation. Not critical tasks are garbage…
006e34bed813
·Samuele Kaplun on Apr 2 2008, 18:24.
Extended status report to support --status, --since, --task.
af5ff41062b4
·Samuele Kaplun on Apr 2 2008, 16:22.

Apr 1 2008

New cleaner signal handling. By using task_sleep_now_if_required(can_stop_too)…
cc5418ab136d
·Samuele Kaplun on Apr 1 2008, 18:59.

Mar 31 2008

New bibsched_low_level_task_submission for enqueing tasks via API. (changes a…
0fb4ae583079
·Samuele Kaplun on Mar 31 2008, 19:08.

Mar 26 2008

Added file existence check for CFG_BIBSCHED_LOG_PAGER.
171c85e4a34c
·Tibor Simko on Mar 26 2008, 22:40.

Mar 10 2008

Updated conf files. Replaced old style variable names (e.g. WEBURL) with new…
6dc20e3ca587
·Tibor Simko on Mar 10 2008, 20:32.

Feb 4 2008

Updated copyright years.
eceb995a1b50
·Tibor Simko on Feb 4 2008, 18:38.

Nov 21 2007

Added a simple queue status reporter in order to quickly inspect the list of…
7fdd29a30847
·Tibor Simko on Nov 21 2007, 16:53.

Nov 6 2007

SessionGC moved to more general InvenioGC. Now support old delete fulltext…
9ab40bcfa745
·Samuele Kaplun on Nov 6 2007, 18:53.

Sep 3 2007

Added infrastructure and a simple skeleton for the forthcoming bibclassify…
cf5ca6dcef73
·Tibor Simko on Sep 3 2007, 16:29.

Jul 27 2007

Added webstatadmin to allowed BibSched apps.
cccbcd4ee51d
·Marcus Johansson on Jul 27 2007, 13:34.

Jul 26 2007

Added function to retrieve list of task ids for a certain task name, and…
cb8c0e32ffd8
·Marcus Johansson on Jul 26 2007, 12:13.
Added function to retrieving, and unpickling, of arguments for a certain task.
f34915e0105e
·Marcus Johansson on Jul 26 2007, 11:18.
Added function to determine whether or not a task is due for execution.
945973ab2e62
·Marcus Johansson on Jul 26 2007, 10:59.

Jun 21 2007

Fixed a typo in the code.
b58104d2157f
·Samuele Kaplun on Jun 21 2007, 12:38.

Jun 20 2007

If the CFG_BIBSCHED_LOG_PAGER is set then we use it's value as the log pager…
90c7c23b4d32
·Samuele Kaplun on Jun 20 2007, 19:17.

Jun 6 2007

Many small changes and fixies to new code
b289ca144768
·Samuele Kaplun on Jun 6 2007, 19:52.

Jun 5 2007

Very small cleaning.
5525a1a68677
·Samuele Kaplun on Jun 5 2007, 17:48.
Implemented log viewer, purge DONE process action and…
9abb0f038c20
·Samuele Kaplun on Jun 5 2007, 16:35.

May 22 2007

Moved from the obsolete sre module to re.
9657e2ace771
·Samuele Kaplun on May 22 2007, 11:54.

Feb 20 2007

Fixed signals sent to bibsched tasks when stopping them. Now using…
1396459dcf01
·Tibor Simko on Feb 20 2007, 14:54.

Feb 14 2007

Updated copyright years (2007).
df75ba0b1feb
·Tibor Simko on Feb 14 2007, 19:31.

Nov 9 2006

When submitting a new periodical task after it has finished, update the task…
6924d227c7f0
·Tibor Simko on Nov 9 2006, 11:04.

Sep 25 2006

Made BibSched refresh time configurable. Set to 5 seconds by default. Note…
2d02bcab416c
·Tibor Simko on Sep 25 2006, 18:10.

Sep 20 2006

BibSched module split into bin/lib completed. Most of the stuff lives in lib.
f12be6fad614
·Tibor Simko on Sep 20 2006, 16:04.