# Bio::EnsEMBL::Hive project # # Copyright Team Ensembl # You may distribute this package under the same terms as perl itself Contact Jessica Severin on implemetation/design detail: jessica@ebi.ac.uk Contact Ewan Birney on EnsEMBL in general: birney@sanger.ac.uk Summary: This is a distributed processing system based on 'autonomous agents' and Hive behavioural structure of Honey Bees . It implements all functionality of both data-flow graphs and block-branch diagrams which should allow it to codify any program, algorithm, or parallel processing job control system. It is not bound to any processing 'farm' system and can be adapted to any GRID. It builds on the design of the Ensembl Pipeline and presently uses Bio::EnsEMBL::Pipeline::RunnableDB perl wrapper objects as nodes/blocks in the graphs but could be adapted more generally. 7 June, 2004 : Jessica Severin This project is under active development and should be classified as per-alpha Most of the design has been settled and I'm in the process of implementing the details but entire objects could disappear or drastically change as I approach the end. Watch this space for further developments
Jessica Severin
authored
job reseting. This allowed direct UPDATE..WHERE.. sql to be used.
Also changed the retry_count system: retry_count is only incremented
for jobs that failed (status in ('GET_INPUT','RUN','WRITE_OUTPUT')).
Job that were CLAIMED by the dead worker are just reset without
incrementing the retry_count since they were never attempted to run.
Also the fetching of claimed jobs now has an 'ORDER BY retry_count'
so that jobs that have failed are at the bottom of the list of jobs
to process. This allows the 'bad' jobs to filter themselves out.| Name | Last commit | Last update |
|---|---|---|
| modules/Bio/EnsEMBL/Hive | ||
| scripts | ||
| sql | ||
| README |