Skip to content
GitLab
Projects
Groups
Snippets
Help
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Sign in
Toggle navigation
Open sidebar
ensembl-gh-mirror
ensembl-hive
Commits
22165755
Commit
22165755
authored
Sep 22, 2017
by
Matthieu Muffato
Browse files
Some meadows may disallow job-arrays, in which case we submit jobs one by one
parent
dfbfa4e4
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
10 additions
and
2 deletions
+10
-2
hive_config.json
hive_config.json
+1
-0
scripts/beekeeper.pl
scripts/beekeeper.pl
+9
-2
No files found.
hive_config.json
View file @
22165755
...
...
@@ -10,6 +10,7 @@
"CleanupTempDirectoryKilledWorkers"
:
0
,
"MaxLimboSeconds"
:
10
,
"MaxRegistrationSeconds"
:
30
,
"CanSubmitJobArrays"
:
1
,
"LOCAL"
:
{
"MaxRegistrationSeconds"
:
60
,
"TotalRunningWorkersMax"
:
2
,
...
...
scripts/beekeeper.pl
View file @
22165755
...
...
@@ -585,8 +585,15 @@ sub run_autonomously {
.
(
defined
(
$worker_cmd_args
)
?
"
$worker_cmd_args
"
:
'')
.
'
-preregistered
';
my
$meadow_process_ids
=
$this_meadow
->
submit_workers_return_meadow_pids
(
$specific_worker_cmd
,
$this_meadow_rc_worker_count
,
$iteration
,
$rc_name
,
$submission_cmd_args
||
'',
$submit_log_subdir
);
my
$meadow_process_ids
=
[]
;
if
(
$this_meadow_rc_worker_count
>
1
and
!
$this_meadow
->
config_get
('
CanSubmitJobArrays
'))
{
foreach
my
$i
(
1
..
$this_meadow_rc_worker_count
)
{
my
$submitted_process_id
=
$this_meadow
->
submit_workers_return_meadow_pids
(
$specific_worker_cmd
,
1
,
"
$iteration
.
$i
",
$rc_name
,
$submission_cmd_args
||
'',
$submit_log_subdir
);
push
@$meadow_process_ids
,
$submitted_process_id
->
[
0
];
}
}
else
{
$meadow_process_ids
=
$this_meadow
->
submit_workers_return_meadow_pids
(
$specific_worker_cmd
,
$this_meadow_rc_worker_count
,
$iteration
,
$rc_name
,
$submission_cmd_args
||
'',
$submit_log_subdir
);
}
warn
"
Submitted the following process_ids to
"
.
$this_meadow
->
signature
.
"
:
"
.
join
('
,
',
@$meadow_process_ids
)
.
"
\n
";
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment