Performance improvements suggested
Analysis shows that WES + CWL
is around 10 seconds slower that CWL
alone:
hyperfine 'cwltool dbfetch.cwl --dbName sp --id wap_rat,wap_pig --method fetchBatch --outFormat fasta'
Benchmark #1: cwltool dbfetch.cwl --dbName sp --id wap_rat,wap_pig --method fetchBatch --outFormat fasta
Time (mean ± σ): 3.788 s ± 0.144 s [User: 1.819 s, System: 0.210 s]
Range (min … max): 3.640 s … 4.067 s
The above command is executed in my machine and uses the Docker as default container runner.
hyperfine './wes_request.sh'
Benchmark #1: ./wes_request.sh
Time (mean ± σ): 13.409 s ± 1.961 s [User: 6.681 s, System: 3.073 s]
Range (min … max): 12.023 s … 17.907 s
wes_request.sh
does a POST request and 'polls' (no delay) for the status of the job until completed.
Edited by Ghost User