EE-2865: upload with S3 (#36)
EE-2865: upload now uses S3Client. Initially, I used S3TransferManager, but that is no longer supported, as F. Tariq Sulaiman wrote in the INC0015818 [ https://embl.service-now.com/sp?id=ticket&table=incident&sys_id=5e4d54c31bf18e10a32b4043b24bcbc6 ] ServiceNow ticket: "In the meanwhile, we will update our knowledge article that only single stream upload will be available. We will stop supporting multipart before going to production. We will potentially open up multipart upload based on the discussion with s3 v2 java sdk repo owners/collaborators. Note: This could be something unrelated to your actual problem. But the subject says Transfer Manager so we want you to know that we will have to remove the transfer manager support for FIRE s3 write. You can always use 3.putObject(objectRequest, RequestBody.fromByteBuffer(getRandomByteBuffer(10_000))) as described here(https://docs.aws.amazon.com/sdk-for-java/latest/developer-guide/examples-s3-objects.html). " Other than that, I removed some no longer needed dependencies and fixed JaCoCo reporting.
Showing
- README.md 8 additions, 0 deletionsREADME.md
- pom.xml 117 additions, 66 deletionspom.xml
- src/main/java/uk/ac/ebi/ega/fire/exceptions/NonRetryableFireException.java 14 additions, 7 deletions...ac/ebi/ega/fire/exceptions/NonRetryableFireException.java
- src/main/java/uk/ac/ebi/ega/fire/exceptions/RetryableFireException.java 5 additions, 3 deletions...uk/ac/ebi/ega/fire/exceptions/RetryableFireException.java
- src/main/java/uk/ac/ebi/ega/fire/listener/ProgressListener.java 1 addition, 1 deletion...in/java/uk/ac/ebi/ega/fire/listener/ProgressListener.java
- src/main/java/uk/ac/ebi/ega/fire/models/ErrorResponse.java 11 additions, 7 deletionssrc/main/java/uk/ac/ebi/ega/fire/models/ErrorResponse.java
- src/main/java/uk/ac/ebi/ega/fire/models/FileBodyInterceptor.java 0 additions, 79 deletions...n/java/uk/ac/ebi/ega/fire/models/FileBodyInterceptor.java
- src/main/java/uk/ac/ebi/ega/fire/models/FileSystemEntry.java 0 additions, 54 deletionssrc/main/java/uk/ac/ebi/ega/fire/models/FileSystemEntry.java
- src/main/java/uk/ac/ebi/ega/fire/models/FireObjectRequest.java 0 additions, 63 deletions...ain/java/uk/ac/ebi/ega/fire/models/FireObjectRequest.java
- src/main/java/uk/ac/ebi/ega/fire/models/FireObjectResponse.java 0 additions, 107 deletions...in/java/uk/ac/ebi/ega/fire/models/FireObjectResponse.java
- src/main/java/uk/ac/ebi/ega/fire/models/FireResponse.java 27 additions, 46 deletionssrc/main/java/uk/ac/ebi/ega/fire/models/FireResponse.java
- src/main/java/uk/ac/ebi/ega/fire/models/IFireResponse.java 0 additions, 41 deletionssrc/main/java/uk/ac/ebi/ega/fire/models/IFireResponse.java
- src/main/java/uk/ac/ebi/ega/fire/models/KeyValue.java 0 additions, 46 deletionssrc/main/java/uk/ac/ebi/ega/fire/models/KeyValue.java
- src/main/java/uk/ac/ebi/ega/fire/properties/FireProperties.java 15 additions, 63 deletions...in/java/uk/ac/ebi/ega/fire/properties/FireProperties.java
- src/main/java/uk/ac/ebi/ega/fire/properties/HttpClientProperties.java 0 additions, 59 deletions...a/uk/ac/ebi/ega/fire/properties/HttpClientProperties.java
- src/main/java/uk/ac/ebi/ega/fire/s3/ProgressMonitoringInputStream.java 32 additions, 0 deletions.../uk/ac/ebi/ega/fire/s3/ProgressMonitoringInputStream.java
- src/main/java/uk/ac/ebi/ega/fire/s3/S3InputStream.java 5 additions, 4 deletionssrc/main/java/uk/ac/ebi/ega/fire/s3/S3InputStream.java
- src/main/java/uk/ac/ebi/ega/fire/s3/S3Operations.java 0 additions, 9 deletionssrc/main/java/uk/ac/ebi/ega/fire/s3/S3Operations.java
- src/main/java/uk/ac/ebi/ega/fire/service/FireService.java 1415 additions, 0 deletionssrc/main/java/uk/ac/ebi/ega/fire/service/FireService.java
- src/main/java/uk/ac/ebi/ega/fire/service/HttpClientFireService.java 0 additions, 341 deletions...ava/uk/ac/ebi/ega/fire/service/HttpClientFireService.java
Please register or sign in to comment