|
com.amazonaws
aws-java-sdk-bom
>1.12.7871
pom
import
com.amazonaws
aws-java-sdk-s3
| 1 [Ultima versione](https://central.sonatype.com/artifact/com.amazonaws/aws-java-sdk-bom). 2 [Ultima versione](https://central.sonatype.com/artifact/software.amazon.awssdk/bom). 3 [Ultima versione](https://central.sonatype.com/artifact/software.amazon.awssdk.crt/aws-crt). ## Migrazione di Client Constructor ### Costruttori supportati (migrazione automatica) | Costruttore V1 | Equivalente a V2 | Stato migrazione | | --- | --- | --- | | new TransferManager() | S3TransferManager.create() | Supportata | | TransferManagerBuilder. defaultTransferManager() | S3TransferManager.create() | Supportato | | TransferManagerBuilder. standard().build() | S3TransferManager.builder().build() | Supportato | | new TransferManager(AWSCredentials) | S3TransferManager.builder() .s3Client(S3AsyncClient.builder() .credentialsProvider(...).build()) .build() | Supportato | | new TransferManager( AWSCredentialsProvider) | S3TransferManager.builder() .s3Client(S3AsyncClient.builder() .credentialsProvider(...).build()) .build() | Supportata | ### Costruttori non supportati (è richiesta la migrazione manuale) | Costruttore V1 | Equivalente a V2 | Note sulla migrazione | | --- | --- | --- | | new TransferManager(AmazonS3) | È richiesta la migrazione manuale | Crea un file S3AsyncClient separato | | new TransferManager(AmazonS3, ExecutorService) | È richiesta la migrazione manuale | Crea S3AsyncClient e configura un executor | | new TransferManager(AmazonS3, ExecutorService, boolean) | È richiesta la migrazione manuale | shutDownThreadPoolsparametro non supportato | ### Esempi di migrazione manuale **Codice V1:** ``` AmazonS3 s3Client = AmazonS3ClientBuilder.defaultClient(); TransferManager transferManager = new TransferManager(s3Client); ``` **Codice V2:** ``` // Create an `S3AsyncClient` with similar configuration S3AsyncClient s3AsyncClient = S3AsyncClient.builder() .credentialsProvider(DefaultCredentialsProvider.create()) .build(); // Provide the configured `S3AsyncClient` to the S3 transfer manager builder. S3TransferManager transferManager = S3TransferManager.builder() .s3Client(s3AsyncClient) .build(); ``` ## Migrazione del metodo client Attualmente, lo strumento di migrazione supporta `resumeUpload` metodi di base `copy` `download` `upload``uploadDirectory`,`downloadDirectory`,`resumeDownload`,, e. ### Metodi di trasferimento di base | Metodo V1 | Metodo V2 | Modifica del tipo di restituzione | Stato migrazione | | --- | --- | --- | --- | | upload(String, String, File) | uploadFile(UploadFileRequest) | Upload → FileUpload | Supportata | | upload(PutObjectRequest) | upload(UploadRequest) | Upload → Upload | Supportato | | download(String, String, File) | downloadFile(DownloadFileRequest) | Download → FileDownload | Supportato | | download(GetObjectRequest, File) | downloadFile(DownloadFileRequest) | Download → FileDownload | Supportato | | copy(String, String, String, String) | copy(CopyRequest) | Copy → Copy | Supportato | | copy(CopyObjectRequest) | copy(CopyRequest) | Copy → Copy | Supportato | | uploadDirectory(String, String, File, boolean) | uploadDirectory( UploadDirectoryRequest) | MultipleFileUpload → DirectoryUpload | Supportato | | downloadDirectory(String, String, File) | downloadDirectory( DownloadDirectoryRequest) | MultipleFileDownload → DirectoryDownload | Supportata | ### Metodi di trasferimento riutilizzabili | Metodo V1 | Metodo V2 | Stato migrazione | | --- | --- | --- | | resumeUpload(PersistableUpload) | resumeUploadFile(ResumableFileUpload) | Supportata | | resumeDownload(PersistableDownload) | resumeDownloadFile(ResumableFileDownload) | Supportata | ### Metodi del ciclo di vita | Metodo V1 | Metodo V2 | Stato migrazione | | --- | --- | --- | | shutdownNow() | close() | Supportata | | shutdownNow(boolean) | Regola manualmente il codice usando il metodo close() | Non supportato | ### Metodi client V1 non supportati | Metodo V1 | Alternativa V2 | Note | | --- | --- | --- | | abortMultipartUploads(String, Date) | Usa il client Amazon S3 di basso livello | Non supportato | | getAmazonS3Client() | Salva un riferimento separatamente | Non supportato; nessun getter nella v2 | | getConfiguration() | Salva un riferimento separatamente | Non supportato; nessun getter nella v2 | | uploadFileList(...) | Effettua più chiamate uploadFile() | Non supportato | | copymetodi con un TransferStateChangeListener parametro | Utilizzare TransferListener | [Vedi esempio di migrazione manuale](#tm-unsupported-client-methods-copy) | | downloadmetodi con un S3ProgressListener parametro | Utilizzare [https://sdk.amazonaws.com/java/api/latest/software/amazon/awssdk/transfer/s3/progress/TransferListener.html](https://sdk.amazonaws.com/java/api/latest/software/amazon/awssdk/transfer/s3/progress/TransferListener.html) | [Vedi esempio di migrazione manuale](#tm-unsupported-client-methods-download) | | `downloadDirectory`metodi con 4 o più parametri | | [Vedi esempio di migrazione manuale](#tm-unsupported-client-methods-download-dir) | | uploadmetodo con un ObjectMetadataProvider parametro | Imposta i metadati nella richiesta | [Vedi esempio di migrazione manuale](#tm-unsupported-client-methods-upload) | | uploadDirectorymetodi con \$1Provider parametro | Imposta i tag nella richiesta | [Vedi esempio di migrazione manuale](#tm-unsupported-client-methods-uploadDirectory) | #### `copy`metodi con un `TransferStateChangeListener` parametro + `copy(CopyObjectRequest copyObjectRequest, AmazonS3 srcS3, TransferStateChangeListener stateChangeListener)` + `copy(CopyObjectRequest copyObjectRequest, TransferStateChangeListener stateChangeListener)` ``` // V1 ---------------------------------------------------------------------------------------------- // Initialize source S3 client AmazonS3 s3client = AmazonS3ClientBuilder.standard() .withRegion("us-west-2") .build(); // Initialize Transfer Manager TransferManager tm = TransferManagerBuilder.standard() .withS3Client(srcS3) .build(); CopyObjectRequest copyObjectRequest = new CopyObjectRequest( "amzn-s3-demo-source-bucket", "source-key", "amzn-s3-demo-destination-bucket", "destination-key" ); TransferStateChangeListener stateChangeListener = new TransferStateChangeListener() { @Override public void transferStateChanged(Transfer transfer, TransferState state) { //Implementation of the TransferStateChangeListener } }; Copy copy = tm.copy(copyObjectRequest, srcS3, stateChangeListener); // V2 ---------------------------------------------------------------------------------------------- S3AsyncClient s3AsyncClient = S3AsyncClient.builder() .region(Region.US_WEST_2) .build(); S3TransferManager transferManager = S3TransferManager.builder() .s3Client(s3AsyncClient) .build(); // Create transfer listener (equivalent to TransferStateChangeListener in v1) TransferListener transferListener = new TransferListener() { @Override public void transferInitiated(Context.TransferInitiated context) { //Implementation System.out.println("Transfer initiated"); } @Override public void bytesTransferred(Context.BytesTransferred context) { //Implementation System.out.println("Bytes transferred"); } @Override public void transferComplete(Context.TransferComplete context) { //Implementation System.out.println("Transfer completed!"); } @Override public void transferFailed(Context.TransferFailed context) { //Implementation System.out.println("Transfer failed"); } }; CopyRequest copyRequest = CopyRequest.builder() .copyObjectRequest(req -> req .sourceBucket("amzn-s3-demo-source-bucket") .sourceKey("source-key") .destinationBucket("amzn-s3-demo-destination-bucket") .destinationKey("destination-key") ) .addTransferListener(transferListener) // Configure the transferListener into the request .build(); Copy copy = transferManager.copy(copyRequest); ``` #### `download`metodi con un `S3ProgressListener` parametro + `download(GetObjectRequest getObjectRequest, File file, S3ProgressListener progressListener)` + `download(GetObjectRequest getObjectRequest, File file, S3ProgressListener progressListener, long timeoutMillis)` + `download(GetObjectRequest getObjectRequest, File file, S3ProgressListener progressListener, long timeoutMillis, boolean resumeOnRetry)` ``` // V1 ---------------------------------------------------------------------------------------------- S3ProgressListener progressListener = new S3ProgressListener() { @Override public void progressChanged(com.amazonaws.event.ProgressEvent progressEvent) { long bytes = progressEvent.getBytesTransferred(); ProgressEventType eventType = progressEvent.getEventType(); // Use bytes and eventType as needed } @Override public void onPersistableTransfer(PersistableTransfer persistableTransfer) { } }; Download download1 = tm.download(getObjectRequest, file, progressListener); Download download2 = tm.download(getObjectRequest, file, progressListener, timeoutMillis) Download download3 = tm.download(getObjectRequest, file, progressListener, timeoutMillis, true) // V2 ---------------------------------------------------------------------------------------------- TransferListener transferListener = new TransferListener() { @Override public void transferInitiated(Context.InitializedContext context) { // Equivalent to ProgressEventType.TRANSFER_STARTED_EVENT System.out.println("Transfer initiated"); } @Override public void bytesTransferred(Context.BytesTransferred context) { // Equivalent to ProgressEventType.REQUEST_BYTE_TRANSFER_EVENT long bytes = context.bytesTransferred(); System.out.println("Bytes transferred: " + bytes); } @Override public void transferComplete(Context.TransferComplete context) { // Equivalent to ProgressEventType.TRANSFER_COMPLETED_EVENT System.out.println("Transfer completed"); } @Override public void transferFailed(Context.TransferFailed context) { // Equivalent to ProgressEventType.TRANSFER_FAILED_EVENT System.out.println("Transfer failed: " + context.exception().getMessage()); } }; DownloadFileRequest downloadFileRequest = DownloadFileRequest.builder() .getObjectRequest(getObjectRequest) .destination(file.toPath()) .addTransferListener(transferListener) .build(); // For download1 FileDownload download = transferManager.downloadFile(downloadFileRequest); // For download2 CompletedFileDownload completedFileDownload = download.completionFuture() .get(timeoutMillis, TimeUnit.MILLISECONDS); // For download3, the v2 SDK does not have a direct equiavalent to the `resumeOnRetry` method of v1. // If a download is interrupted, you need to start a new download request. ``` #### `downloadDirectory`metodi con 4 o più parametri + `downloadDirectory(String bucketName, String keyPrefix, File destinationDirectory, boolean resumeOnRetry)` + `downloadDirectory(String bucketName, String keyPrefix, File destinationDirectory, boolean resumeOnRetry, KeyFilter filter)` + `downloadDirectory(String bucketName, String keyPrefix, File destinationDirectory, KeyFilter filter)` ``` // V1 ---------------------------------------------------------------------------------------------- KeyFilter filter = new KeyFilter() { @Override public boolean shouldInclude(S3ObjectSummary objectSummary) { //Filter implementation } }; MultipleFileDownload multipleFileDownload = tm.downloadDirectory(bucketName, keyPrefix, destinationDirectory, filter); // V2 ---------------------------------------------------------------------------------------------- // The v2 SDK does not have a direct equiavalent to the `resumeOnRetry` method of v1. // If a download is interrupted, you need to start a new download request. DownloadFilter filter = new DownloadFilter() { @Override public boolean test(S3Object s3Object) { // Filter implementation. } }; DownloadDirectoryRequest downloadDirectoryRequest = DownloadDirectoryRequest.builder() .bucket(bucketName) .filter(filter) .listObjectsV2RequestTransformer(builder -> builder.prefix(keyPrefix)) .destination(destinationDirectory.toPath()) .build(); DirectoryDownload directoryDownload = transferManager.downloadDirectory(downloadDirectoryRequest); ``` #### `upload`metodo con `ObjectMetadata` parametro + `upload(String bucketName, String key, InputStream input, ObjectMetadata objectMetadata)` ``` // V1 ----------------------------------------------------------------------------------------------ObjectMetadata metadata = new ObjectMetadata(); ObjectMetadata metadata = new ObjectMetadata(); metadata.setContentType("text/plain"); // System-defined metadata metadata.setContentLength(22L); // System-defined metadata metadata.addUserMetadata("myKey", "myValue"); // User-defined metadata PutObjectRequest putObjectRequest = new PutObjectRequest(bucketName, key, inputStream, metadata); Upload upload = transferManager.upload("amzn-s3-demo-bucket", "my-key", inputStream, metadata); // V2 ---------------------------------------------------------------------------------------------- /* When you use an InputStream to upload in V2, you should specify the content length and use `RequestBody.fromInputStream()`. If you don't provide the content length, the entire stream will be buffered in memory. If you can't determine the content length, we recommend using the CRT-based S3 client. */ Map
software.amazon.awssdk
bom
2.31.682
pom
import
software.amazon.awssdk
s3-transfer-manager
software.amazon.awssdk.crt
aws-crt
0.38.53
TransferManagerBuilder tmBuilder =|
TransferManagerBuilder.standard();
S3TransferManager.Builder tmBuilder =| | client S3 |
S3TransferManager.builder();
tmBuilder.withS3Client(...);|
tmBuilder.setS3Client(...);
tmBuilder.s3Client(...);| | Esecutore |
tmBuilder.withExecutorFactory(...);|
tmBuilder.setExecutorFactory(...);
tmBuilder.executor(...);| | Chiudi i pool di thread |
tmBuilder.withShutDownThreadPools(...);| Non supportato. L'esecutore fornito non verrà spento quando viene chiuso S3TransferManager | | Dimensione minima della parte da caricare |
tmBuilder.setShutdownThreadPools(...);
tmBuilder.withMinimumUploadPartSize(...);|
tmBuilder.setMinimumUploadPartSize(...);
S3AsyncClient s3 = S3AsyncClient.crtBuilder().| | Soglia di caricamento in più parti |
minimumPartSizeInBytes(...).build();
tmBuilder.s3Client(s3);
tmBuilder.withMultipartUploadThreshold(...);|
tmBuilder.setMultipartUploadThreshold(...);
S3AsyncClient s3 = S3AsyncClient.crtBuilder().| | Dimensione minima della parte di copia |
thresholdInBytes(...).build();
tmBuilder.s3Client(s3);
tmBuilder.withMultipartCopyPartSize(...);|
tmBuilder.setMultipartCopyPartSize(...);
S3AsyncClient s3 = S3AsyncClient.crtBuilder().| | Soglia di copia multiparte |
minimumPartSizeInBytes(...).build();
tmBuilder.s3Client(s3);
tmBuilder.withMultipartCopyThreshold(...);|
tmBuilder.setMultipartCopyThreshold(...);
S3AsyncClient s3 = S3AsyncClient.crtBuilder().| | Disattiva i download paralleli |
thresholdInBytes(...).build();
tmBuilder.s3Client(s3);
tmBuilder.withDisableParallelDownloads(...);| Disabilita i download paralleli passando un client S3 standard basato su Java con multipart disabilitato (impostazione predefinita) al gestore di trasferimento.
tmBuilder.setDisableParallelDownloads(...);
S3AsyncClient s3 =| | Calcola sempre md5 multipart |
S3AsyncClient.builder().build();
tmBuilder.s3Client(s3);
tmBuilder.withAlwaysCalculateMultipartMd5(...);| Non supportato. | ------ #### [ Use Java-based S3 async client ] **** | Impostazione | v1 | v2 - Transfer Manager che utilizza un client asincrono S3 basato su Java | | --- | --- | --- | | (procurati un costruttore) |
tmBuilder.setAlwaysCalculateMultipartMd5(...);
TransferManagerBuilder tmBuilder =|
TransferManagerBuilder.standard();
S3TransferManager.Builder tmBuilder =| | client S3 |
S3TransferManager.builder();
tmBuilder.withS3Client(...);|
tmBuilder.setS3Client(...);
tmBuilder.s3Client(...);| | Esecutore |
tmBuilder.withExecutorFactory(...);|
tmBuilder.setExecutorFactory(...);
tmBuilder.executor(...);| | Chiudi i pool di thread |
tmBuilder.withShutDownThreadPools(...);| Non supportato. L'esecutore fornito non verrà spento quando viene chiuso S3TransferManager | | Dimensione minima della parte da caricare |
tmBuilder.setShutdownThreadPools(...);
tmBuilder.withMinimumUploadPartSize(...);|
tmBuilder.setMinimumUploadPartSize(...);
S3AsyncClient s3 = S3AsyncClient.builder()| | Soglia di caricamento in più parti |
.multipartConfiguration(cfg ->
cfg.minimumPartSizeInBytes(...)).build();
tmBuilder.s3Client(s3);
tmBuilder.withMultipartUploadThreshold(...);|
tmBuilder.setMultipartUploadThreshold(...);
S3AsyncClient s3 = S3AsyncClient.builder()| | Dimensione minima della parte di copia |
.multipartConfiguration(cfg ->
cfg.thresholdInBytes(...)).build();
tmBuilder.s3Client(s3);
tmBuilder.withMultipartCopyPartSize(...);|
tmBuilder.setMultipartCopyPartSize(...);
S3AsyncClient s3 = S3AsyncClient.builder()| | Soglia di copia multiparte |
.multipartConfiguration(cfg ->
cfg.minimumPartSizeInBytes(...)).build();
tmBuilder.s3Client(s3);
tmBuilder.withMultipartCopyThreshold(...);|
tmBuilder.setMultipartCopyThreshold(...);
S3AsyncClient s3 = S3AsyncClient.builder()| | Disattiva i download paralleli |
.multipartConfiguration(cfg ->
cfg.thresholdInBytes(...)).build();
tmBuilder.s3Client(s3);
tmBuilder.withDisableParallelDownloads(...);| Disabilita i download paralleli passando un client S3 standard basato su Java con multipart disabilitato (impostazione predefinita) al gestore di trasferimento.
tmBuilder.setDisableParallelDownloads(...);
S3AsyncClient s3 =| | Calcola sempre md5 multipart |
S3AsyncClient.builder().build();
tmBuilder.s3Client(s3);
tmBuilder.withAlwaysCalculateMultipartMd5(...);| Non supportato. | ------ ## Modifiche del comportamento ### Operazioni asincrone **V1 (blocco):** ``` Upload upload = transferManager.upload("amzn-s3-demo-bucket", "key", file); upload.waitForCompletion(); // Blocks until complete ``` **V2 (asincrono):** ``` FileUpload upload = transferManager.uploadFile(UploadFileRequest.builder() .putObjectRequest(PutObjectRequest.builder() .bucket("amzn-s3-demo-bucket") .key("key") .build()) .source(file) .build()); CompletedFileUpload result = upload.completionFuture().join(); // Blocks until complete // Or handle asynchronously: upload.completionFuture().thenAccept(result -> { System.out.println("Upload completed: " + result.response().eTag()); }); ``` ### Gestione degli errori **V1:** I trasferimenti di directory falliscono completamente se una richiesta secondaria fallisce. **V2:** I trasferimenti di directory vengono completati correttamente anche se alcune richieste secondarie falliscono. Verifica la presenza di errori in modo esplicito: ``` DirectoryUpload directoryUpload = transferManager.uploadDirectory(request); CompletedDirectoryUpload result = directoryUpload.completionFuture().join(); // Check for failed transfers if (!result.failedTransfers().isEmpty()) { System.out.println("Some uploads failed:"); result.failedTransfers().forEach(failed -> System.out.println("Failed: " + failed.exception().getMessage())); } ``` ### Download parallelo tramite recuperi a intervalli di byte Quando la funzionalità di trasferimento parallelo automatico è abilitata nell'SDK v2, S3 Transfer Manager utilizza [recuperi a intervalli di byte](https://docs.aws.amazon.com/AmazonS3/latest/userguide/optimizing-performance-guidelines.html#optimizing-performance-guidelines-get-range) per recuperare parti specifiche dell'oggetto in parallelo (download multipart). Il modo in cui un oggetto viene scaricato con v2 non dipende da come l'oggetto è stato originariamente caricato. Tutti i download possono trarre vantaggio da un throughput e da una concorrenza elevati. Al contrario, con Transfer Manager della v1, è importante il modo in cui l'oggetto è stato originariamente caricato. Il v1 Transfer Manager recupera le parti dell'oggetto nello stesso modo in cui le parti sono state caricate. Se un oggetto è stato originariamente caricato come oggetto singolo, v1 Transfer Manager non è in grado di accelerare il processo di download utilizzando richieste secondarie.
tmBuilder.setAlwaysCalculateMultipartMd5(...);