|
com.amazonaws
aws-java-sdk-bom
>1.12.7871
pom
import
com.amazonaws
aws-java-sdk-s3
| 1 [Versi terbaru](https://central.sonatype.com/artifact/com.amazonaws/aws-java-sdk-bom). 2 [Versi terbaru](https://central.sonatype.com/artifact/software.amazon.awssdk/bom). 3 [Versi terbaru](https://central.sonatype.com/artifact/software.amazon.awssdk.crt/aws-crt). ## Migrasi konstruktor klien ### Konstruktor yang didukung (migrasi otomatis) | V1 konstruktor | V2 setara | Status migrasi | | --- | --- | --- | | new TransferManager() | S3TransferManager.create() | Didukung | | TransferManagerBuilder. defaultTransferManager() | S3TransferManager.create() | Didukung | | TransferManagerBuilder. standard().build() | S3TransferManager.builder().build() | Didukung | | new TransferManager(AWSCredentials) | S3TransferManager.builder() .s3Client(S3AsyncClient.builder() .credentialsProvider(...).build()) .build() | Didukung | | new TransferManager( AWSCredentialsProvider) | S3TransferManager.builder() .s3Client(S3AsyncClient.builder() .credentialsProvider(...).build()) .build() | Didukung | ### Konstruktor yang tidak didukung (diperlukan migrasi manual) | V1 konstruktor | V2 setara | Catatan migrasi | | --- | --- | --- | | new TransferManager(AmazonS3) | Migrasi manual diperlukan | Buat secara S3AsyncClient terpisah | | new TransferManager(AmazonS3, ExecutorService) | Migrasi manual diperlukan | Buat S3AsyncClient dan konfigurasikan eksekutor | | new TransferManager(AmazonS3, ExecutorService, boolean) | Migrasi manual diperlukan | shutDownThreadPoolsparameter tidak didukung | ### Contoh migrasi manual **Kode V1:** ``` AmazonS3 s3Client = AmazonS3ClientBuilder.defaultClient(); TransferManager transferManager = new TransferManager(s3Client); ``` **Kode V2:** ``` // Create an `S3AsyncClient` with similar configuration S3AsyncClient s3AsyncClient = S3AsyncClient.builder() .credentialsProvider(DefaultCredentialsProvider.create()) .build(); // Provide the configured `S3AsyncClient` to the S3 transfer manager builder. S3TransferManager transferManager = S3TransferManager.builder() .s3Client(s3AsyncClient) .build(); ``` ## Migrasi metode klien Saat ini, alat migrasi mendukung dasar `copy``download`,`upload`,`uploadDirectory`,`downloadDirectory`,`resumeDownload`, dan `resumeUpload` metode. ### Metode transfer inti | Metode V1 | Metode V2 | Kembalikan perubahan tipe | Status migrasi | | --- | --- | --- | --- | | upload(String, String, File) | uploadFile(UploadFileRequest) | Upload → FileUpload | Didukung | | upload(PutObjectRequest) | upload(UploadRequest) | Upload → Upload | Didukung | | download(String, String, File) | downloadFile(DownloadFileRequest) | Download → FileDownload | Didukung | | download(GetObjectRequest, File) | downloadFile(DownloadFileRequest) | Download → FileDownload | Didukung | | copy(String, String, String, String) | copy(CopyRequest) | Copy → Copy | Didukung | | copy(CopyObjectRequest) | copy(CopyRequest) | Copy → Copy | Didukung | | uploadDirectory(String, String, File, boolean) | uploadDirectory( UploadDirectoryRequest) | MultipleFileUpload → DirectoryUpload | Didukung | | downloadDirectory(String, String, File) | downloadDirectory( DownloadDirectoryRequest) | MultipleFileDownload → DirectoryDownload | Didukung | ### Metode transfer yang dapat dilanjutkan | Metode V1 | Metode V2 | Status migrasi | | --- | --- | --- | | resumeUpload(PersistableUpload) | resumeUploadFile(ResumableFileUpload) | Didukung | | resumeDownload(PersistableDownload) | resumeDownloadFile(ResumableFileDownload) | Didukung | ### Metode siklus hidup | Metode V1 | Metode V2 | Status migrasi | | --- | --- | --- | | shutdownNow() | close() | Didukung | | shutdownNow(boolean) | Sesuaikan kode secara manual menggunakan close() metode | Tidak Didukung | ### Metode klien V1 yang tidak didukung | Metode V1 | V2 alternatif | Catatan | | --- | --- | --- | | abortMultipartUploads(String, Date) | Gunakan klien Amazon S3 tingkat rendah | Tidak Didukung | | getAmazonS3Client() | Simpan referensi secara terpisah | Tidak Didukung; tidak ada pengambil di v2 | | getConfiguration() | Simpan referensi secara terpisah | Tidak Didukung; tidak ada pengambil di v2 | | uploadFileList(...) | Lakukan beberapa uploadFile() panggilan | Tidak Didukung | | copymetode dengan TransferStateChangeListener parameter | Gunakan TransferListener | [Lihat contoh migrasi manual](#tm-unsupported-client-methods-copy) | | downloadmetode dengan S3ProgressListener parameter | Gunakan [https://sdk.amazonaws.com/java/api/latest/software/amazon/awssdk/transfer/s3/progress/TransferListener.html](https://sdk.amazonaws.com/java/api/latest/software/amazon/awssdk/transfer/s3/progress/TransferListener.html) | [Lihat contoh migrasi manual](#tm-unsupported-client-methods-download) | | `downloadDirectory`metode dengan 4 atau lebih parameter | | [Lihat contoh migrasi manual](#tm-unsupported-client-methods-download-dir) | | uploadmetode dengan ObjectMetadataProvider parameter | Tetapkan metadata dalam permintaan | [Lihat contoh migrasi manual](#tm-unsupported-client-methods-upload) | | uploadDirectorymetode dengan \$1Provider parameter | Tetapkan tag dalam permintaan | [Lihat contoh migrasi manual](#tm-unsupported-client-methods-uploadDirectory) | #### `copy`metode dengan `TransferStateChangeListener` parameter + `copy(CopyObjectRequest copyObjectRequest, AmazonS3 srcS3, TransferStateChangeListener stateChangeListener)` + `copy(CopyObjectRequest copyObjectRequest, TransferStateChangeListener stateChangeListener)` ``` // V1 ---------------------------------------------------------------------------------------------- // Initialize source S3 client AmazonS3 s3client = AmazonS3ClientBuilder.standard() .withRegion("us-west-2") .build(); // Initialize Transfer Manager TransferManager tm = TransferManagerBuilder.standard() .withS3Client(srcS3) .build(); CopyObjectRequest copyObjectRequest = new CopyObjectRequest( "amzn-s3-demo-source-bucket", "source-key", "amzn-s3-demo-destination-bucket", "destination-key" ); TransferStateChangeListener stateChangeListener = new TransferStateChangeListener() { @Override public void transferStateChanged(Transfer transfer, TransferState state) { //Implementation of the TransferStateChangeListener } }; Copy copy = tm.copy(copyObjectRequest, srcS3, stateChangeListener); // V2 ---------------------------------------------------------------------------------------------- S3AsyncClient s3AsyncClient = S3AsyncClient.builder() .region(Region.US_WEST_2) .build(); S3TransferManager transferManager = S3TransferManager.builder() .s3Client(s3AsyncClient) .build(); // Create transfer listener (equivalent to TransferStateChangeListener in v1) TransferListener transferListener = new TransferListener() { @Override public void transferInitiated(Context.TransferInitiated context) { //Implementation System.out.println("Transfer initiated"); } @Override public void bytesTransferred(Context.BytesTransferred context) { //Implementation System.out.println("Bytes transferred"); } @Override public void transferComplete(Context.TransferComplete context) { //Implementation System.out.println("Transfer completed!"); } @Override public void transferFailed(Context.TransferFailed context) { //Implementation System.out.println("Transfer failed"); } }; CopyRequest copyRequest = CopyRequest.builder() .copyObjectRequest(req -> req .sourceBucket("amzn-s3-demo-source-bucket") .sourceKey("source-key") .destinationBucket("amzn-s3-demo-destination-bucket") .destinationKey("destination-key") ) .addTransferListener(transferListener) // Configure the transferListener into the request .build(); Copy copy = transferManager.copy(copyRequest); ``` #### `download`metode dengan `S3ProgressListener` parameter + `download(GetObjectRequest getObjectRequest, File file, S3ProgressListener progressListener)` + `download(GetObjectRequest getObjectRequest, File file, S3ProgressListener progressListener, long timeoutMillis)` + `download(GetObjectRequest getObjectRequest, File file, S3ProgressListener progressListener, long timeoutMillis, boolean resumeOnRetry)` ``` // V1 ---------------------------------------------------------------------------------------------- S3ProgressListener progressListener = new S3ProgressListener() { @Override public void progressChanged(com.amazonaws.event.ProgressEvent progressEvent) { long bytes = progressEvent.getBytesTransferred(); ProgressEventType eventType = progressEvent.getEventType(); // Use bytes and eventType as needed } @Override public void onPersistableTransfer(PersistableTransfer persistableTransfer) { } }; Download download1 = tm.download(getObjectRequest, file, progressListener); Download download2 = tm.download(getObjectRequest, file, progressListener, timeoutMillis) Download download3 = tm.download(getObjectRequest, file, progressListener, timeoutMillis, true) // V2 ---------------------------------------------------------------------------------------------- TransferListener transferListener = new TransferListener() { @Override public void transferInitiated(Context.InitializedContext context) { // Equivalent to ProgressEventType.TRANSFER_STARTED_EVENT System.out.println("Transfer initiated"); } @Override public void bytesTransferred(Context.BytesTransferred context) { // Equivalent to ProgressEventType.REQUEST_BYTE_TRANSFER_EVENT long bytes = context.bytesTransferred(); System.out.println("Bytes transferred: " + bytes); } @Override public void transferComplete(Context.TransferComplete context) { // Equivalent to ProgressEventType.TRANSFER_COMPLETED_EVENT System.out.println("Transfer completed"); } @Override public void transferFailed(Context.TransferFailed context) { // Equivalent to ProgressEventType.TRANSFER_FAILED_EVENT System.out.println("Transfer failed: " + context.exception().getMessage()); } }; DownloadFileRequest downloadFileRequest = DownloadFileRequest.builder() .getObjectRequest(getObjectRequest) .destination(file.toPath()) .addTransferListener(transferListener) .build(); // For download1 FileDownload download = transferManager.downloadFile(downloadFileRequest); // For download2 CompletedFileDownload completedFileDownload = download.completionFuture() .get(timeoutMillis, TimeUnit.MILLISECONDS); // For download3, the v2 SDK does not have a direct equiavalent to the `resumeOnRetry` method of v1. // If a download is interrupted, you need to start a new download request. ``` #### `downloadDirectory`metode dengan 4 atau lebih parameter + `downloadDirectory(String bucketName, String keyPrefix, File destinationDirectory, boolean resumeOnRetry)` + `downloadDirectory(String bucketName, String keyPrefix, File destinationDirectory, boolean resumeOnRetry, KeyFilter filter)` + `downloadDirectory(String bucketName, String keyPrefix, File destinationDirectory, KeyFilter filter)` ``` // V1 ---------------------------------------------------------------------------------------------- KeyFilter filter = new KeyFilter() { @Override public boolean shouldInclude(S3ObjectSummary objectSummary) { //Filter implementation } }; MultipleFileDownload multipleFileDownload = tm.downloadDirectory(bucketName, keyPrefix, destinationDirectory, filter); // V2 ---------------------------------------------------------------------------------------------- // The v2 SDK does not have a direct equiavalent to the `resumeOnRetry` method of v1. // If a download is interrupted, you need to start a new download request. DownloadFilter filter = new DownloadFilter() { @Override public boolean test(S3Object s3Object) { // Filter implementation. } }; DownloadDirectoryRequest downloadDirectoryRequest = DownloadDirectoryRequest.builder() .bucket(bucketName) .filter(filter) .listObjectsV2RequestTransformer(builder -> builder.prefix(keyPrefix)) .destination(destinationDirectory.toPath()) .build(); DirectoryDownload directoryDownload = transferManager.downloadDirectory(downloadDirectoryRequest); ``` #### `upload`metode dengan `ObjectMetadata` parameter + `upload(String bucketName, String key, InputStream input, ObjectMetadata objectMetadata)` ``` // V1 ----------------------------------------------------------------------------------------------ObjectMetadata metadata = new ObjectMetadata(); ObjectMetadata metadata = new ObjectMetadata(); metadata.setContentType("text/plain"); // System-defined metadata metadata.setContentLength(22L); // System-defined metadata metadata.addUserMetadata("myKey", "myValue"); // User-defined metadata PutObjectRequest putObjectRequest = new PutObjectRequest(bucketName, key, inputStream, metadata); Upload upload = transferManager.upload("amzn-s3-demo-bucket", "my-key", inputStream, metadata); // V2 ---------------------------------------------------------------------------------------------- /* When you use an InputStream to upload in V2, you should specify the content length and use `RequestBody.fromInputStream()`. If you don't provide the content length, the entire stream will be buffered in memory. If you can't determine the content length, we recommend using the CRT-based S3 client. */ Map
software.amazon.awssdk
bom
2.31.682
pom
import
software.amazon.awssdk
s3-transfer-manager
software.amazon.awssdk.crt
aws-crt
0.38.53
TransferManagerBuilder tmBuilder =|
TransferManagerBuilder.standard();
S3TransferManager.Builder tmBuilder =| | Klien S3 |
S3TransferManager.builder();
tmBuilder.withS3Client(...);|
tmBuilder.setS3Client(...);
tmBuilder.s3Client(...);| | Pelaksana |
tmBuilder.withExecutorFactory(...);|
tmBuilder.setExecutorFactory(...);
tmBuilder.executor(...);| | Shutdown thread pool |
tmBuilder.withShutDownThreadPools(...);| Tidak didukung. Pelaksana yang disediakan tidak akan dimatikan saat S3TransferManager ditutup | | Ukuran bagian unggahan minimum |
tmBuilder.setShutdownThreadPools(...);
tmBuilder.withMinimumUploadPartSize(...);|
tmBuilder.setMinimumUploadPartSize(...);
S3AsyncClient s3 = S3AsyncClient.crtBuilder().| | Ambang batas unggahan multipart |
minimumPartSizeInBytes(...).build();
tmBuilder.s3Client(s3);
tmBuilder.withMultipartUploadThreshold(...);|
tmBuilder.setMultipartUploadThreshold(...);
S3AsyncClient s3 = S3AsyncClient.crtBuilder().| | Ukuran bagian salinan minimum |
thresholdInBytes(...).build();
tmBuilder.s3Client(s3);
tmBuilder.withMultipartCopyPartSize(...);|
tmBuilder.setMultipartCopyPartSize(...);
S3AsyncClient s3 = S3AsyncClient.crtBuilder().| | Ambang batas salinan multipart |
minimumPartSizeInBytes(...).build();
tmBuilder.s3Client(s3);
tmBuilder.withMultipartCopyThreshold(...);|
tmBuilder.setMultipartCopyThreshold(...);
S3AsyncClient s3 = S3AsyncClient.crtBuilder().| | Nonaktifkan unduhan paralel |
thresholdInBytes(...).build();
tmBuilder.s3Client(s3);
tmBuilder.withDisableParallelDownloads(...);| Nonaktifkan unduhan paralel dengan meneruskan klien S3 berbasis Java standar dengan multipart dinonaktifkan (default) ke manajer transfer.
tmBuilder.setDisableParallelDownloads(...);
S3AsyncClient s3 =| | Selalu hitung multipart md5 |
S3AsyncClient.builder().build();
tmBuilder.s3Client(s3);
tmBuilder.withAlwaysCalculateMultipartMd5(...);| Tidak didukung. | ------ #### [ Use Java-based S3 async client ] **** | Pengaturan | v1 | v2 - Transfer Manager menggunakan klien async S3 berbasis Java | | --- | --- | --- | | (dapatkan pembangun) |
tmBuilder.setAlwaysCalculateMultipartMd5(...);
TransferManagerBuilder tmBuilder =|
TransferManagerBuilder.standard();
S3TransferManager.Builder tmBuilder =| | Klien S3 |
S3TransferManager.builder();
tmBuilder.withS3Client(...);|
tmBuilder.setS3Client(...);
tmBuilder.s3Client(...);| | Pelaksana |
tmBuilder.withExecutorFactory(...);|
tmBuilder.setExecutorFactory(...);
tmBuilder.executor(...);| | Shutdown thread pool |
tmBuilder.withShutDownThreadPools(...);| Tidak didukung. Pelaksana yang disediakan tidak akan dimatikan saat S3TransferManager ditutup | | Ukuran bagian unggahan minimum |
tmBuilder.setShutdownThreadPools(...);
tmBuilder.withMinimumUploadPartSize(...);|
tmBuilder.setMinimumUploadPartSize(...);
S3AsyncClient s3 = S3AsyncClient.builder()| | Ambang batas unggahan multipart |
.multipartConfiguration(cfg ->
cfg.minimumPartSizeInBytes(...)).build();
tmBuilder.s3Client(s3);
tmBuilder.withMultipartUploadThreshold(...);|
tmBuilder.setMultipartUploadThreshold(...);
S3AsyncClient s3 = S3AsyncClient.builder()| | Ukuran bagian salinan minimum |
.multipartConfiguration(cfg ->
cfg.thresholdInBytes(...)).build();
tmBuilder.s3Client(s3);
tmBuilder.withMultipartCopyPartSize(...);|
tmBuilder.setMultipartCopyPartSize(...);
S3AsyncClient s3 = S3AsyncClient.builder()| | Ambang batas salinan multipart |
.multipartConfiguration(cfg ->
cfg.minimumPartSizeInBytes(...)).build();
tmBuilder.s3Client(s3);
tmBuilder.withMultipartCopyThreshold(...);|
tmBuilder.setMultipartCopyThreshold(...);
S3AsyncClient s3 = S3AsyncClient.builder()| | Nonaktifkan unduhan paralel |
.multipartConfiguration(cfg ->
cfg.thresholdInBytes(...)).build();
tmBuilder.s3Client(s3);
tmBuilder.withDisableParallelDownloads(...);| Nonaktifkan unduhan paralel dengan meneruskan klien S3 berbasis Java standar dengan multipart dinonaktifkan (default) ke manajer transfer.
tmBuilder.setDisableParallelDownloads(...);
S3AsyncClient s3 =| | Selalu hitung multipart md5 |
S3AsyncClient.builder().build();
tmBuilder.s3Client(s3);
tmBuilder.withAlwaysCalculateMultipartMd5(...);| Tidak didukung. | ------ ## Perubahan perilaku ### Operasi asinkron **V1 (pemblokiran):** ``` Upload upload = transferManager.upload("amzn-s3-demo-bucket", "key", file); upload.waitForCompletion(); // Blocks until complete ``` **V2 (asinkron):** ``` FileUpload upload = transferManager.uploadFile(UploadFileRequest.builder() .putObjectRequest(PutObjectRequest.builder() .bucket("amzn-s3-demo-bucket") .key("key") .build()) .source(file) .build()); CompletedFileUpload result = upload.completionFuture().join(); // Blocks until complete // Or handle asynchronously: upload.completionFuture().thenAccept(result -> { System.out.println("Upload completed: " + result.response().eTag()); }); ``` ### Penanganan kesalahan **V1:** Transfer direktori gagal sepenuhnya jika ada sub-permintaan yang gagal. **V2:** Transfer direktori berhasil diselesaikan bahkan jika beberapa sub-permintaan gagal. Periksa kesalahan secara eksplisit: ``` DirectoryUpload directoryUpload = transferManager.uploadDirectory(request); CompletedDirectoryUpload result = directoryUpload.completionFuture().join(); // Check for failed transfers if (!result.failedTransfers().isEmpty()) { System.out.println("Some uploads failed:"); result.failedTransfers().forEach(failed -> System.out.println("Failed: " + failed.exception().getMessage())); } ``` ### Unduhan paralel melalui pengambilan rentang byte Ketika fitur transfer paralel otomatis diaktifkan di SDK v2, Manajer Transfer S3 menggunakan [pengambilan rentang byte untuk mengambil](https://docs.aws.amazon.com/AmazonS3/latest/userguide/optimizing-performance-guidelines.html#optimizing-performance-guidelines-get-range) bagian tertentu dari objek secara paralel (unduhan multibagian). Cara objek diunduh dengan v2 tidak tergantung pada bagaimana objek awalnya diunggah. Semua unduhan dapat memperoleh manfaat dari throughput dan konkurensi yang tinggi. Sebaliknya, dengan Transfer Manager v1, penting bagaimana objek awalnya diunggah. Manajer Transfer v1 mengambil bagian-bagian objek dengan cara yang sama seperti bagian-bagian yang diunggah. Jika objek awalnya diunggah sebagai objek tunggal, Manajer Transfer v1 tidak dapat mempercepat proses pengunduhan dengan menggunakan sub-permintaan.
tmBuilder.setAlwaysCalculateMultipartMd5(...);