Specifications for Amazon EC2 high-performance computing instances - Amazon EC2

Specifications for Amazon EC2 high-performance computing instances

High-performance computing instances are purpose built to offer the best price performance for running HPC workloads at scale on AWS. These instances are ideal for applications that benefit from high-performance processors, such as large, complex simulations and deep learning workloads.

Pricing

For pricing information, see Amazon EC2 On-Demand Pricing.

Instance families and instance types

Instance family Available instance types
Hpc6a hpc6a.48xlarge
Hpc6id hpc6id.32xlarge
Hpc7a hpc7a.12xlarge | hpc7a.24xlarge | hpc7a.48xlarge | hpc7a.96xlarge
Hpc7g hpc7g.4xlarge | hpc7g.8xlarge | hpc7g.16xlarge

Instance family summary

Instance family Hypervisor Processor type (architecture) Metal instances available Dedicated Hosts support Spot support Hibernation support Supported operating systems
Hpc6a Nitro v4 AMD (x86_64) Linux
Hpc6id Nitro v4 Intel (x86_64) Windows | Linux
Hpc7a Nitro v4 AMD (x86_64) Windows | Linux
Hpc7g Nitro v5 AWS Graviton (arm64) Linux

Performance specifications

Instance type Burstable Memory (GiB) Processor vCPUs CPU cores Threads per core Accelerators Accelerator memory
Hpc6a
hpc6a.48xlarge 384.00 AMD EPYC 7R13 96 96 1
Hpc6id
hpc6id.32xlarge 1024.00 Intel Xeon Ice Lake 64 64 1
Hpc7a
hpc7a.12xlarge 768.00 AMD EPYC 9R14 24 24 1
hpc7a.24xlarge 768.00 AMD EPYC 9R14 48 48 1
hpc7a.48xlarge 768.00 AMD EPYC 9R14 96 96 1
hpc7a.96xlarge 768.00 AMD EPYC 9R14 192 192 1
Hpc7g
hpc7g.4xlarge 128.00 AWS Graviton3E Processor 16 16 1
hpc7g.8xlarge 128.00 AWS Graviton3E Processor 32 32 1
hpc7g.16xlarge 128.00 AWS Graviton3E Processor 64 64 1

Network specifications

Instance type Baseline / Burst bandwidth (Gbps) EFA ENA ENA Express Network cards Max. network interfaces IP addresses per interface IPv6
Hpc6a
hpc6a.48xlarge 100 Gigabit 1 2 50
Hpc6id
hpc6id.32xlarge 200 Gigabit 2 2 50
Hpc7a
hpc7a.12xlarge 300 Gigabit 2 4 50
hpc7a.24xlarge 300 Gigabit 2 4 50
hpc7a.48xlarge 300 Gigabit 2 4 50
hpc7a.96xlarge 300 Gigabit 2 4 50
Hpc7g
hpc7g.4xlarge 200 Gigabit 1 4 50
hpc7g.8xlarge 200 Gigabit 1 4 50
hpc7g.16xlarge 200 Gigabit 1 4 50

Amazon EBS specifications

The following table indicates which instance types are Amazon EBS optimized by default and which optionally support it. It also describes their EBS-optimized performance, including dedicated bandwidth to Amazon EBS, the typical maximum aggregate throughput that can be achieved on that dedicated connection with a streaming read workload and 128 KiB I/O size, and the maximum IOPS the instance type can support when using a 16 KiB I/O size. Instance types not listed do not support Amazon EBS optimization.

Important

An instance's EBS performance is bounded by the instance's performance limits, or the aggregated performance of its attached volumes, whichever is smaller. To achieve maximum EBS performance, an instance must have attached volumes that provide a combined performance equal to or greater than the maximum instance performance. For example, to achieve 80,000 IOPS for r6i.16xlarge, the instance must have at least 5 gp3 volumes provisioned with 16,000 IOPS each (5 volumes x 16,000 IOPS = 80,000 IOPS).

We recommend that you choose an EBS–optimized instance type that provides more dedicated Amazon EBS throughput than your application needs; otherwise, the connection between Amazon EBS and Amazon EC2 can become a performance bottleneck.

Instance type Baseline / Maximum bandwidth (Mbps) Baseline / Maximum throughput (MB/s, 128 KiB I/O) Baseline / Maximum IOPS (16 KiB I/O) NVMe EBS optimization 2
Hpc6a
hpc6a.48xlarge 1 87.00 / 2085.00 10.88 / 260.62 500.00 / 11000.00 default
Hpc6id
hpc6id.32xlarge 1 87.00 / 2085.00 10.88 / 260.62 500.00 / 11000.00 default
Hpc7a
hpc7a.12xlarge 1 87.00 / 2085.00 10.88 / 260.62 500.00 / 11000.00 default
hpc7a.24xlarge 1 87.00 / 2085.00 10.88 / 260.62 500.00 / 11000.00 default
hpc7a.48xlarge 1 87.00 / 2085.00 10.88 / 260.62 500.00 / 11000.00 default
hpc7a.96xlarge 1 87.00 / 2085.00 10.88 / 260.62 500.00 / 11000.00 default
Hpc7g
hpc7g.4xlarge 1 87.00 / 2085.00 10.88 / 260.62 500.00 / 11000.00 default
hpc7g.8xlarge 1 87.00 / 2085.00 10.88 / 260.62 500.00 / 11000.00 default
hpc7g.16xlarge 1 87.00 / 2085.00 10.88 / 260.62 500.00 / 11000.00 default
Note

1 These instances can support maximum performance for 30 minutes at least once every 24 hours, after which they revert to their baseline performance. Other instances can sustain the maximum performance indefinitely. If your workload requires sustained maximum performance for longer than 30 minutes, use one of these instances.

2 default indicates that instances are enabled for EBS optimization by default. supported indicates that instances can optionally be enabled for EBS optimization For more information, see Amazon EBS–optimized instances.

Instance store specifications

The following table shows the instance store volume configuration for supported instance types, along with the aggregated IOPS performance with 4,096 byte block size at queue depth saturation.

Instance type Instance store volumes Instance store type 100% random read IOPS / Write IOPS Needs initialization 1 TRIM support 2
Hpc6id
hpc6id.32xlarge 4 x 3800 GB NVMe SSD 2,146,664 / 1,073,336

1 Volumes attached to certain instances suffer a first-write penalty unless initialized. For more information, see Optimize disk performance for instance store volumes.

2 For more information, see Instance store volume TRIM support.

Security specifications

Instance type EBS encryption Instance store encryption Encryption in transit AMD SEV-SNP NitroTPM Nitro Enclaves
Hpc6a
hpc6a.48xlarge Instance store not supported
Hpc6id
hpc6id.32xlarge
Hpc7a
hpc7a.12xlarge Instance store not supported
hpc7a.24xlarge Instance store not supported
hpc7a.48xlarge Instance store not supported
hpc7a.96xlarge Instance store not supported
Hpc7g
hpc7g.4xlarge Instance store not supported
hpc7g.8xlarge Instance store not supported
hpc7g.16xlarge Instance store not supported