File system metrics - FSx for ONTAP

File system metrics

Your Amazon FSx for NetApp ONTAP file system metrics are classified as either File system metrics or Detailed file system metrics.

  • File system metrics are aggregate performance and storage metrics for a single file system that take a single dimension, FileSystemId. These metrics measure network performance and storage capacity usage for your file system.

  • Detailed file system metrics measure your file system's storage capacity and used storage in each storage tier (for example, SSD storage and capacity pool storage). Each metric includes a FileSystemId, StorageTier, and DataType dimension.

Note the following about when Amazon FSx publishes data points for these metrics to CloudWatch:

  • For the utilization metrics (any metric whose name ends in Utilization, such as NetworkThroughputUtilization), there is a data point emitted each period for every active file server or aggregate. For example, Amazon FSx emits one minutely metric per active file server for FileServerDiskIopsUtilization, and one minutely metric per aggregate for DiskIopsUtilization.

  • For all other metrics, there is a single data point emitted each period, corresponding to the total value of the metric across all of your active file servers (such as DataReadBytes for file server metrics) or all of your aggregates (such as DiskReadBytes for storage metrics).

Network I/O metrics

All of these metrics take one dimension, FileSystemId.

Metric Description
NetworkThroughputUtilization

The percent utilization of network throughput for the file system.

The Average statistic is the average network throughput utilization of the file system over a specified period.

The Minimum statistic is the lowest network throughput utilization of the file system over a specified period.

The Maximum statistic is the highest network throughput utilization of the file system over a specified period.

Units: Percent

Valid statistics: Average, Minimum, and Maximum

NetworkSentBytes

The number of bytes (network I/O) sent by the file system.

The Sum statistic is the total number of bytes sent by the file system over a specified period.

To calculate sent throughput (bytes per second) for any statistic, divide the statistic by the seconds in the specified period.

Units: Bytes

Valid statistics: Sum

NetworkReceivedBytes

The number of bytes (network I/O) received by the file system.

The Sum statistic is the total number of bytes received by the file system over a specified period.

To calculate received throughput (bytes per second) for any statistic, divide the statistic by the seconds in the specified period.

Units: Bytes

Valid statistics: Sum

DataReadBytes

The number of bytes (network I/O) from reads by clients to the file system.

The Sum statistic is the total number of bytes associated with read operations during the specified period. To calculate the average throughput (bytes per second) for a period, divide the Sum statistic by the number of seconds in the specified period.

Units: Bytes

Valid statistics: Sum

DataWriteBytes

The number of bytes (network I/O) from writes by clients to the file system.

The Sum statistic is the total number of bytes associated with write operations during the specified period. To calculate the average throughput (bytes per second) for a period, divide the Sum statistic by the number of seconds in the specified period.

Units: Bytes

Valid statistics: Sum

DataReadOperations

The count of read operations (network I/O) from reads by clients to the file system.

The Sum statistic is the total number of I/O operations that occurred over a specified period. To calculate the average read operations per second for a period, divide the Sum statistic by the number of seconds in the specified period.

Units: Count

Valid statistics: Sum

DataWriteOperations

The count of write operations (network I/O) from writes by clients to the file system.

The Sum statistic is the total number of I/O operations that occurred over a specified period. To calculate the average write operations per second for a period, divide the Sum statistic by the number of seconds in the specified period.

Units: Count

Valid statistics: Sum

MetadataOperations

The count of metadata operations (network I/O) by clients to the file system.

The Sum statistic is the total number of I/O operations that occurred over a specified period. To calculate the average metadata operations per second for a period, divide the Sum statistic by the number of seconds in the specified period.

Units: Count

Valid statistics: Sum

DataReadOperationTime

The sum of total time spent within the file system for read operations (network I/O) from clients accessing data in the file system.

The Sum statistic is the total number of seconds spent by read operations during the specified period. To calculate the average read latency for a period, divide the Sum statistic by the Sum of the DataReadOperations metric over the same period.

Units: Seconds

Valid statistics: Sum

DataWriteOperationTime

The sum of total time spent within the file system for fulfilling write operations (network I/O) from clients accessing data in the file system.

The Sum statistic is the total number of seconds spent by write operations during the specified period. To calculate the average write latency for a period, divide the Sum statistic by the Sum of the DataWriteOperations metric over the same period.

Units: Seconds

Valid statistics: Sum

CapacityPoolReadBytes

The number of bytes read (network I/O) from the file system's capacity pool tier.

To ensure data integrity, ONTAP performs a read operation on the capacity pool immediately after performing a write operation.

The Sum statistic is the total number of bytes read from the file system's capacity pool tier over a specified period. To calculate capacity pool bytes per second, divide the Sum statistic by the seconds in a specified period.

Units: Bytes

Valid statistics: Sum

CapacityPoolReadOperations

The number of read operations (network I/O) from the file system's capacity pool tier. This translates to a capacity pool read request.

To ensure data integrity, ONTAP performs a read operation on the capacity pool immediately after performing a write operation.

The Sum statistic is the total number of read operations from the file system's capacity pool tier over a specified period. To calculate capacity pool requests per second, divide the Sum statistic by the seconds in a specified period.

Units: Count

Valid statistics: Sum

CapacityPoolWriteBytes

The number of bytes written (network I/O) to the file system's capacity pool tier.

To ensure data integrity, ONTAP performs a read operation on the capacity pool immediately after performing a write operation.

The Sum statistic is the total number of bytes written to the file system's capacity pool tier over a specified period. To calculate capacity pool bytes per second, divide the Sum statistic by the seconds in a specified period.

Units: Bytes

Valid statistics: Sum

CapacityPoolWriteOperations

The number of write operations (network I/O) to the file system from the capacity pool tier. This translates to a write request.

To ensure data integrity, ONTAP performs a read operation on the capacity pool immediately after performing a write operation.

The Sum statistic is the total number of write operations to the file system's capacity pool tier over a specified period. To calculate capacity pool requests per second, divide the Sum statistic by the seconds in a specified period.

Units: Count

Valid statistics: Sum

File server metrics

All of these metrics take one dimension, FileSystemId.

Metric Description
CPUUtilization

The percent utilization of the file system's CPU resources.

The Average statistic is the average CPU utilization of the file system over a specified period.

The Minimum statistic is the lowest CPU utilization of the file system over a specified period.

The Maximum statistic is the highest CPU utilization of the file system over a specified period.

Units: Percent

Valid statistics: Average, Minimum, and Maximum

FileServerDiskThroughputUtilization

The disk throughput between your file server and the primary tier, as a percentage of the provisioned limit determined by throughput capacity.

The Average statistic is the average percent utilization of the file servers' disk throughput over a specified period.

The Minimum statistic is the lowest percent utilization of the file servers' disk throughput over a specified period.

The Maximum statistic is the highest utilization of the file servers' disk throughput over a specified period.

Units: Percent

Valid statistics: Average, Minimum, and Maximum

FileServerDiskThroughputBalance

The percentage of available burst credits for disk throughput between your file server and the primary tier. This is valid for file systems that are provisioned with a throughput capacity of 512 MBps or less.

The Average statistic is the average burst balance available over a specified period.

The Minimum statistic is the minimum burst balance available over a specified period.

The Maximum statistic is the maximum burst balance available over a specified period.

Units: Percent

Valid statistics: Average, Minimum, and Maximum

FileServerDiskIopsBalance

The percentage of available burst credits for disk IOPS between your file server and the primary tier. This is valid for file systems that are provisioned with a throughput capacity of 512 MBps or less.

The Average statistic is the average burst balance available over a specified period.

The Minimum statistic is the minimum burst balance available over a specified period.

The Maximum statistic is the maximum burst balance available over a specified period.

Units: Percent

Valid statistics: Average, Minimum, and Maximum

FileServerDiskIopsUtilization

The percentage of IOPS utilization of available disk IOPS capacity for your file server.

The Average statistic is the average disk IOPS utilization of the file system over a specified period.

The Minimum statistic is the minimum disk IOPS utilization of the file system over a specified period.

The Maximum statistic is the maximum disk IOPS utilization of the file system over a specified period.

Units: Percent

Valid statistics: Average, Minimum, and Maximum

FileServerCacheHitRatio

The percentage of all read requests that are served by data in the file system's RAM and NVMe caches. A higher percentage means that more reads are served by the file system's read caches.

Units: Percent

The Average statistic is the average cache hit percent for the file system over a specified period.

The Minimum statistic is the lowest cache hit percent for the file system over a specified period.

The Maximum statistic is the highest cache hit percent for the file system over a specified period.

Valid statistics: Average, Minimum, and Maximum

Disk I/O metrics

All of these metrics take one dimension, FileSystemId.

Metric Description
DiskReadBytes

The number of bytes (disk I/O) from any disk reads to the file system's primary tier.

The Sum statistic is the total number of bytes read from the file system over a specified period.

To calculate read disk throughput (bytes per second) for any statistic, divide the Sum statistic by the seconds in the specified period.

Units: Bytes

Valid statistics: Sum

DiskWriteBytes

The number of bytes (disk I/O) from any disk writes to the file system's primary tier.

The Sum statistic is the total number of bytes written from the file system over a specified period.

To calculate write disk throughput (bytes per second) for any statistic, divide Sum the statistic by the seconds in the specified period.

Units: Bytes

Valid statistics: Sum

DiskIopsUtilization

The disk IOPS between your file server and storage volumes, as a percentage of the primary's tiers provisioned disk IOPS limit.

The Average statistic is the average disk IOPS utilization of the file system over a specified period.

The Minimum statistic is the minimum disk IOPS utilization of the file system over a specified period.

The Maximum statistic is the maximum disk IOPS utilization of the file system over a specified period.

Units: Percent

Valid statistics: Average, Minimum, and Maximum

DiskReadOperations

The number of read operations (disk I/O) from the file system's primary tier.

The Sum statistic is the total number of read operations from the primary tier over a specified period.

Units: Count

Valid statistics: Sum

DiskWriteOperations

The number of write operations (disk I/O) to the file system's primary tier.

The Sum statistic is the total number of write operations to the primary tier over a specified period.

Units: Count

Valid statistics: Sum

Storage capacity metrics

All of these metrics take one dimension, FileSystemId.

Metric Description
StorageEfficiencySavings

The bytes saved from storage efficiency features (compression, deduplication, and compaction).

The Average statistic is the average storage efficiency savings over a specified period. To calculate storage efficiency savings as a percentage of all data stored, over a one minute period, divide StorageEfficiencySavings by the sum of StorageEfficiencySavings and the StorageUsed file system metric, using the Sum statistic for StorageUsed.

The Minimum statistic is the minimum storage efficiency savings over a specified period.

The Maximum statistic is the maximum storage efficiency savings over a specified period.

Units: Bytes

Valid statistics: Average, Minimum, and Maximum

StorageUsed

The total amount of physical data stored on the file system, on both the primary (SSD) tier and the capacity pool tier. This metric includes savings from storage-efficiency features, such as data compression and deduplication.

Units: Bytes

Valid statistics: Average, Minimum, and Maximum

LogicalDataStored

The total amount of logical data stored on the file system, considering both the SSD tier and the capacity pool tier. This metric includes the total logical size of snapshots and FlexClones, but does not include storage efficiency savings achieved through compression, compaction, and deduplication.

To compute storage-efficiency savings in bytes, take the Average of StorageUsed over a given period and subtract it from the Average of LogicalDataStored over the same period.

To compute storage-efficiency savings as a percentage of total logical data size, take the Average of StorageUsed over a given period and subtract it from the Average of LogicalDataStored over the same period. Then divide the difference by the Average of LogicalDataStored over the same period.

Units: Bytes

Valid statistics: Average, Minimum, and Maximum

Detailed file system metrics

Detailed file system metrics are detailed storage-utilization metrics for each of your storage tiers. Detailed file system metrics all have the dimensions FileSystemId, StorageTier, and DataType.

  • The StorageTier dimension indicates the storage tier that the metric measures, with possible values of SSD and StandardCapacityPool.

  • The DataType dimension indicates the type of data that the metric measures, with the possible value All.

There is a row for each unique combination of a given metric and dimensional key-value pairs, with a description of what that combination measures.

Metric Description
StorageCapacityUtilization

The storage capacity utilization for each of your file system's aggregates. There is one metric emitted each minute for each of your file system's aggregates.

The Average statistic is the average amount of storage capacity utilization for your file system's performance tier over the specified period.

The Minimum statistic is the lowest amount of storage capacity utilization for your file system's performance tier over the specified period.

The Maximum statistic is the highest amount of storage capacity utilization for your file system's performance tier over the specified period.

Units: Percent

Valid statistics: Average, Minimum, and Maximum

StorageCapacity

The total storage capacity of the primary (SSD) tier.

Units: Bytes

Valid statistics: Maximum

StorageUsed

The used physical storage capacity in bytes, specific to the storage tier. This value includes savings from storage-efficiency features, such as data compression and deduplication. Valid dimension values for StorageTier are SSD and StandardCapacityPool, corresponding to the storage tier that this metric measures. This metric also requires the DataType dimension with the value All.

The Average, Minimum, and Maximum statistics are per-tier storage consumption in bytes for the given period.

To calculate storage capacity utilization of your primary (SSD) storage tier, divide any of these statistics by the Maximum StorageCapacity over the same period, with the StorageTier dimension equal to SSD.

To calculate the free storage capacity of your primary (SSD) storage tier in bytes, subtract any of these statistics from the Maximum StorageCapacity over the same period, with the dimension StorageTier equal to SSD.

Units: Bytes

Valid statistics: Average, Minimum, and Maximum