Metrics
Metrics creates custom metrics asynchronously by logging metrics to standard output following Amazon CloudWatch Embedded Metric Format (EMF).
These metrics can be visualized through Amazon CloudWatch Console.
Key features¶
- Aggregating up to 100 metrics using a single CloudWatch EMF object (large JSON blob).
- Validating your metrics against common metric definitions mistakes (for example, metric unit, values, max dimensions, max metrics).
- Metrics are created asynchronously by the CloudWatch service. You do not need any custom stacks, and there is no impact to Lambda function latency.
- Creating a one-off metric with different dimensions.
 
  Terminologies¶
If you're new to Amazon CloudWatch, there are two terminologies you must be aware of before using this utility:
- Namespace. It's the highest level container that will group multiple metrics from multiple services for a given application, for example ServerlessEcommerce.
- Dimensions. Metrics metadata in key-value format. They help you slice and dice metrics visualization, for example ColdStartmetric by Paymentservice.
- Metric. It's the name of the metric, for example: SuccessfulBooking or UpdatedBooking.
- Unit. It's a value representing the unit of measure for the corresponding metric, for example: Count or Seconds.
- Resolution. It's a value representing the storage resolution for the corresponding metric. Metrics can be either Standard or High resolution.
 
  Getting started¶
Installation¶
Install the library in your project:
| 1 |  | 
Caution
When using the Lambda Advanced Logging Controls feature you must install version of Powertools for AWS Lambda (TypeScript) v1.15.0 or newer.
Usage¶
The Metrics utility must always be instantiated outside of the Lambda handler. In doing this, subsequent invocations processed by the same instance of your function can reuse these resources. This saves cost by reducing function run time. In addition, Metrics can track cold start and emit the appropriate metrics.
| 1 2 3 4 5 6 7 8 9 10 11 12 13 |  | 
Utility settings¶
The library requires two settings. You can set them as environment variables, or pass them in the constructor.
These settings will be used across all metrics emitted:
| Setting | Description | Environment variable | Default | Allowed Values | Example | Constructor parameter | 
|---|---|---|---|---|---|---|
| Service | Optionally, sets service metric dimension across all metrics | POWERTOOLS_SERVICE_NAME | service_undefined | Any string | serverlessAirline | serviceName | 
| Metric namespace | Logical container where all metrics will be placed | POWERTOOLS_METRICS_NAMESPACE | default_namespace | Any string | serverlessAirline | default_namespace | 
| Function Name | Function name used as dimension for the ColdStartmetric | POWERTOOLS_METRICS_FUNCTION_NAME | See docs | Any string | my-function-name | functionName | 
| Disabled | Whether to disable the log of metrics to standard output or not | POWERTOOLS_METRICS_DISABLED | false | Boolean | true | 
Tip
Use your application name or main service as the metric namespace to easily group all metrics
Example using AWS Serverless Application Model (SAM)¶
The Metrics utility is instantiated outside of the Lambda handler. In doing this, the same instance can be used across multiple invocations inside the same execution environment. This allows Metrics to be aware of things like whether or not a given invocation had a cold start or not.
| 1 2 3 4 5 6 7 8 9 10 11 |  | 
| 1 2 3 4 5 6 7 8 9 10 |  | 
You can initialize Metrics anywhere in your code - It'll keep track of your aggregate metrics in memory.
Creating metrics¶
You can create metrics using the addMetric method, and you can create dimensions for all your aggregate metrics using the addDimension method.
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 |  | 
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |  | 
Creating dimension sets¶
You can create separate dimension sets for your metrics using the addDimensions method. This allows you to group metrics by different dimension combinations.
When you call addDimensions(), it creates a new dimension set rather than adding to the existing dimensions. This is useful when you want to track the same metric across different dimension combinations.
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 |  | 
Autocomplete Metric Units
Use the MetricUnit enum to easily find a supported metric unit by CloudWatch. Alternatively, you can pass the value as a string if you already know them e.g. "Count".
Metrics overflow
CloudWatch EMF supports a max of 100 metrics per batch. Metrics will automatically propagate all the metrics when adding the 100th metric. Subsequent metrics, e.g. 101th, will be aggregated into a new EMF object, for your convenience.
Do not create metrics or dimensions outside the handler
Metrics or dimensions added in the global scope will only be added during cold start. Disregard if that's the intended behavior.
Adding high-resolution metrics¶
You can create high-resolution metrics passing resolution as parameter to addMetric.
When is it useful?
High-resolution metrics are data with a granularity of one second and are very useful in several situations such as telemetry, time series, real-time incident management, and others.
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |  | 
Autocomplete Metric Resolutions
Use the MetricResolution type to easily find a supported metric resolution by CloudWatch. Alternatively, you can pass the allowed values of 1 or 60 as an integer.
Adding multi-value metrics¶
You can call addMetric() with the same name multiple times. The values will be grouped together in an array.
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |  | 
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 |  | 
Adding default dimensions¶
You can add default dimensions to your metrics by passing them as parameters in 4 ways:
- in the constructor
- in the Middy-compatible middleware
- using the setDefaultDimensionsmethod
- in the decorator
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 |  | 
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |  | 
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 |  | 
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |  | 
- Binding your handler method allows your handler to access thiswithin the class methods.
If you'd like to remove them at some point, you can use the clearDefaultDimensions method.
Changing default timestamp¶
When creating metrics, we use the current timestamp. If you want to change the timestamp of all the metrics you create, utilize the setTimestamp function. You can specify a datetime object or an integer representing an epoch timestamp in milliseconds.
Note that when specifying the timestamp using an integer, it must adhere to the epoch timezone format in milliseconds.
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |  | 
Flushing metrics¶
As you finish adding all your metrics, you need to serialize and "flush them" by calling publishStoredMetrics(). This will print the metrics to standard output.
You can flush metrics automatically using one of the following methods:
- manually
- Middy-compatible middleware
- class decorator
Using the Middy middleware or decorator will automatically validate, serialize, and flush all your metrics. During metrics validation, if no metrics are provided then a warning will be logged, but no exception will be thrown. If you do not use the middleware or decorator, you have to flush your metrics manually.
Metric validation
If metrics are provided, and any of the following criteria are not met, a RangeError error will be thrown:
- Maximum of 29 dimensions
- Namespace is set only once (or none)
- Metric units must be supported by CloudWatch
Middy middleware¶
See below an example of how to automatically flush metrics with the Middy-compatible logMetrics middleware.
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |  | 
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |  | 
Using the class decorator¶
Note
The class method decorators in this project follow the experimental implementation enabled via the experimentalDecorators compiler option in TypeScript.
Additionally, they are implemented to decorate async methods. When decorating a synchronous one, the decorator replaces its implementation with an async one causing the caller to have to await the now decorated method.
If this is not the desired behavior, you can use the logMetrics middleware instead.
The logMetrics decorator of the metrics utility can be used when your Lambda handler function is implemented as method of a Class.
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |  | 
- Binding your handler method allows your handler to access thiswithin the class methods.
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |  | 
Manually¶
You can manually flush the metrics with publishStoredMetrics as follows:
Warning
Metrics, dimensions and namespace validation still applies.
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 |  | 
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |  | 
Throwing a RangeError when no metrics are emitted¶
If you want to ensure that at least one metric is emitted before you flush them, you can use the throwOnEmptyMetrics parameter and pass it to the middleware or decorator:
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |  | 
Capturing a cold start invocation as metric¶
You can optionally capture cold start metrics with the logMetrics middleware or decorator via the captureColdStartMetric param.
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |  | 
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 |  | 
If it's a cold start invocation, this feature will:
- Create a separate EMF blob solely containing a metric named ColdStart
- Add the function_name,serviceand default dimensions
This has the advantage of keeping cold start metric separate from your application metrics, where you might have unrelated dimensions.
We do not emit 0 as a value for the ColdStart metric for cost-efficiency reasons. Let us know if you'd prefer a flag to override it.
Setting function name¶
When emitting cold start metrics, the function_name dimension defaults to context.functionName. If you want to change the value you can set the functionName parameter in the metrics constructor, define the environment variable POWERTOOLS_METRICS_FUNCTION_NAME, or pass a value to captureColdStartMetric.
The priority of the function_name dimension value is defined as:
- functionNameconstructor option
- POWERTOOLS_METRICS_FUNCTION_NAMEenvironment variable
- The value passed in the captureColdStartMetriccall, orcontext.functionNameif using logMetrics decorator or Middy middleware
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |  | 
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |  | 
Advanced¶
Adding metadata¶
You can add high-cardinality data as part of your Metrics log with the addMetadata method. This is useful when you want to search highly contextual information along with your metrics in your logs.
Info
This will not be available during metrics visualization - Use dimensions for this purpose
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |  | 
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |  | 
Single metric with different dimensions¶
CloudWatch EMF uses the same dimensions across all your metrics. Use singleMetric if you have a metric that should have different dimensions.
Generally, using different dimensions would be an edge case since you pay for unique metric.
Keep the following formula in mind: unique metric = (metric_name + dimension_name + dimension_value).
| 1 2 3 4 5 6 7 8 9 10 11 12 13 |  | 
- Metadata should be added before calling addMetric()to ensure it's included in the same EMF blob.
- Single metrics are emitted as soon as addMetric()is called, so you don't need to callpublishStoredMetrics().
Customizing the logger¶
You can customize how Metrics logs warnings and debug messages to standard output by passing a custom logger as a constructor parameter. This is useful when you want to silence warnings or debug messages, or when you want to log them to a different output.
| 1 2 3 4 5 6 7 8 9 10 11 12 |  | 
Testing your code¶
When unit testing your code that uses the Metrics utility, you may want to silence the logs emitted by the utility. To do so, you can set the POWERTOOLS_DEV environment variable to true. This instructs the utility to not emit any logs to standard output.
If instead you want to spy on the logs emitted by the utility, you must set the POWERTOOLS_DEV environment variable to true in conjunction with the POWERTOOLS_METRICS_DISABLED environment variable set to false.
When POWERTOOLS_DEV is enabled, Metrics uses the global console to emit metrics to standard out. This allows you to easily spy on the logs emitted and make assertions on them.
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |  |