Amazon MQ Monitoring Integration

Amazon MQ is a messaging service that helps communicate messages between various applications and components. With Site24x7's integration, monitor your Amazon MQ service and get full visibility on all the broker and destination metrics. 

To make your monitoring experience easier, the components monitored for MQ are classified as four monitors:

  • Amazon MQ Broker
  • Amazon MQ Topic
  • Amazon MQ Queue
  • Amazon MQ Network Connector

Setup and configuration

  1. If you haven't already, enable access to your AWS resources between your AWS account and Site24x7's AWS account by either:
    • Creating Site24x7 as an IAM user.
    • Creating a cross-account IAM role. Learn more.
  2. On the Integrate AWS Account page, check the box next to Amazon MQ. Learn more.

Policy and permissions

Site24x7 uses various Amazon MQ APIs to collect information on your messaging service. Assign the AWS Managed policy ReadOnlyAccess to the Site24x7 entity (IAM user or IAM role) to help Site24x7 collect metrics and metadata. If you want to assign a custom policy, please make sure the following read-level actions are present in the policy JSON. Learn more.

  • "mq:DescribeBroker",
  • "mq:DescribeConfiguration",
  • "mq:DescribeConfigurationRevision",
  • "mq:DescribeUser",
  • "mq:ListTags",
  • "mq:ListBrokers",
  • "mq:DescribeBrokerEngineTypes",
  • "cloudwatch:ListMetrics",
  • "logs:DescribeLogStreams",
  • "logs:GetLogEvents"

Polling Frequency

Site24x7 collects metric data on your clusters, namespace and nodes as per the poll frequency set, ranging from one minute up to one day. Learn more.

IT Automations

You can add automations for the AWS services supported by Site24x7. Log in to Site24x7 and go to Admin > IT Automation Templates (+) > Add Automation Templates. Once automations are added, you can schedule them to be executed one after the other.

You can now reboot an Amazon MQ broker automatically using Amazon MQ automations.

Licensing

Each of the customer-managed Amazon MQ will be considered a basic monitor, except the Amazon MQ Network Connector. For an Amazon MQ Network Connector, it consumes 1 basic monitor license for 5 monitors. Learn more.

Performance Metrics

CloudWatch Metric Description Statistics Unit
Burst Balance The remaining percentage of the underlying storage layer's Amazon EBS volume burst credits  Average  Percent 
Cpu Credit Balance The number of earned CPU credits that an instance has accrued since it was launched or started (including the number of launch credits). The credit balance is available for the broker instance to spend on bursts beyond the baseline CPU utilization Minimum  Credits
Cpu Utilization The percentage of allocated Amazon EC2 compute units that the broker currently uses  Maximum  Percent 
Current Connections Count The current number of active connections on the current broker. Maximum  Count 
Established Connections Count The total number of connections, active and inactive, that have been established on the broker. Maximum  Count 
Heap Usage The percentage of the ActiveMQ JVM memory limit that the broker currently uses. Maximum  Percent  
Network In The volume of incoming traffic for the broker. Sum  MB 
Network Out  The volume of outgoing traffic for the broker. Sum  MB 
Open Transaction Count The total number of transactions in progress. Maximum  Count 
Store Percent Usage The percent used by the storage limit. If this reaches 100, the broker will refuse messages. Average  Percent 
Inactive Durable Topic Subscribers Count The number of inactive durable topic subscribers, up to a maximum of 2000. Sum  Count 
Journal Files For Fast Recovery The number of journal files that will be replayed after a clean shutdown. Sum  Count 
Journal Files For Full Recovery The number of journal files that will be replayed after an unclean shutdown. Sum Count 
Total Consumer Count The number of message consumers subscribed to destinations on the current broker. Maximum Count 
Total Message Count The number of messages stored on the broker. Maximum  Count 
Total Producer Count The number of message producers active on destinations on the current broker. Maximum  Count 
Volume Read Ops The number of read operations performed on the Amazon EBS volume. Sum  Count  
Volume Write Ops The number of write operations performed on the Amazon EBS volume. Sum  Count  
Total Enqueue Count The total number of messages that have been sent to the broker. Sum  Count  
Total Dequeue Count The total number of messages that have been consumed by clients. Sum  Count  

Metrics for Queues and Topics

CloudWatch Metric Description Statistics Unit
Consumer Count The number of consumers subscribed to the destination. Maximum Count
Enqueue Time The end-to-end latency from when a message arrives at a broker until it is delivered to a consumer. Maximum Time(millisecond)
Expired Count The number of messages that couldn't be delivered because they expired, per minute. Sum Count
Dispatch Count The number of messages sent to consumers, per minute. Sum Count
Inflight Count The number of messages sent to consumers that have not been acknowledged. Sum Count
Memory Usage The percentage of the memory limit that the destination currently uses. Average Percent
Producer Count The number of producers for the destination. Maximum Count
Queue Size The number of messages in the queue. Note: This metric is applicable only for Queue. Maximum Count

Metrics for Network Connector

CloudWatch Metric Description Statistics Unit
Enqueue Count The number of messages sent to the destination, per minute. Maximum Count
Dequeue Count The number of messages acknowledged by consumers, per minute. Sum Count
Receive Count The number of messages that have been received from the remote broker for a duplex network connector. Sum Count

Threshold Configuration

Go to Admin > Configuration Profiles > Threshold and Availability (+) > choose the monitor type as Amazon MQ Broker/Amazon MQ Topic/Amazon MQ Queue/Amazon MQ Network Connector. You can set threshold values for all the metrics mentioned above. Further, for Amazon MQ Queue and Amazon MQ Topic monitors, you can choose to mute inactive alerts in the threshold form.

Forecast

Estimate future values of the following performance metrics and make informed decisions about adding capacity or scaling your AWS infrastructure.

  • CPU Utilization
  • Heap Usage
  • Store Percent Usage
  • Total Enqueue Count
  • Total Dequeue Count
  • Volume Read Ops
  • Volume Write Ops

Similarly, you can also view the forecast for the following metrics of Amazon MQ Queues and Topics:

  • Inflight Count
  • Memory Usage 

Site24x7's Amazon MQ monitoring interface

Summary

Gain an overview of different events occurring within each resource with time series charts. These charts provide event timelines on CPU credit balance, CPU usage, the number of current connections, established connection count, heap usage and network throughput, and many more. All time series charts have the average, minimum, and maximum values listed.

Monitored Resources

On the Monitored Resources tab, you can view a list of Amazon MQ Topics, queues, and network connectors within your Amazon MQ environment. Click on an individual listing to see performance and resource usage stats associated with that resource. You can also set thresholds and be notified when any of these services fail by clicking the pencil icon under Action.

Logs

Collect Amazon MQ log entries for selected log types, with the logs being fetched from CloudWatch.The recent logs tab consists of both Audit log as well as General log.

Configuration

The configuration details of an Amazon MQ are provided under this tab. Details on the broker engine type, broker instance type, deployment type, endpoint URL, security group(s) and many more are listed in this section.

Outages

A list of down, trouble, critical, or maintenance history is displayed in the Outages tab. Details on start time to end time of an outage, duration, and comments (if any) are provided in this section.

Inventory

The configuration details of the threshold for each certificate are set here. The various threshold parameters that can be set include certificate age, and the number of hours, minutes, or days until certificate expiry. The polling frequency and the notification profile can be set according to the user and viewed here.

Was this document helpful?
Thanks for taking the time to share your feedback. We’ll use your feedback to improve our online help resources.