You are here

AWS S3 Monitoring

Download version    6    5

Included in Opsview 5
Included in Opsview 6
check_circle
Opsview Supported

AWS - S3 CloudWatch Opspack

Amazon Simple Storage Service is storage for the Internet. It is designed to make web-scale computing easier for developers. Amazon S3 has a simple web services interface that you can use to store and retrieve any amount of data, at any time, from anywhere on the web. It gives any developer access to the same highly scalable, reliable, fast, inexpensive data storage infrastructure that Amazon uses to run its own global network of web sites. The service aims to maximize benefits of scale and to pass those benefits on to developers.

What Can You Monitor

Opsview Monitor's AWS S3 Opspack provides all of the latest metrics to track your S3 buckets. Service checks included in the Opspack allow for tracking of GET and PUT requests across each bucket. S3 Request metrics can help you easily identify operational issues.

Service Checks

Service Check Description
AWS/S3.BucketSizeBytes The amount of data in bytes stored in a bucket in the standard storage class
AWS/S3.NumberOfObjects The total number of objects stored in a bucket for all storage classes except for the GLACIER storage class
AWS/S3.AllRequests The total number of HTTP requests made to a bucket
AWS/S3.GetRequests The number of HTTP GET requests made for objects in a bucket
AWS/S3.PutRequests The number of HTTP PUT requests made for objects in a bucket
AWS/S3.DeleteRequests The number of HTTP DELETE requests made for objects in a bucket
AWS/S3.HeadRequests The number of HTTP HEAD requests made to a bucket
AWS/S3.PostRequests The number of HTTP POST requests made to a bucket
AWS/S3.ListRequests The number of HTTP requests that list the contents of a bucket
AWS/S3.BytesDownloaded The number bytes downloaded for requests made to a bucket, where the response includes a body
AWS/S3.BytesUploaded The number bytes uploaded to a bucket that contain a request body
AWS/S3.4xxErrors The number of HTTP 4xx client error status code requests made to a bucket
AWS/S3.5xxErrors The number of HTTP 5xx client error status code requests made to a bucket
AWS/S3.FirstByteLatency The per-request time from the complete request being received by a bucket to when the response starts to be returned
AWS/S3.TotalRequestLatency The elapsed per-request time from the first byte received to the last byte sent to a bucket

AWS - S3 CloudWatch Opspack

Amazon Simple Storage Service is storage for the Internet. It is designed to make web-scale computing easier for developers. Amazon S3 has a simple web services interface that you can use to store and retrieve any amount of data, at any time, from anywhere on the web. It gives any developer access to the same highly scalable, reliable, fast, inexpensive data storage infrastructure that Amazon uses to run its own global network of web sites. The service aims to maximize benefits of scale and to pass those benefits on to developers.

What You Can Monitor

Opsview Monitor's AWS S3 Opspack provides all of the latest metrics to track your S3 buckets. Service checks included in the Opspack allow for tracking of GET and PUT requests across each bucket. S3 Request metrics can help you easily identify operational issues.

Note: This Opspack knows when it was last run, so when testing the results in the troubleshoot section, you will need to wait a couple of minutes each time you recheck the results. The time frame that is searched for is based around the last time the Opspack ran, so running it too quickly will result in no data being found and the service check going into an unknown

Service Checks

Service Check Description
AWS/S3.BucketSizeBytes The amount of data in bytes stored in a bucket in the standard storage class
AWS/S3.NumberOfObjects The total number of objects stored in a bucket for all storage classes except for the GLACIER storage class
AWS/S3.AllRequests The total number of HTTP requests made to a bucket
AWS/S3.GetRequests The number of HTTP GET requests made for objects in a bucket
AWS/S3.PutRequests The number of HTTP PUT requests made for objects in a bucket
AWS/S3.DeleteRequests The number of HTTP DELETE requests made for objects in a bucket
AWS/S3.HeadRequests The number of HTTP HEAD requests made to a bucket
AWS/S3.PostRequests The number of HTTP POST requests made to a bucket
AWS/S3.ListRequests The number of HTTP requests that list the contents of a bucket
AWS/S3.BytesDownloaded The number bytes downloaded for requests made to a bucket, where the response includes a body
AWS/S3.BytesUploaded The number bytes uploaded to a bucket that contain a request body
AWS/S3.4xxErrors The number of HTTP 4xx client error status code requests made to a bucket
AWS/S3.5xxErrors The number of HTTP 5xx client error status code requests made to a bucket
AWS/S3.FirstByteLatency The per-request time from the complete request being received by a bucket to when the response starts to be returned
AWS/S3.TotalRequestLatency The elapsed per-request time from the first byte received to the last byte sent to a bucket

Notes

This Opspack knows when it was last run, so when testing the results in the troubleshoot section, you will need to wait a couple minutes each time you recheck the results. The time frame that is searched for is based around the last time the Opspack ran, so running it too quickly will result in no data being found and the service check going into an unknown.

Prerequisites

There are two ways of adding your authentication credentials to the host. We recommend adding the access key and secret key directly using the variable 'AWS_CLOUDWATCH_AUTHENTICATION'. You can also add the access key and secret key to a file (default /usr/local/nagios/etc/aws_credentials.cfg) in the following format:

[default]
aws_access_key_id = "Your Access Key Id"
aws_secret_access_key = "Your Secret Key Id"

Setup and Configuration

Step 1: Add the host template and the 'Cloud - AWS - S3 CloudWatch' Opspack to the host running the S3 software.

Add host template

Step 2: Add and configure the host Variables tab. Add in 'AWS_CLOUDWATCH_AUTHENTICATION' with either the file location or the access key and secret key depending on your preferred way of supplying the access credential. Add the region you hosted in, then add and configure the AWS_S3_BUCKET_NAME' by adding the name of the bucket.

Add variable

Step 3: Reload and view the S3 statistics

View output

Setup and Configuration

To configure and utilize this Opspack, you need to add the 'Cloud - AWS - S3 CloudWatch' Opspack to your Opsview Monitor system

Step 1: Add the host template

Add the Cloud - AWS - S3 CloudWatch Host Template to your Opsview Monitor host. If the resource you're monitoring has no hostname or public IP, then open the Advanced settings pane and change Host Check Command to Always assumed to be UP.

For more information, refer to Opsview Knowledge Center - Adding Host Templates to Hosts.

Step 2: Add and configure the variables for the host

Variable Description
AWS_CLOUDWATCH_AUTHENTICATION Authentication details for CloudWatch. The Value is not used and therefore can be set to anything. Either override the File Path with the location of your credentials file, or override the Access Key and Secret Key arguments (this approach is recommended as the values will be encrypted). Optionally, override the Region (default: eu-west-1) with the location of your instance if you are not using the default region.
AWS_S3_BUCKET_NAME Bucket name to monitor from AWS

For more information, refer to Opsview Knowledge Center - Adding Variables to Hosts.

Step 3: Apply changes and S3 buckets will now be monitored

View output

v1.0-opsview-5

ODI-309 - AWS Cloudwatch Opspacks

Initial release for AWS Cloudwatch Opspacks

v2.0-opsview-6

ODI-1154 Release Opspacks for Opsview Monitor 6.0

Initial release of Opspack to work with Opsview Monitor 6.0