CloudWatch Metrics Sink Addition

[vmmusings]

Description

• This PR adds CloudWatchMetricsSink which helps pushing metrics emitted at different sources in spark env to Cloudwatch.
• DimensionedCloudWatchReporter class is picked up from this library: https://github.com/azagniotov/codahale-aggregated-metrics-cloudwatch-reporter
• [Pending Items] Add options to filter out metrics in sink using regex.

1. Spark Metrics System.

2. Usage of above cloudwatch Metric Sink.

Add below configuration to metrics.properties or to spark configuration while submitting applicaton.

spark.metrics.conf.*.sink.cloudwatch.class=org.apache.spark.metrics.sink.CloudWatchSink
spark.metrics.conf.*.sink.cloudwatch.namespace=<Your CloudWatch metrics Namespace>
spark.metrics.conf.*.sink.cloudwatch.pollingPeriod=<Optional polling period value, defaults to 1>
spark.metrics.conf.*.sink.cloudwatch.pollingTimeUnit=<Optional polling period unit, defaults to MINUTES>
spark.metrics.conf.*.sink.cloudwatch.awsAccessKeyId=<Optional aws access key, uses DefaultAWSCredentialsProviderChain by default>
spark.metrics.conf.*.sink.cloudwatch.awsSecretKey=<Optional aws secret key, uses DefaultAWSCredentialsProviderChain by default>
spark.metrics.conf.*.sink.cloudwatch.awsRegion=<Optional aws region, uses DefaultAwsRegionProviderChain by default>
spark.metrics.conf.*.sink.cloudwatch.shouldParseInlineDimensions=<Optional true|false setting, defaults to false>

Issues Resolved

List any issues this PR will resolve, e.g. Closes [...].

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.