generated from mintlify/starter
-
Notifications
You must be signed in to change notification settings - Fork 3
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
4 changed files
with
387 additions
and
252 deletions.
There are no files selected for viewing
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,98 @@ | ||
| --- | ||
| title: 'Send data from AWS to Axiom' | ||
| description: 'Send data from AWS to Axiom' | ||
| sidebarTitle: AWS | ||
| tags: | ||
| ['axiom documentation', 'documentation', 'axiom', 'aws cloudfront', 'ADOT', 'amazon s3', 'aws s3', 'aws lambda', 'aws', 'cloudwatch', 'amazon'] | ||
| --- | ||
|
|
||
| ## Why Axiom | ||
|
|
||
| Switching from Amazon CloudWatch Logs to Axiom slashes | ||
| costs and speeds up the path to actionable insights. | ||
|
|
||
|
|
||
| <Frame caption="AWS to Axiom diagram"> | ||
| <img src="/doc-assets/aws-to-axiom-diagram.png" alt="AWS to Axiom diagram" /> | ||
| </Frame> | ||
|
|
||
| #### Slash costs and reach answers faster | ||
|
|
||
| Amazon CloudWatch Logs is like a digital watchdog, stashing away log files from | ||
| EC2 instances, CloudTrail, and other sources. Engineering teams using AWS often | ||
| start with CloudWatch because it’s a breeze to set up and integrates well with the | ||
| wider AWS ecosystem. But, as log volumes grow, CloudWatch can quickly drain your | ||
| budget. Worse, the search and analytics experience is basic, especially when | ||
| navigating logs from multiple AWS accounts or a variety of cloud platforms. | ||
|
|
||
| #### Why Amazon CloudWatch Logs falls short | ||
|
|
||
| **High and unpredictable costs:** The first reason for rethinking Amazon CloudWatch Logs | ||
| is usually the cost. CloudWatch charges by GB ingested, stored, and analyzed. Logs in the Standard tier start at $0.50 per GB, not including storage and analysis costs. | ||
| Comparing ingestion and storage alone for 5 TB of log data per day, CloudWatch is 3.5x | ||
| more expensive ($79.5K/mo) than Axiom ($22.5K/mo). | ||
|
|
||
| **Log management price comparison USD for 5 TB of log data per day:** | ||
|
|
||
| | | Axiom | AWS CloudWatch | | ||
| | --- | --- | --- | | ||
| | | Ingest cost | .15/GB * 5000 GB = $750 | .50/GB *5000 GB = $2,500 | | ||
| | | Retention cost | $0.00 | .03/GB *5000 GB = $150 | | ||
| | | Standard retention | 95 days | 30 days | | ||
| | | Total daily cost | $750 | $2,650 | | ||
| | | Total monthly cost | $22,500 | $79,500 | | ||
|
|
||
|
|
||
| Beyond ingest and storage, extra fees are applied for dashboards ($3.00 each), log metrics (starting at $0.30 per metric), and alarms (from $0.10 per alarm metric). With so many | ||
| variables, estimating monthly charges gets tricky, and many CloudWatch users realize they could save big by switching to Axiom, getting more fidelity and analysis power for less cost. | ||
|
|
||
| **Clunky analytics workflows:** Once logs are stored in CloudWatch, teams have to sift through log groups and log streams to find insights. Log streams, sequences of log events from the same source, get split once they hit a volume threshold, which creates painfully slow and | ||
| error-prone workflows. | ||
|
|
||
|
|
||
|
|
||
| ## Axiom's CloudWatch Forwarder | ||
|
|
||
| Axiom provides a unique way of ingesting CloudWatch logs into Axiom. | ||
| The Axiom CloudWatch integration is subscribed to one or more of your CloudWatch Log Groups and runs as a Lambda function. | ||
|
|
||
| While there are other methods to ship logs from AWS Services, The [**CloudWatch Forwarder**](./cloudwatch) is the fastest way to get started with Axiom and AWS. | ||
|
|
||
|
|
||
| ## Other ways to send data to Axiom | ||
| Checkout [AWS Documentation](https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/AWS-logs-and-resource-policy.html) of which services send logs to Cloudwatch and/or S3. | ||
|
|
||
|
|
||
| | | Service | Methods | | ||
| | --- | --- | --- | | ||
| | | AWS Lambda | [AWS Lambda Extension Layer](./aws-lambda) | | ||
| | | AWS Cloudwatch | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | Amazon S3 | [AWS S3 Forwarder](./aws-s3) or [Vector](./vector) | | ||
| | | AWS Firehose | [AWS Firehose](./aws-firehose) | | ||
| | | AWS Firelens. | [AWS Firelens](./aws-firelens) | | ||
| | | Amazon ECS | [Fluentbit](./fluent-bit) | | ||
| | | Cloudfront | [AWS S3 Forwarder](./aws-s3) | | ||
| | | Amazon API Gateway | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | AWS AppSync | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | Amazon Aurora MySQL | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | Amazon Bedrock Knowledge | [AWS Cloudwatch Forwarder](./cloudwatch), [AWS S3 Forwarder](./aws-s3) or [AWS Firehose](./aws-firehose) | | ||
| | | Amazon Chime media quality metric logs and SIP message logs | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | AWS CloudHSM audit logs | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | CloudWatch Evidently evaluation event logs | [AWS Cloudwatch Forwarder](./cloudwatch) or [AWS Firehose](./aws-firehose) | | ||
| | | Cloudtrail | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | AWS CodeBuild | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | Amazon CodeWhisperer event logs | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | Amazon Cognito | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | Amazon Connect | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | AWS DataSync | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | Amazon ElastiCache (Redis OSS) | [AWS Cloudwatch Forwarder](./cloudwatch) or [AWS Firehose](./aws-firehose) | | ||
| | | AWS Beanstalk | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | AWS Elemental MediaTailor | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | Amazon Event Bridge Pipes | [AWS Cloudwatch Forwarder](./cloudwatch), [AWS S3 Forwarder](./aws-s3) or [AWS Firehose](./aws-firehose) | | ||
| | | AWS Fargate | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | AWS Fault Injection Service experiment | [AWS S3 Forwarder](./aws-s3) | | ||
| | | Amazon FinSpace | [AWS Cloudwatch Forwarder](./cloudwatch), [AWS S3 Forwarder](./aws-s3) or [AWS Firehose](./aws-firehose) | | ||
| | | AWS Global Accelerator flow logs | [AWS S3 Forwarder](./aws-s3) | | ||
| | | AWS Global Accelerator flow logs | [AWS S3 Forwarder](./aws-s3) | | ||
| | | AWS Glue job logs | [AWS Cloudwatch Forwarder](./cloudwatch) | | ||
| | | AWS IoT Core | [Lambda Function](aws-iot-rules) | |
Oops, something went wrong.