AWS Data Transfer Cost Explorer

Related tags

DevOps Tools awsdtc
Overview

The AWS Data Transfer Cost Explorer

The AWS Data Transfer Cost Explorer tool analyzes the billed Data Transfer items in your AWS account and presents them visualized on a map.

Motivation;

We have a continuous cost optimization case on AWS. Especially the Data Transfer tab on the Bills screen is quite long and it takes a long time to understand which areas are used more.

Another need is to catch unusual Data Transfers in our infrastructure. For example, in our infrastructure, it is not possible to get traffic from Tokyo to Sao Paulo, but thanks to this tool, we can see and solve it.

General:

Filtered:

Bubble Charts for Data Transfers:

Sunburst for Regions:

Binaries

Configuration

  • set AWS credentials in ~/.aws/credentials file
[default]
aws_access_key_id = A******************U
aws_secret_access_key = WD/**********************************MA

or

  • set AWS credentials system environment
export AWS_ACCESS_KEY_ID=A******************U
export AWS_SECRET_ACCESS_KEY=WD/**********************************MA

Policy

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": [
                "aws-portal:ViewUsage",
                "aws-portal:ViewBilling",
                "cur:DescribeReportDefinitions",
            ],
            "Resource": "*"
        }
    ]
}

Running

  1. Download Binary for your OS
  2. Run awsdtc executable in Command Line
  3. And call in your browser http://localhost:8000

License

Distributed under the MIT License. See LICENSE for more information.

Contact

Oğuzhan YILMAZ - @c1982 - [email protected]

You might also like...
Aws asg updater - Update AMIs within AWS Auto Scaling groups automatically.

AWS Auto Scaling Groups Updater AWS Auto Scaling group is a great way of managing Amazon EC2 instances. AWS Auto Scaling group watches the correspondi

Aws-secretsmanager-caching-extension - Cache server for AWS Secrets Manager
Aws-secretsmanager-caching-extension - Cache server for AWS Secrets Manager

AWS Lambda Extension / Sidecar Container Cache Server The cache server is writte

Pulumi-aws-iam - Reusable IAM modules for AWS

xyz Pulumi Component Provider (Go) This repo is a boilerplate showing how to cre

A Terraform module to manage cluster authentication (aws-auth) for an Elastic Kubernetes (EKS) cluster on AWS.

Archive Notice The terraform-aws-modules/eks/aws v.18.20.0 release has brought back support aws-auth configmap! For this reason, I highly encourage us

HBase Exporter,fetch data from jmx for region-level data.

HBase Exporter Prometheus exporter for HBase which fetch data from hbase jmx, written in Go. You can even see region-level metrics. Installation and U

Kstone is an etcd management platform, providing cluster management, monitoring, backup, inspection, data migration, visual viewing of etcd data, and intelligent diagnosis.
Kstone is an etcd management platform, providing cluster management, monitoring, backup, inspection, data migration, visual viewing of etcd data, and intelligent diagnosis.

Kstone 中文 Kstone is an etcd management platform, providing cluster management, monitoring, backup, inspection, data migration, visual viewing of etcd

Conduit - Data Integration for Production Data Stores
Conduit - Data Integration for Production Data Stores

Conduit Data Integration for Production Data Stores. 💫 Overview Conduit is a da

💧 Visual Data Preparation (VDP) is an open-source tool to seamlessly integrate Vision AI with the modern data stack
💧 Visual Data Preparation (VDP) is an open-source tool to seamlessly integrate Vision AI with the modern data stack

Website | Community | Blog Get Early Access Visual Data Preparation (VDP) is an open-source tool to streamline the end-to-end visual data processing p

AWS environment config loader

awsenv AWS environment config loader. awsenv is a small binary that loads AWS environment variables for an AWS profile from ~/.aws/credentials - usefu

Comments
  • http: panic serving [::1]:61264: runtime error

    http: panic serving [::1]:61264: runtime error

    Application is not responding and showing the following error from the console:

    2021/05/17 06:39:58 http: panic serving [::1]:61264: runtime error: invalid memory address or nil pointer dereference
    goroutine 6 [running]:
    net/http.(*conn).serve.func1(0xc0000a7540)
    	/usr/local/go/src/net/http/server.go:1824 +0x153
    panic(0x15589a0, 0x198fc40)
    	/usr/local/go/src/runtime/panic.go:971 +0x499
    text/template.errRecover(0xc000064ac0)
    	/usr/local/go/src/text/template/exec.go:163 +0x1b2
    panic(0x15589a0, 0x198fc40)
    	/usr/local/go/src/runtime/panic.go:965 +0x1b9
    text/template.(*Template).execute(0x0, 0x1706e20, 0xc0002901c0, 0x0, 0x0, 0x0, 0x0)
    	/usr/local/go/src/text/template/exec.go:217 +0x180
    text/template.(*Template).Execute(...)
    	/usr/local/go/src/text/template/exec.go:203
    main.RunPage.func2(0x170d220, 0xc0002901c0, 0xc000280300)
    	/Users/oguzhan/go/src/awsdtc/web.go:59 +0x74
    net/http.HandlerFunc.ServeHTTP(0xc000021900, 0x170d220, 0xc0002901c0, 0xc000280300)
    	/usr/local/go/src/net/http/server.go:2069 +0x44
    net/http.(*ServeMux).ServeHTTP(0x199f160, 0x170d220, 0xc0002901c0, 0xc000280300)
    	/usr/local/go/src/net/http/server.go:2448 +0x1ad
    net/http.serverHandler.ServeHTTP(0xc000290000, 0x170d220, 0xc0002901c0, 0xc000280300)
    	/usr/local/go/src/net/http/server.go:2887 +0xa3
    net/http.(*conn).serve(0xc0000a7540, 0x170e040, 0xc000112000)
    	/usr/local/go/src/net/http/server.go:1952 +0x8cd
    created by net/http.(*Server).Serve
    	/usr/local/go/src/net/http/server.go:3013 +0x39b
    
    opened by istemi 1
  • Not working with CrossAccount configuration

    Not working with CrossAccount configuration

    If the default profile is containing crossaccount configuration and / or MFA the app is throwing the follwing error:

    For verbose messaging see aws.Config.CredentialsChainVerboseErrors
    

    error: NoCredentialProviders: no valid providers in chain. Deprecated.

    enhancement 
    opened by daknhh 1
  • NAT traffic

    NAT traffic

    It would be great if you could add NAT traffic to this. NAT gateways are high cost and it would be good to be able to see where possible overuse of them are happening

    enhancement 
    opened by snemetz 1
Releases(v1.0.4)
Owner
Oğuzhan YILMAZ
Tech. Lead at @maestropanel, CTO at @masomo
Oğuzhan YILMAZ
Container-Explorer is a tool to explore containerd installation on a mounted image.

Container-Explorer Container-Explorer is a tool to explore containerd installation on a mounted image. Container-Explorer attempts to provide the simi

Google 27 Nov 23, 2022
Tree style (files) explorer for p9p acme.

xplor, a tree-style (file) explorer for (plan9port) Acme screenshot, regular screenshot, monospaced Xplor is written for Acme, the Plan 9 text editing

Shingirai Chanakira 0 Nov 25, 2021
The GCP Enterprise Cloud Cost Optimiser, or gecco for short, helps teams optimise their cloud project costs.

gecco helps teams optimise their cloud resource costs. Locate abandoned, idle, and inefficiently configured resources quickly. gecco helps teams build

aeihr. 2 Jan 9, 2022
Cost-aware network traffic analysis

Traffic Refinery Overview Traffic Refinery is a cost-aware network traffic analysis library implemented in Go For a project overview, installation inf

null 6 Nov 21, 2022
A lightweight, cloud-native data transfer agent and aggregator

English | 中文 Loggie is a lightweight, high-performance, cloud-native agent and aggregator based on Golang. It supports multiple pipeline and pluggable

null 791 Nov 25, 2022
This plugin helps you to use the AWS Command Line Interface (AWS CLI) to start and end sessions to your managed instances

Session Manager Plugin This plugin helps you to use the AWS Command Line Interface (AWS CLI) to start and end sessions to your managed instances. Sess

Amazon Web Services 178 Nov 28, 2022
Terraform provider to help with various AWS automation tasks (mostly all that stuff we cannot accomplish with the official AWS terraform provider)

terraform-provider-awsutils Terraform provider for performing various tasks that cannot be performed with the official AWS Terraform Provider from Has

Cloud Posse 24 Oct 1, 2022
Infrastructure testing helper for AWS Resources that uses AWS SSM to remotely execute commands on EC2 machines.

Infrastructure testing helper for AWS Resources that uses AWS SSM to remotely execute commands on EC2 machines, to enable infrastructure engineering teams to write tests that validate behaviour.

Ankit Wal 18 Sep 5, 2022
Amazon Web Services (AWS) providerAmazon Web Services (AWS) provider

Amazon Web Services (AWS) provider The Amazon Web Services (AWS) resource provider for Pulumi lets you use AWS resources in your cloud programs. To us

William Garcia Jacobo 0 Nov 10, 2021