Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[EPIC] Roll out a cost attribution system in all AWS clusters #4872

Open
12 of 19 tasks
Tracked by #4384
consideRatio opened this issue Sep 24, 2024 · 0 comments
Open
12 of 19 tasks
Tracked by #4384

[EPIC] Roll out a cost attribution system in all AWS clusters #4872

consideRatio opened this issue Sep 24, 2024 · 0 comments

Comments

@consideRatio
Copy link
Member

consideRatio commented Sep 24, 2024

This EPIC captures the AWS part of #4384:

Quick intro

The AWS cost attribution system is a simple Python webserver accessing AWS Cost Explorer API to summarize information about an AWS accounts billing data. This summarized billing data is then exposed via a k8s Service, making a Grafana instance able to access it as a datasource. There is a datasource plugin used for this in Grafana called Infinity, as it helps parse the JSON response provided by the webserver. The openscapes grafana instance currently has this system deployed, and the Grafana instance has a Dashboard defined within it that we can re-use.

Kinds of work involved

Most of the AWS specific parts have been done, so now working this epic will mostly involve less cloud specific parts, such as:

  • terraform / eksctl
  • grafana dashboard development like in jupyterhub/grafana-dashboards
  • interaction and communication with openscapes and nasa-cryo community
  • the deployer script (Python) and GitHub workflows
  • public communication via a blog post

As seen in openscapes

You can inspect the dashboard live at https://grafana.openscapes.2i2c.cloud/d/b4dbba938e548f10/cloud-cost-attribution?orgId=1

openscapes-cost-attribution-is-up

Tasks

  1. 51 of 54
  2. consideRatio
  3. consideRatio sgibson91
  4. GeorgianaElena
  5. consideRatio
  6. sgibson91
  7. consideRatio
  8. consideRatio
  9. consideRatio
  10. consideRatio
  11. jnywong
  12. consideRatio
  13. consideRatio
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant