Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SARC-271: Update data frame with RGU data #113

Merged
merged 6 commits into from
Apr 5, 2024
Merged

SARC-271: Update data frame with RGU data #113

merged 6 commits into from
Apr 5, 2024

Conversation

notoraptor
Copy link
Contributor

Hello @bouthilx @nurbal ! Voici la PR pour SARC-271 !

@@ -40,7 +40,9 @@
"diskusage_report_command": "diskusage_report --project --all_users",
"prometheus_url": "https://mila-thanos.calculquebec.ca",
"prometheus_headers_file": "secrets/drac_prometheus/headers.json",
"start_date": "2022-04-01"
"start_date": "2022-04-01",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Je n'avais jamais réalisé qu'il y avait un start date dans la config des grappes. Ça sert à quoi? @nurbal

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ça va avec end_date dans la db pour le parametre -d auto lors du scraping des jobs.
end_date indique la date du dernier scraping réussi, utilisé pour savroi à partir de quelle date il faut scraper. Mais s'il n'est pas spécifié alors on considère qu'il faut commencer à partir de start_date.
Cette valeur dans le fichier de config indique à quoi iul faut initialiser la valuer lors du db init.

Tant u'on est là, il y a les paramètres "duc_inodes_command" et "duc_storage_command" qui ne me sembent pas servir à grand chose dans sarc ? 🤔

…obs related to given cluster name are updated.

Add new function update_job_series_rgu to apply changes on data frame for all clusters.
"nodes_info_file": "secrets/nodes_cedar.txt"
"nodes_info_file": "secrets/nodes_cedar.txt",
"rgu_start_date": "2024-04-03",
"gpu_to_rgu_billing": "secrets/gpu_to_rgu_billing_cedar.json"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@notoraptor il me faudrait les 4 fichiers gpu_to_rgu_billing_<cluster>.json avant de merger cette PR ;)

@nurbal nurbal merged commit 44eabe9 into master Apr 5, 2024
7 checks passed
@notoraptor notoraptor deleted the sarc-271 branch April 10, 2024 18:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants