Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

This repository's size is huge #184

Open
mcara opened this issue Jan 26, 2022 · 7 comments
Open

This repository's size is huge #184

mcara opened this issue Jan 26, 2022 · 7 comments

Comments

@mcara
Copy link
Member

mcara commented Jan 26, 2022

This repository includes directories for MAST downloads as well as reference CRDS files bringing the size of this repository close to 4GB. In my opinion this is not necessary and all these directories should be removed from this repository.

@nkerman
Copy link
Collaborator

nkerman commented Feb 15, 2022

In my recent clone of this directory (2022-02-15), it seems to be only about 1 GB (984 MB), and the vast majority (945 MB)of that is in the .git subdirectory.
I'm guessing that there have been images, FITS files, etc. under version control and since removed, but they live on in the .git history.

@pllim
Copy link
Contributor

pllim commented Feb 15, 2022

1 GB is also a lot of disk space for something that isn't cat videos.

@larrybradley
Copy link
Member

Reducing the repo size would require rewriting the git history.

@pllim
Copy link
Contributor

pllim commented Feb 15, 2022

Only 500-ish commits to squash...

@pllim
Copy link
Contributor

pllim commented Feb 15, 2022

Going forward, maintainers need to be strict in the review process to not allow big data files (or any) being checked in.

@nkerman
Copy link
Collaborator

nkerman commented Feb 15, 2022

One major issue is not clearing Notebook's cells before committing. (I think I was guilty of this early on in a different repo)

@pllim
Copy link
Contributor

pllim commented Feb 15, 2022

Proposal:

1, Push the current state of repo to another repo that no one will ever use (for history record keeping purpose).
2. Clear all the notebooks and unwanted data here.
3. Squash all the commits and force push to master.
4. ???
5. Profit!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants